How to Make It
Butter a 10-inch cake pan. Melt the butter in a large skillet. Add the apple wedges in an even layer and cook over moderately low heat, turning halfway through cooking, until golden brown, about 8 minutes. Add the brandy and simmer until the alcohol cooks off, about 3 minutes. Add the sugar and cook, stirring occasionally, until the apples are browned and the sugar caramelizes to a deep golden, about 12 minutes.
Using a slotted spoon, transfer the cooked apples to the prepared cake pan and arrange them in concentric circles. Pour the caramel over the apples.
Preheat the oven to 350°. In a medium bowl, mix the buttermilk with the egg yolks and vanilla. In a large bowl, combine the cake flour, sugar, all-purpose flour, baking powder, baking soda, nutmeg, cinnamon, cloves and salt. Using an electric mixer, beat in the butter. Gradually add the buttermilk mixture, beating on low speed until well blended.
Scrape the batter over the apples in the pan and smooth the top. Bake for about 30 minutes, or until a cake tester inserted in the center comes out clean. Let the cake cool until warm, then invert onto a large plate. Cut the cake into wedges and serve with the vanilla ice cream.