When you cook potatoes this way, they get crunchy on the outside and stay creamy on the inside. Slideshow: More Mashed Potato Recipes
Preheat the oven to 375°. On a rimmed baking sheet, toss the potatoes with the olive oil and season with salt and pepper. Roast for about 20 minutes, stirring occasionally, until the potatoes are tender.
Meanwhile, in a small saucepan, melt the butter. Add the garlic and cook over low heat for 2 minutes. Let stand for 15 minutes. Discard the garlic and stir in the caraway seeds.
Using the back of a spoon, gently press down on each potato until it cracks open. Spoon the caraway butter over the potatoes and roast for 20 minutes longer, until golden and crisp. Transfer the potatoes to a platter, garnish with the chives and serve.