In a large skillet, heat 2 tablespoons of the oil over moderate heat. Add the garlic and crushed red pepper and cook just until fragrant. Off the heat, add the broccoli and cauliflower and toss. Toss half of the cheese and the olives with the vegetables. Transfer to the baking dish and sprinkle with the remaining cheese.