In a large skillet heat oil over medium-high heat. Add garlic and anchovy fillets; cook and stir for 30 seconds. Add undrained tomatoes, potatoes, oregano, black pepper, red pepper, and salt. Bring to boiling; reduce heat. Cover and simmer for 10 minutes, stirring once.
Stir in olives and capers. Place the cod on top of the potato mixture. Cover and simmer about 10 minutes or until potatoes are tender and fish flakes easily when tested with a fork. Stir together parsley and Parmesan; sprinkle over potato mixture in skillet.