Mainly, the series was shot at the Buckingham palace. Some scene had to be taken at another castle, looking like the Buckingham castle, you can learn more over here. Beside, the scene where the actors are outside the scenes are taken around London, on the countryside, where it is peaceful and safe to shot.
Buckingham Palace, London
Map provided by Google, use ctrl+middle mouse button to move in and out.
