A castle is a fortified, usually walled residence, as of a prince or noble in feudal times. In medieval times, the castle was the center of any large village. In times of war or siege, the castle would be the refuge for villagers who lived outside the castle walls.