This fortress was the centre of the FitzHerbert Barony of Talgarth founded in 1208. First mentioned in 1215, the castle was granted in 1310 to Roger Mortimer of Chirk for life, but was seized by the Crown after his rebellion in 1321-2. Held by the Despensers until their overthrow in 1326, it was then acquired by Roger Mortimer of Wigmore, subsequently 1st Earl of March. Confiscated after his execution in 1330, it was returned to the Mortimers of Wigmore in 1352 and it remained a Mortimer property till the death of the 5th Earl of March in 1425.

It’s possible that the castle never really recovered from the attentions of Llywelyn ap Gruffydd in the 1260s. Its plan was rectangular with chamfered corners, and there were at least two round towers, the remains of one being being overlain by a later curtain wall. An inventory of  1330 and jury inquisition in 1337 mention a hall, kitchen, chambers, latrines, brewhouse, chapel etc.