Pembrokeshire has a long history of castle building, everything from early motte and bailey castles to grand bishop’s fortified palaces.