This gem is often overlooked in favour of its neighbours, but England's only city named after a castle rewards those who look a little closer.