This is a great place to start your visit. You'll find out about the history of the town, and you can book walking tours, including the guided ghost tour.
The castle hosts a number of very interesting exhibits, including medieval artefacts, and if you're looking for stunning views, then the balcony of the Ypres Tower is a good place to go!
This house is full of literary history - Henry James bought the house in the late 19th century and wrote three novels here, and E F Benson also lived here. Lamb House was the inspiration for Mallards, the house in his Mapp and Lucia novels.