Most visitors to Amsterdam will wander into the red-light district out of sheer curiosity. The narrow streets are mostly safe day and night - just don't try to take pictures of the women working in the windows.
Lympne Castle opens its doors to visitors during the summer only. It is privately owned, and more an interesting medieval manor than a castle.