I think I'm probably the nearest neighbour with my little sub pen in Blackrock Bay, but I dont see any issues.
The weird little hut on the hill to the south was made by me and Drew and Rwody while out on an adventure. You're welcome to destroy it. There's a skeleton spawner under the sand to the south-east that I had the idea of making into an arrow/bonemeal farm but I havent ever got round to. If the mood takes you, feel free to take it over.