You can swim around very outside edge of the continents, even where all the mountains were. Somewhere miles away on the backside of nowhere there was a little dilapidated house.
In vanilla, I spent one full night just swimming around the Eastern Kingdoms on my druid. I'd recently heard rumors about the Ashbringer possibly existing in the game, just waiting for some wandering soul to come across its incredibly well hidden home, possibly requiring high level fishing skill to attain. Despite the fact that the scenery was mostly repetitive and to most anyone else should have been incredibly boring, I really enjoyed the evening.
I later became a Game Master and had the ability to fly invisibly through the terrain on live servers and occasionally would make a point to travel to random nooks, either not normally accessible or else very hard and time consuming to reach by legal means, and that was fun too. This was before flying mounts: characters would appear to swim through the air and could be made to travel very fast indeed.
The best hidden secrets in the game were things like The Chair, at the base of The Room, an underground dungeon that could only be reached by flying through the terrain of a castle that stood on Game Master Island, which itself could only be accessed using Game Master powers. Rumors were that early rule breakers in the game, perhaps in beta, were transported into The Room where all they could do is sit in The Chair or not. I don't know if that's true.
Probably people discovered all this on private servers as well, but there was definitely something magical about doing it on live realms - at least for me.
GMs used to teleport people to GM island on my original server for fixing various things WAY back in the day. There were a few exploit mechanics that enabled regular players getting there. (Briefly via teleport hack but I think there were 'legit' methods for a window of time with spirit regen + low level rogue maybe?)
Ah, here it is. The internet documents everything. http://wow.gamepedia.com/Newman's_Landing?cookieSetup=true