more info http://www.wowwiki.com/Map_coordinates
You should definitely get a map addon. Most of the time map addons will help you finish your quests quicker too!
Here's an addon I like and is pretty popular: Carbonite
http://wow.curse.com/downloads/wow-addons/details/carbonite.aspx
just download map addon it will help you.