It may not be so obvious at first (especially beginners to SEO), but to be found in the search engines, and in Google – you need to have your site indexed (content stored in their database(s)).
Crawling is only part of the issue. Data needs to be compiled and copied from your server to theirs, simply stated.
Much like you would write down your friend’s information and meta data into your address book for easy organization and retrieval, search engines do the same (and more).
So, how do you find out if your website has been indexed, and at least “available” to be found for your keywords?
Look at this quick video (I put in my highest production budget ever….Not) 🙂
- 10+ SEO Bots & What You Need to Know (marketingpilgrim.com)
- How To Silo Your Website: The Masthead (wolf-howl.com)
- Google Patent Granted on Polite Web Crawling (seobythesea.com)
- What is a Googlebot? (brighthub.com)