I manage several websites, all of which are fun projects for the most part, nothing serious or commercial.
However, times have changed a great deal in the last 7+ years when it comes to getting your web site spidered and indexed by the big search engines so that it can appear in search results when someone types in your URL (address) or keywords that apply to your site.
For one thing, in the last 7 years Google has come to the fore and now dominates the search engine business. Why it became so popular I am not sure, but the term “Googling” is synonymous with “searching” these days when it comes to web searches.
Back in the day, it was relatively easy to submit your site to the many search engines around at that time. All the sites, Google included, used to include a link on their main page that webmasters could follow for submitting their website URL to that particular search engine.
These days however, the placement and ranking of a website on a search engine is very big business indeed. As with most things in life, if its free at first and holds merit, it will eventually become commercialized and costly.
The easiest way to see if your site has been indexed is to type your URL e.g. http://www.mywebpage.com in to the search field and hit search. If results come up, you have been indexed. Google chooses not to add every site that it indexes to its mammoth search engine database, however, even if you don’t know about Google, Google knows about you! Google’s spidering web-bots, the AI software it uses to index and spider websites, can land on your domain and look at your pages whether you are aware of it or not.
For example, four days ago I launched a new website. I had not announced it and there were no links on my new site that linked out of my domain to any other websites. Yet, less than two days later I was monitoring IP addresses and noticed not one, but two Google bots examining my site, and not just the homepage either, they were 3 levels deep. How do they do this? I have no idea but Google is like the silent big-brother of the web.
Now to the point of this post. I had a need this morning to submit a site of mine to Google as I wish it to be indexed. A simple task I thought. After spending 15 minutes following links on Google’s website I finally found what I was looking for, buried deep in their site. “My dear Google, one could be forgiven for thinking that you really don’t want people to manually submit their sites to your search engine any more? Is there something you are not telling us?”
Anyway, to save others the time and frustration, here is the URL submission page for submitting your site to Google (at least until they decide to move it again):