We all know Search Engine Optimization is a difficult business. Sometime we have a tendency to rank well on one engine for a specific keyphrase and assume that every one search engines can like our pages, and hence we’ll rank well for that keyphrase on variety of engines. sadly this can be rarely the case. All the most important search engines differ somewhat, thus what is get you ranked high on one engine may very well facilitate to lower your ranking on another engine.
It is for this reason that some individuals prefer to optimize pages for every specific search engine. sometimes these pages would solely be slightly completely different however this slight distinction might build all the distinction when it involves ranking high.
However as a result of search engine spiders crawl through sites indexing each page it will realize, it’d bump into your search engine specific optimizes pages and since they’re terribly similar, the spider might imagine you’re spamming it and can do one amongst 2 things, ban your web site altogether or severely punish you within the kind of lower rankings.
So what are you able to do to mention stop Google indexing pages that are meant for AltaVista, well the answer is basically quite easy and i am stunned that a lot of webmaster’s who do optimize for every search engine do not use it a lot of. It’s done employing a robots.txt file that resides on your webspace.
A Robots.txt file could be a important a part of any webmasters battle against obtaining banned or punished by the search engines if he or she styles completely different pages for various search engine’s.
The robots.txt file is simply a straightforward text file because the file extension suggests. It’s created employing a easy text editor like notepad or wordpad, difficult word processors like Microsoft Word can solely corrupt the file.