Quote:
Originally Posted by major
can we go more specific in this technique? like "attention all google and yahoo spiders, msn not allowed"  |
What technique? I was making a joke that some people actually think somethink like "Attention all search engine spiders" followed by spammy content makes a positive difference in search engine rankings.
If you want to exclude certain bots or spiders from your site you need to set the directives in your
robots.txt file.