Tweet
There is a lot of misinformation out there. I mean it is crazy.
I got a copy of the Dummies Guide to Adsense and on page 55 of the book, it tells you to put this code
User-agent: *
Disallow: /
in your robots.txt file to ALLOW robots to scrub your whole site. Wow. That code will EXCLUDE all robots from the entire server.
The correct code to allow all robots complete access is
User-agent: *
Disallow:
(or just create an empty "/robots.txt" file, or don't use one at all).
I mean come on...the entire premise of the book is to get traffic on your site and here the author is giving you a "tip" that will shut you down completely.
I got a copy of the Dummies Guide to Adsense and on page 55 of the book, it tells you to put this code
User-agent: *
Disallow: /
in your robots.txt file to ALLOW robots to scrub your whole site. Wow. That code will EXCLUDE all robots from the entire server.
The correct code to allow all robots complete access is
User-agent: *
Disallow:
(or just create an empty "/robots.txt" file, or don't use one at all).
I mean come on...the entire premise of the book is to get traffic on your site and here the author is giving you a "tip" that will shut you down completely.
Comment