[typo] additional robots.txt entries
qeantk at gmail.com
Sun Oct 29 02:13:53 EST 2006
Any chance we could get the trackback urls added to the robots.txt disallow
(with any appropriate user-agent filtering needed to let trackbacks still
work, if any trackback supporting blogs even read the robots.txt file) , so
the googlebot will leave them alone?
Personally, I think the feeds should be added to, but maybe people
disagree. I just know I'm tired of googling things and getting the xml
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Typo-list