[typo] additional robots.txt entries

Tim Connor qeantk at gmail.com
Sun Oct 29 02:13:53 EST 2006


Any chance we could get the trackback urls added to the robots.txt disallow
(with any appropriate user-agent filtering needed to let trackbacks still
work, if any trackback supporting blogs even read the robots.txt file) , so
the googlebot will leave them alone?

Personally, I think the feeds should be added to, but maybe people
disagree.  I just know I'm tired of googling things and getting the xml
version, myself.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://rubyforge.org/pipermail/typo-list/attachments/20061029/609211a8/attachment.html 


More information about the Typo-list mailing list