WordPress produces a bajillion different feeds for every post, category, search, basically anything you can imagine. For a long time now some of these have shown up in search results next to regular pages, which I imagine was very confusing for people clicking from a search result to a bunch of XML. No longer! From the Webmaster blog: Taking feeds out of our web search results.
or just deny the feeds:
Disallow: */feed/
Thank god. This problem has become extremely annoying. It was so bad that at one point, almost everything I was clicking on was an XML feed.
Ditto. That was my exact thought when I read this. A tutorial robots.txt seemed like it would have been more useful and cover my issues of duplication than just your feeds.
Is “Google” now synonymous with “search”? 🙂
Lol, I use to do disallow as well.
I use in robots.txt:
Disallow: /feed
What´s the difference between that and:
Disallow: */feed/
Sabo
Sabo: WordPress has heaps of feeds beyond the one found at the root /feed/… in particular, a feed for every category and tag.