
It is supported by Yahoo! Slurp too!
Not sure if I have seen this mentioned before. Dan Thies noticed Googlebot's wildcard robot.txt support:
Google's URL removal page contains a little bit of handy information that's not found on their webmaster info pages where it should be.Google supports the use of 'wildcards' in robots.txt files. This isn't part of the original 1994 robots.txt protocol, and as far as I know, is not supported by other search engines. To make it work, you need to add a separate section for Googlebot in your robots.txt file. An example:
User-agent: Googlebot
Disallow: /*sort=This would stop Googlebot from reading any URL that included the string &sort= no matter where that string occurs in the URL.
Good information to know if your site has recently suffered in Google due to duplicate content issues.
Dan also recently an SEO coach blog on his SEO Research Labs site.
New to the site? Join for Free and get over $300 of free SEO software.

Once you set up your free account you can comment on our blog, and you are eligible to receive our search engine success SEO newsletter.
Already have an account? Login to share your opinions.
Tried to submit this for a client:
User-agent: Googlebot
Disallow: /*PHPSESSID=
Through the Removal site
But I get the folowing message: URLs cannot have wild cards in them (e.g. "*"). The following line contains a wild card: DISALLOW /*PHPSESSID=
¿so?

I am also getting this message form Google, when I try to remove:
URLs cannot have wild cards in them (e.g. "*"). The following line contains a wild card:
DISALLOW /thread*-0.html
It was around for years. See http://www.webmasterworld.com/forum93/106.htm
In 2005 (when I wrote this post) I don't think Microsoft did.
New to the site? Join for Free and get over $300 of free SEO software.

Once you set up your free account you can comment on our blog, and you are eligible to receive our search engine success SEO newsletter.
Already have an account? Login to share your opinions.



Visit PPC Blog, our new sister site focused on pay per click marketing.
Join our training program today and get the Google rankings, search traffic, growth, and profits you deserve!
Not convinced? Try our free 7-day course for beginners. After viewing it we hope to see you join our community! Best of luck growing your business & we hope our site helps increase your rankings!
In Short? We offer the #1 SEO training program. And it comes with tools, videos, a private member's forum, and so much more.

