A New Kind of Duplicate Content - GoogleBot Random Form Crawl

Michael VanDeMar highlights how a website lost an important page to duplication across a new not so important page, which was added to the Google index by Google filling out forms.

If you have limited PageRank and a Google accessible form or search box you may want to block them from indexing output URLs via a robots noindex meta tag or your robots.txt file.

Published: May 23, 2008 by Aaron Wall in google

New to the site? Join for Free and get over $300 of free SEO software.

Once you set up your free account you can comment on our blog, and you are eligible to receive our search engine success SEO newsletter.

Already have an account? Login to share your opinions.

Comments

May 24, 2008 - 7:42am

Hey Aaron. :)

Just to clarify, the site that lost the ranking page to the poorer ranking dupe wasn't a client of mine. I saw it happen to my site and went to see if it was a fluke or a pattern, and I found his site as well.

May 24, 2008 - 7:44am

Will update it. Sorry on the Michael.

But maybe he will read your post and hire you ;)

May 25, 2008 - 12:48am

Do duplicate keyword lists within a same domain count against you?

New to the site? Join for Free and get over $300 of free SEO software.

Once you set up your free account you can comment on our blog, and you are eligible to receive our search engine success SEO newsletter.

Already have an account? Login to share your opinions.

Gain a Competitive Advantage Today

Your top competitors have been investing into their marketing strategy for years.

Now you can know exactly where they rank, pick off their best keywords, and track new opportunities as they emerge.

Explore the ranking profile of your competitors in Google and Bing today using SEMrush.

Enter a competing URL below to quickly gain access to their organic & paid search performance history - for free.

See where they rank & beat them!

  • Comprehensive competitive data: research performance across organic search, AdWords, Bing ads, video, display ads, and more.
  • Compare Across Channels: use someone's AdWords strategy to drive your SEO growth, or use their SEO strategy to invest in paid search.
  • Global footprint: Tracks Google results for 120+ million keywords in many languages across 28 markets
  • Historical data: since 2009, before Panda and Penguin existed, so you can look for historical penalties and other potential ranking issues.
  • Risk-free: Free trial & low price.
Your competitors, are researching your site

Find New Opportunities Today


    Email Address
    Pick a Username
    Yes, please send me "7 Days to SEO Success" mini-course (a $57 value) for free.

    Learn More

    We value your privacy. We will not rent or sell your email address.