Google's Cat & Mouse SEO Game

This infographic highlights how Google's cat and mouse approach to SEO has evolved over the past decade.

One of the best ways to understand where Google is headed is to look at where they have been and how they have changed.

Click on it for ginormous version.

Google's Collateral Damage Infographic.

If you would like us to make more of them then please spread this one. We listen to the market & invest in what it values ;)

Feel free to leave comments below if you have any suggestions or feedback on it :)

Conversion Optimization Book Review

Conversion optimization is an ongoing concern for serious businesses. When viewed in the shadow of a big change like Google's recent Panda Farmer update, optimizing your site's existing traffic streams becomes even more attractive - or necessary - to remain competitive.

A book was released recently by O'Reilly, authored by Khalid Saleh and Ayat Shukairy, the co-founders of Invesp - a leading conversion optimization company. Entitled: Conversion Optimization: The Art and Science of Converting Prospects to Customers it is now available from Amazon and most other book providers.

For developing a better understanding of the foundational basics and lucrative potential of conversion optimization, it is a book I would highly recommend.

Tone and Style

Conversion optimizing is a dense subject, with lots of bits-and-bytes of small, related information tied together to make a complete picture. Saleh and Shukairy tackle this book with the intention of making this dense, complicated subject easier to understand conceptually, and therefore, profit from.
The first two chapters offer simple foundational ideas for the novice, covering the general concepts, analytics and formulas typically used in measuring and improving conversions. However, in the introduction the authors make this clear - and suggest those with a bit of experience may want to skip right to chapter three. I appreciated the suggestion, but read from the beginning anyway. :)

I like the way this book progresses in this manner - each successive chapter builds on the ideas posited in previous chapters. Even though I have some experience with optimization, I read the book from the beginning. While it was not new information to me, it was nice to reaffirm where my thinking aligns with conversion experts and identify places where our opinions diverged.

Once chapter three starts, the simple ideas presented in the beginning of the book are built-on slowly, which encourages you to see how smaller ideas nourish the roots of larger results. This is a an example of a well considered and deftly executed book idea - and it makes reading and learning easier.

A simple tone from industry experts is common with O'Reilly books - it is part of what makes them solid study materials, especially for introducing you to new subjects. What I think Saleh and Shukairy do uniquely well, is inject just enough warmth in their tone to keep the flow engaging without overdoing it and diluting the impact of the subject matter. It is a careful balancing act - they obviously have a ton of information to share and don't want to overwhelm the reader, but at the same time need to keep it on a level that most anyone can embrace.

Cold facts often need warming-up before serving them. Saleh and Shukairy say: "Conversion optimization is a blend of science and art. It is the intersection of creative, marketing, and analytical disciplines." I would add that creating an easily digestible tome on a genuinely dry subject matter is an art of its own. It requires an intersecting of knowledge, warmth, experience and understanding, and the writing skills to blend these seamlessly. Saleh and Shukairy use a simple tone and style to layer their ideas upon each other and leave the reader with a sense of foundation and conceptual understanding.

Informational Depth

The meat of this book concentrates on presenting eight principles that combine into what Saleh and Shukairy call the "Conversion Framework." They believe that understanding this framework correctly allows you to apply it judiciously and continue to benefit from conversion optimizing efforts both online and offline. They want to teach a man to fish, not simply feed him.

Here again is where the reader benefits from the approach of these specific authors. Rather than using ideas that are rooted in topical or fleeting "what is working now" type of thinking, Saleh and Shukairy want you to avoid the simple path, and learn something deeper - something that will continue to offer you value.

These concepts are explained and well supported by examples, numbers and facts. For example, when discussing the creation of personas, they are adamant to warn against getting lost in this effort and provide realistic numbers for you to use to keep your own efforts in-check. While they are encouraging the implementation of conceptual information, they offer guidelines and warnings that are much more concrete. They walk you slowly to the intersection of art and science.

After the Conversion Framework concepts are presented and supported in chapters 3-8, in chapter nine Saleh and Shukairy present you with 49 specific things to consider in optimizing your website. This part of the book is something very concrete that you can return to for any new project. While you may not want to do all 49 of these things to every effort, it is a safe bet that your best moves for most optimization projects are clearly detailed within them. I'd recommend a bookmark here.

One thing I like about these 49 specific things to address, is that Saleh and Shukairy are candid about what to expect. If a change is not likely to produce much of a lift, they state it. What this does, is helps you to approach your own efforts with additional perspective on potential results. You can save time through the benefit of following the authors' expert advice.

Ultimately, the informational depth of a book like this should work to save you time and efforts - bringing an understood focus and purpose to your next move. By establishing a conceptual framework and then offering concrete, actionable items Saleh and Shukairy present a well-balanced and useful resource that achieves this purpose.

Potential Audiences

While I feel most people who work in selling products would benefit from the ideas presented in this book, the authors themselves offer a warning in the preface to answer the question, "Who Should Not Read This Book?"

We cast a wide net when we wrote this book, but there are a few people who might not enjoy it. Developers whose work stays far from the actual user of their application (i.e., developers of backend applications) aren't likely to enjoy this book. Those who believe that conversion optimization is only about testing may not like our approach to optimization. Finally, those who are looking for pure tactics and are not concerned with the theory behind conversion optimization might find some of the chapters in the book boring.

Personally, I believe that with the simple tone and structured logic in the way the concepts are presented, this is a quick read that offers a lot to gain. Having the 49 items to optimize as a reference-ready checklist simply adds to the overall value.

Consider this: Brand new, this book (offered bundled in both print an e-format) retails for less than $40 US, and you can buy it as just an e-book for even less. This is a very small investment if even one idea in it pays off for you somewhere. If more of these ideas resonate, you may implement new strategies that increase your returns by thousands, or even hundreds-of-thousands of dollars. The potential effect of conversion optimizing cannot be overstated.

In times when it gets harder to count on the search engines to bring you more and more traffic, it is a shrewd move indeed to look toward conversion optimization. Saleh and Shukairy offer you a simple, straightforward means to consider; reading Conversion Optimization: The Art and Science of Converting Prospects to Customers can easily be seen as a small, but smart investment in remaining competitive.

How Google Destroyed the Value of Google Site Search

Do You Really Want That Indexed?

On-demand indexing was a great value added feature for Google site search, but now it carries more risks than ever. Why? Google decides how many documents make their primary index. And if too many of your documents are arbitrarily considered "low quality" then you get hit with a sitewide penalty. You did nothing but decide to trust Google & use Google products. In response Google goes out of its way to destroy your business. Awesome!

Keep in mind that Google was directly responsible for the creation of AdSense farms. And rather than addressing them directly, Google had to roll everything through an arbitrary algorithmic approach.

< meta name="googlebot" content="noindex" />

Part of the prescribed solution to the Panda Update is to noindex content that Google deems to be of low quality. But if you are telling GoogleBot to noindex some of your content, then if you are also using them for site search, you destroy the usability of their site search feature by making your content effectively invisible to your customers. For Google Site Search customers this algorithmic change is even more value destructive than the arbitrary price jack Google Site Search recently did.

We currently use Google Site Search on our site here, but given Google's arbitrary switcheroo styled stuff, I would be the first person to dump it if they hit our site with their stupid "low quality" stuff that somehow missed eHow & sites which wrap repurposed tweets in a page. :D

Cloaking vs rel=noindex, rel=canonical, etc. etc. etc.

Google tells us that cloaking is bad & that we should build our sites for users instead of search engines, but now Google's algorithms are so complex that you literally have to break some of Google's products to be able to work with other Google products. How stupid! But a healthy reminder for those considering deeply integrating Google into your on-site customer experience. Who knows when their model will arbitrarily change again? But we do know that when it does they won't warn partners in advance. ;)

I could be wrong in the above, but if I am, it is not easy to find any helpful Google documentation. There is no site-search bot on their list of crawlers, questions about if they share the same user agent have gone unanswered, and even a blog post like this probably won't get a response.

That is a reflection of only one more layer of hypocrisy, in which Google states that if you don't provide great customer service then your business is awful, while going to the dentist is more fun than trying to get any customer service from Google. :D

I was talking to a friend about this stuff and I think he summed it up perfectly: "The layers of complexity make everyone a spammer since they ultimately conflict, giving them the ability to boot anyone at will."

Poke The Box Review

I received this book in the mail.

It's nice to be sent books. And it's by Seth!

The book is called Poke The Box. It's about making a start. Seth encourages us to just jump in and do things. It doesn't matter if they go wrong, the important thing is to make the start. To break out of conservative patterns. It's a scatter-shot rant about the death of the industrial revolution, with Godin inciting us, over and over again, to take action.

Gotta say, I was a little disappointed by the book. It skates over the surface, didn't really hang together, and recycles some pretty tired themes. This review amused me.

Or maybe this book is the start of something else Seth has in mind. I don't know. Having said that, I think the central point of the book is valuable, and that is to.....

Start Something

Do you ever regret not buying a particular domain name? Or a particular site? Do you regret not having started a site in that niche that is now taking off? Do you ever feel you've missed the boat on affiliate marketing? Do you regret not going harder at SEO in the days when it was just that much easier?

I think a lot of us can relate. There are always regrets and missed opportunities.

We *could* have done some of these things. But, for whatever reason, we didn't. And we probably still find reasons not to make a start on things today. Chances are, we're going to regret not having started them when we look back five years from now, too.

Take Seth's advice, and just make the start on that thing you are thinking of doing.

Fail At Something

Often we don't start something because we're scared of failing. However, as we know, failure is a part of life. The old cliche about the only way never to fail is to never try anything - rings true.

In SEO, one thing that might be good to start, if you're not doing so already, is some simple testing. Buy a few cheap domain names, add a little content, and try to get the site ranking for some obscure keyword term. As you don't really care about the keyword term, you can remain focused on pure SEO. If it fails to work, it doesn't matter. In fact, that tells you something about whatever technique you were using.Throw a few links at it. What happens? Does this fail to produce rankings? At least you know who not to get links from in future!

This is something I've let slip lately, so I'm going to make a new start on it, too.

Do Something Worth Doing

Seth mentions Tom Peters, who wrote "In Search Of Excellence". Seth sees that Peters is frustrated, because people are hearing his message, without embracing the thinking behind it. Being excellent isn't about doing what working extra hard at doing what you're told, it's about making the leap and doing work you decide is worth doing.

Sometimes, the thing that enables us to keep going with a site is simply that we believe in it. Nobody else might be paying attention. The rankings are mediocre. No one is linking to it. But if we feel what we're doing is worthwhile, we're more likely to work through the rough patches when there is no other reward on offer. If we don't really believe in a project, it's hard to find the will to work through the inevitable challenges.

Summary

Well, I guess should just say "Go!" :)

Why not - today - start something new.

Download IE9

If Microsoft used their primary product to bundle other free products they were giving away to gain market leverage Google would hoot and/or holler. Google demanded that Chrome be shown as an option in Europe when Microsoft was required to market their competitors via BrowserChoice.eu.

Yet if you visit YouTube with an old browser you can see that Google claims it isn't an advertisement, yet somehow Internet Explorer didn't make the short list.

IE9 launched as a solid product with great reviews and enhanced privacy features.

A new version of Microsoft Corp.'s Internet Explorer to be released Tuesday will be the first major Web browser to include a do-not-track tool that helps people keep their online habits from being monitored.

Microsoft's decision to include the tool in Internet Explorer 9 means Google Inc. and Apple Inc. are the only big providers of browsers that haven't yet declared their support for a do-no-track system in their products.

I have long been a fan of using multiple web browsers for different tasks. Perhaps the single best reason to use IE9 is that a large segment of your customer base will be using it. Check out how search is integrated into the browser and use it as a keyword research tool.

The second best reason to use it is that sending some usage data to Microsoft will allow them to improve their search relevancy to better compete with Google. As a publisher I don't care who wins in search, so much as I want the marketshare to be split more evenly, such that if Panda II comes through there is less risk to webmasters. Stable ecosystems allow aggressive investment in growth, whereas unstable ones retard it.

Speaking of Google, Michael Gray recently wrote: "They are the virtual drug dealers of the 21st century, selling ads wrapped around other people’s content, creating information polluted ghettos, and they will become the advertising equivalent of a drug lord poised to rule the web."

The problem with Google's ecosystem was not only that it was running fast and loose (hence the need for the content farm update, a problem Google created, and a solution which had major collateral damage along with some unintended consequences, while missing the folks who were public enemy #1).

Beyond that, Google recently announced the ability for you to report counterfeit products advertised in AdWords. Their profit margins are pretty fat. Why did the problem go ignored so long? Why does the solution require you to work for Google for free?

In the following video, Matt winces, as though he might have an issue with what he is saying. "We take our advertising business very seriously as well. Both our commitment to delivering the best possible audience for advertisers, and to only show ads that you really want to see." - Matt Cutts

How does this relate to Internet Explorer 9? Well let's look at what sort of ads Google is running:

I am not sure if that is legal. But even if it is, it is low brow & sleazier than Google tries to portray their brand as being.

If Microsoft did the same thing you know Google would cry. Ultimately I think Google's downfall will be them giving Microsoft carte blanche to duplicate their efforts. Microsoft has deep pockets, fat margins, and is rapidly buying search marketshare. If Microsoft can use their browser as a storefront (like Google does) they have much greater marketshare than Chrome has.

Cory Doctorow's excellent essay "Beware the spyware model of technology – its flaws are built in" is a great read & warns where the above approach leads.

Is the Huffington Post Google's Favorite Content Farm?

I was looking for information about the nuclear reactor issue in Japan and am glad it did not turn out as bad as it first looked!

But in that process of searching for information I kept stumbling into garbage hollow websites. I was cautious not to click on the malware results, but of the mainstream sites covering the issue, one of the most flagrant efforts was from the Huffington Post.

AOL recently announced that they were firing 15% to 20% of their staff. No need for original stories or even staff writers when you can literally grab a third party tweet, wrap it in your site design, and rank it in Google. Inline with that spirit, I took a screenshot. Rather than calling it the Huffington Post I decided a more fitting title would be plundering host. :D

plundering host.

We were told that the content farm update was to get rid of low quality web pages & yet that information-less page was ranking at the top of their search results, when it was nothing but a 3rd party tweet wrapped in brand and ads.

How does Huffington Post get away with that?

You can imagine in a hyperspace a bunch of points, some points are red, some points are green, and in others there’s some mixture. Your job is to find a plane which says that most things on this side of the place are red, and most of the things on that side of the plane are the opposite of red. - Google's Amit Singhal

If you make it past Google's arbitrary line in the sand there is no limit to how much spamming and jamming you can do.

we actually came up with a classifier to say, okay, IRS or Wikipedia or New York Times is over on this side, and the low-quality sites are over on this side. - Matt Cutts

(G)arbitrage never really goes away, it just becomes more corporate.

The problem with Google arbitrarily picking winners and losers is the winners will mass produce doorway pages. With much of the competition (including many of the original content creators) removed from the search results, this sort of activity is simply printing money.

As bad as that sounds, it is actually even worse than that. Today Google Alerts showed our brand being mentioned on a group-piracy website built around a subscription model of selling 3rd party content without permission! As annoying as that feels, of course there are going to be some dirtbags on the way that you have to deal with from time to time. But now that the content farm update has went through, some of the original content producers are no longer ranking for their own titles, whereas piracy sites that stole their content are now the canonical top ranked sources!

Google never used to put piracy sites on the first page of results for my books, this is a new feature on their part, and I think it goes a long way to show that their problem is cultural rather than technical. Google seems to have reached the conclusion that since many of their users are looking for pirated eBooks, quality search results means providing them with the best directory of copyright infringements available. And since Google streamlined their DMCA process with online forms, I couldn’t discover a method of telling them to remove a result like this from their search results, though I tried anyway.
... I feel like the guy who was walking across the street when Google dropped a 1000 pound bomb to take out a cockroach - Morris Rosenthal

Way to go Google! +1 +1

Too clever by half.

Google's Matt Cutts Talks Down Keyword Domain Names

I have long documented Google's preference toward brands, while Google has always stated that they don't really think of brand.

While not thinking of brands, someone on the Google UI team later added navigational aids to the search results promoting popular brands - highlighting the list of brands with the label "brands" before the list of links.

Take a look at what Matt Cutts shares in the following video, where he tries to compare brand domain names vs keyword domain names. He highlights brand over and over again, and then when he talks about exact match domains getting a bonus or benefit, he highlights that Google may well dial that down soon.

Now if you are still on the fence, let me just give you a bit of color. that we have looked at the rankings and the weights that we give to keyword domains, & some people have complained that we are giving a little too much weight for keywords in domains. So we have been thinking about at adjusting that mix a bit and sort of turning the knob down within the algorithm, so that given 2 different domains it wouldn't necessarily help you as much to have a domain name with a bunch of keywords in it. - Matt Cutts

For years the Google algorithm moved in one direction, and that was placing increased emphasis on brand and domain authority. That created the content farm problem, but with the content farm update they figured out how to dial down a lot of junk hollow authority sites. They were able to replace "on-topic-ness" with "good-ness," according to the search quality engineer who goes by the nickname moultano. As part of that content farm update, they dialed up brands to the point where now doorway pages are ranking well (so long as they are hosted on brand websites).

Google keeps creating more signals from social media and how people interact with the search results. A lot of those types of signals are going to end up favoring established brands which have large labor forces & offline marketing + distribution channels. Google owns about 97% of the mobile search market, so more and more of that signal will eventually end up bleeding into the online world.

In addition to learning from the firehose of mobile search data, Google is also talking about selling hotel ads on a price per booking. Google can get a taste of any transaction simply by offering free traffic in exchange for giving them the data needed to make a marketplace & then requiring access to the best deals & discounts:

It is believed that Google requires participating hotels to provide Google Maps with the lowest publicly available rates, for stays of one to seven nights, double occupancy, with arrival days up to 90 days ahead.

In a world where Google has business volume data, clientele demographics, pricing data, and customer satisfaction data for most offline businesses they don't really need to place too much weight on links or domain names. Businesses can be seen as being great simply by being great.*

(*and encouraging people to stuff the ballot box for them with discounts :D)

Classical SEO signals (on-page optimization, link anchor text, domain names, etc.) have value up until a point, but if Google is going to keep mixing in more and more signals from other data sources then the value of any single signal drops. I haven't bought any great domain names in a while, and with Google's continued brand push and Google coming over the top with more ad units (in markets like credit cards and mortgage) I am seeing more and more reason to think harder about brand. It seems that is where Google is headed. The link graph is rotted out by nepotism & paid links. Domain names are seen as a tool for speculation & a short cut. It is not surprising Google is looking for more signals.

How have you adjusted your strategies of late? What happens to the value of domain names if EMD bonus goes away & Google keeps adding other data sources?

A Thought Experiment on Google Whitelisting Websites

Google has long maintained that "the algorithm" is what controls rankings, except for sites which are manually demoted for spamming, getting hacked, delivering spyware, and so on.

At the SMX conference it was revealed that Google uses white listing:

Google and Bing admitted publicly to having ‘exception lists’ for sites that were hit by algorithms that should not have been hit. Matt Cutts explained that there is no global whitelist but for some algorithms that have a negative impact on a site in Google’s search results, Google may make an exception for individual sites.

The idea that "sites rank where they deserve, with the exception of spammers" has long been pushed to help indemnify Google from potential anti-competitive behavior. Google's marketing has further leveraged the phrase "unique democratic nature of the web" to highlight how PageRank originally worked.

But why don't we conduct a thought experiment for the purpose of thinking through the differences between how Google behaves and how Google doesn't want to be perceived as behaving.

Let's cover the negative view first. The negative view is that either Google has a competing product or a Google engineer dislikes you and goes out of his way to torch your stuff simply because you are you and he dislikes you & is holding onto a grudge. Given Google's current monopoly-level marketshare in most countries, such would be seen as unacceptable if Google was just picking winners and losers based on their business interests.

The positive view is that "the algorithm handles almost everything, except some edge cases of spam." Let's break down that positive view a bit.

  • Off the start, consider that Google engineers write the algorithms with set goals and objectives in mind.
    • Google only launched universal search after Google bought Youtube. Coincidence? Not likely. If Google had rolled out universal search before buying Youtube then they likely would have increased the price of Youtube by 30% to 50%.
    • Likewise, Google trains some of their algorithms with human raters. Google seeds certain questions & desired goals in the minds of raters & then uses their input to help craft an algorithm that matches their goals. (This is like me telling you I can't say the number 3, but I can ask you to add 1 and 2 then repeat whatever you say :D)
  • At some point Google rolls out a brand-filter (or other arbitrary algorithm) which allows certain favored sites to rank based on criteria that other sites simply can not match. It allows some sites to rank with junk doorway pages while demoting other websites.
  • To try to compete with that, some sites are forced to either live in obscurity & consistently shed marketshare in their market, or be aggressive and operate outside the guidelines (at least in spirit, if not in a technical basis).
  • If the site operates outside the guidelines there is potential that they can go unpenalized, get a short-term slap on the wrist, or get a long-term hand issued penalty that can literally last for up to 3 years!
  • Now here is where it gets interesting...
    • Google can roll out an automated algorithm that is overly punitive and has a significant number of false positives.
    • Then Google can follow up by allowing nepotistic businesses & those that fit certain criteria to quickly rank again via whitelisting.
    • Sites which might be doing the same things as the whitelisted sites might be crushed for doing the exact same thing & upon review get a cold shoulder.

You can see that even though it is claimed "TheAlgorithm" handles almost everything, they can easily interject their personal biases to decide who ranks and who does not. "TheAlgorithm" is first and foremost a legal shield. Beyond that it is a marketing tool. Relevancy is likely third in line in terms of importance (how else could one explain the content farm issue getting so out of hand for so many years before Google did something about it).

Doorway Pages Ranking in Google in 2011?

When Google did the Panda update they highlighted that not only did some "low quality" sites get hammered, but that some "high quality" sites got a boost. Matt Cutts said: "we actually came up with a classifier to say, okay, IRS or Wikipedia or New York Times is over on this side, and the low-quality sites are over on this side."

Here is the problem with that sort of classification system: doorway pages.

The following Ikea page was ranking page 1 in the search results for a fairly competitive keyword.

Once you strip away the site's navigation there are literally only 20 words on that page. And the main body area "content" for that page is a link to a bizarre, confusing, and poor-functioning flash tour which takes a while to load.

If you were trying to design the worst possible user experience & wanted to push the "minimum viable product" page into the search results then you really couldn't possibly do much worse that that Ikea page is (at least not without delivering malware and such).

I am not accusing Ikea of doing anything spammy. They just have terrible usability on that page. Their backlinks to that page are few in number & look just about as organic as they could possibly come. But not that long ago companies like JC Penny and Overstock were demoted by Google for building targeted deep links (that they needed in order to rank, but were allegedly harming search relevancy & Google user experience). Less than a month later Google arbitrarily changed their algorithm to where other branded sites simply didn't need many (or in some cases any) deep links to get in the game, even if their pages were pure crap. Google Handling Flash.

We are told the recent "content farm" update was to demote low quality content. If that is the case, then how does a skeleton of a page like that rank so high? How did that Ikea page go from ranking on the third page of Google's results to the first one? I think Google's classifier is flashing a new set of exploits for those who know what to look for.

A basic tip? If you see Google ranking an information-less page like that on a site you own, that might be a green light to see how far you can run with it. Give GoogleBot the "quality content" it seeks. Opportunity abound!

Quick & Dirty Competitive Research for Keywords

There are so many competitive research tools on the market. We reviewed some of the larger ones here but there are quite a few more on the market today.

The truth is that you can really get a lot of good, usable data to give you an idea of what the competition is likely to be by using free tools or the free version of paid tools.

Some of the competitive research tools out there (the paid ones) really are useful if you are going to scale way up with some of your SEO or PPC plans but many of the paid versions are overkill for a lot of webmasters.

Choosing Your Tools

Most tools come with the promises of “UNCOVERING YOUR COMPETITORS BEST _____".

That blank can be links, keywords, traffic sources, and so on. As we know, most competitive research tools are rough estimates at best and almost useless estimates at worst. Unless you get your hands on your competition’s analytics reports, you are still kind of best-guessing. In this example we are looking for the competitiveness of a core keyword.

Best-guessing really isn’t a bad thing so long as you realize that what you are doing is really triangulating data points and looking for patterns across different tools. Keep in mind many tools use Google’s data so you’ll want to try to reach beyond Google’s data points a bit and hit up places like:

The lure of competitive research is to get it done quickly and accurately. However, gauging the competition of a keyword or market can’t really be done with a push of the button as there are factors that come into play which a push-button tool cannot account for, such as:

  • how hard is the market to link build for?
  • is the vertical dominated by brands and thick EMD’s?
  • what is your available capital?
  • are the ranking sites knowledgeable about SEO or are they mostly ranking on brand authority/domain authority? (how tight is their site structure, how targeted is their content, etc)
  • is Google giving the competing sites a brand boost?
  • is Google integrating products, images, videos, local results, etc?

Other questions might be stuff like "how is Google Instant skewing this keyword marketplace" or "is Google firing a vertical search engine for these results (like local" or "is Google placing 3 AdWords ads at the top of the search results" or "is Google making inroads into the market" like they are with mortgage rates.

People don't search in an abstract mathematical world, but by using their fingers and eyes. Looking at the search results matters. Quite a bit of variables come into play which require some human intuition and common sense. A research tool is only as good as the person using it, you have to know what you are looking at & what to be aware of.

Getting the Job Done

In this example I decided to use the following tools:

Yep, just 2 free tools.... :)

So we are stipulating that you’ve already selected a keyword. In this case I picked a generic keyword for the purposes of going through how to use the tools. Plug your keyword into Google, flip on SEO for Firefox and off you go!

This is actually a good example of where a push button tool might bite the dust. You’ve got Related Search breadcrumbs at the top, Images in the #1 spot, Shopping in the #3 spot, and News (not pictured) in the #5 spot.

So wherever you thought you might rank, just move yourself down a 1-3 spots depending on where you would be in the SERPS. This can have a large effect on potential traffic and revenue so you’ll want to evaluate the SERP prior to jumping in.

You might decide that you need to shoot for 1 or 2 rather than top 3 or top 5 given all the other stuff Google is integrating into this results page. Or you might decide that the top spot is locked up and the #2 position is your only opportunity, making the risk to reward ratio much less appealing.

With SEO for Firefox you can quickly see important metrics like:

  • Yahoo! links to domain/page
  • domain age
  • Open Site Explorer and Majestic SEO link data
  • presence in strong directories
  • potential, estimated traffic value from SEM Rush

Close up of SEO for Firefox data:

Basically by looking at the results page you can see what other pieces of universal search you’ll be competing with, whether the home page or a sub-page is ranking, and whether you are competing with brands and/or strong EMD’s.

With SEO for Firefox you’ll see all of the above plus the domain age, domain links, page links, listings in major directories, position in other search engines, and so on. This will give you a good idea of potential competitiveness of this keyword for free and in about 5 seconds.

It is typically better & easier to measure the few smaller sites that managed to rank rather than measuring the larger authoritative domains. Why? Well...

Checking Links

So now that you know how many links are pointing to that domain/page you’ll want to check how many unique domains are pointing in and what the anchor text looks like, in addition to what the quality of those links might be.

Due to its ease of use (in addition to the data being good) I like to use Open Site Explorer from SeoMoz in these cases of quick research. I will use their free service for this example, which requires no log in, and they are even more generous with data when you register for a free account.

The first thing I do is head over to the anchor text distribution of the site or page to see if the site/page is attracting links specific to the keyword I am researching:

What’s great here is you can see the top 5 instances of anchor text usage, how many total links are using that term, and how many unique domains are supplying those total links.

You can also see data relative to the potential quality of the entire link profile in addition to the ratio of total/unique domains linking in.

You probably won’t want or need to do this for every single keyword you decide to pursue. However, when looking at a new market, a potential core keyword, or if you are considering buying an exact match domain for a specific keyword you can accomplish a really good amount of competitive research on that keyword by using a couple free tools.

Types of Competitive Research

Competitive research is a broad term and can go in a bunch of different directions. As an example, when first entering a market you would likely start with some keyword research and move into analyzing the competition of those keywords before you decide to enter or fully enter the market.

As you move into bigger markets and start to do more enterprise-level competitive research specific to a domain, link profiles, or a broader market you might move into some paid tools.

Analysis paralysis is a major issue in SEO. Many times you might find that those enterprise-level tools really are overkill for what you might be trying to do initially. Gauging the competitiveness of a huge keyword or a lower volume keyword really doesn’t change based on the money you throw at a tool. The data is the data especially when you narrow down the research to a keyword, keywords, or domains.

Get the Data, Make a Decision

So with the tools we used here you are getting many of the key data points you need to decide whether pursuing the keyword or keywords you have chosen is right for you.

Some things the tools cannot tell you are questions we talked about before:

  • how much captial can you allocate to the project?
  • how hard are you willing to work?
  • do you have a network of contacts you can lean on for advice and assistance?
  • do you have enough patience to see the project through, especially if ranking will take a bit..can you wait on the revenue?
  • is creativity lacking in the market and can you fill that void or at least be better than what’s out there?

Only you can answer those questions :)

Pages