3 Reasons Google Won’t Offer Car Insurance Comparisons in the US Anytime Soon

The following is a guest column written by Rory Joyce from CoverHound.

Last week Google Advisor made its long-awaited debut in the car insurance vertical -- in the UK. Given Google’s 2011 acquisition of BeatThatQuote.com, a UK comparison site, for 37.7 million pounds ($61.5 million US), it comes as little surprise that the company chose to enter the UK ahead of other markets. While some might suspect Google’s foray into the UK market is merely a trial balloon, and that an entrance into the US market is inevitable, I certainly wouldn’t hold my breath.

Here are three reasons Google will not be offering an insurance comparison product anytime soon in the US market:

1) High Opportunity Cost

Finance and insurance is the number one revenue - generating advertising vertical for Google, totaling $4 billion in 2011. While some of that $4 billion is made up of products like health insurance, life insurance and credit cards, the largest segment within the vertical is undoubtedly car insurance. The top 3 advertisers in the vertical as a whole are US carriers -- State Farm, Progressive and Geico -- spending a combined sum of $110 million in 2011.

The keyword landscape for the car insurance vertical is relatively dense. A vast majority of searches occur across 10-20 generic terms (ie - “car insurance,” “auto insurance,” “cheap auto insurance,” “auto insurance quotes,” etc). This is an important point because it helps explain the relatively high market CPC of car insurance keywords versus other verticals. All of the major advertisers are in the auction for a large majority of searches, resulting in higher prices. The top spot for head term searches can reach CPCs well over $40. The overall average revenue/click for Google is probably somewhere around $30. Having run run similar experiments with carrier click listing ads using SEM traffic, I can confidently assume that the click velocity (clicks per clicker) is around 1.5. So the average revenue per searcher who clicks is probably somewhere around $45 for Google.

Now, let’s speculate on Google’s potential revenues from advertisers in a comparison environment. Carriers’ marketing allowable is approximately $250 per new policy. When structuring pay-for-performance pricing deep in the funnel (or on a sold-policy basis), carriers are unlikely to stray from those fundamentals. In a fluid marketplace higher in the funnel (i.e.  Adwords PPC), they very often are managing to a marginal cost per policy that far exceeds even $500 (see $40 CPCs). While it may seem like irrational behavior, there are two reasons they are able to get away with this:

a) They are managing to an overall average cost per policy, meaning all direct response marketing channels benefit from “free,” or unattributable sales. With mega-brands like Geico, this can be a huge factor.

b) There are pressures to meet sales goals at all costs. Google presents the highest intent of any marketing channel available to insurance marketers. If marketers need to move the needle in a hurry, this is where they spend.

Regardless of how Google actually structures the pricing, the conversion point will be much more efficient for the consumer since they will be armed with rates and thus there will be less conversion velocity for Google. The net-net here is a much more efficient marketplace, and one where Google can expect average revenue to be about $250 per sold policy.

How does this match up against the $45 unit revenue they would significantly cannibalize? The most optimized and competitive carriers can convert as high as 10% of clicks into sales. Since Google would be presenting multiple policies we can expect that in a fully optimized state, they may see 50% higher conversion and thus 15% of clicks into sales. Here is a summary of the math:

With the Advisor product, in an optimized state, Google will make about $37.50 ($250 x .15) per clicker. Each cannibalized lead will thus cost Google $7.50 of unit revenue ($45 - $37.50). Given the dearth of compelling comparison options in insurance (that can afford AdWords), consumers would definitely be intrigued and so one can assume the penetration/cannibalization would be significant.

Of course there are other impacts to consider: How would this affect competition and average revenue for non-cannibalized clicks? Will responders to Advisor be incremental and therefore have zero opportunity cost?

2) Advisor Has Poor Traction in Other Verticals

Over the past couple of years, Google has rolled out its Advisor product in several verticals including: personal banking, mortgage, and flight search.

We know that at least mortgage didn’t work out very well. Rolled out in early 2011, it was not even a year before Google apparently shut the service down in January of 2012.

I personally don’t have a good grasp on the Mortgage vertical so I had a chat with a high-ranking executive at a leading mortgage site, an active AdWords advertiser. In talking to him it became clear that there were actually quite a bit of similarities between mortgage and insurance as it relates to Google including:

  1. Both industries are highly regulated in the US, at the state level.
  2. Both verticals are competitive and lucrative. CPCs in mortgage can exceed $40.
  3. Like insurance, Google tested Advisor in the UK market first.

Hoping he could serve as my crystal ball for insurance, I asked, “So why did Advisor for Mortgage fail?” His response was, “The chief issue was that the opportunity cost was unsustainably high. Google needed to be as or more efficient than direct marketers who had been doing this for years. They underestimated this learning curve and ultimately couldn’t sustain the lost revenue as a result of click cannibalization.”

Google better be sure it has a good understanding of the US insurance market before entering, or else history will repeat itself, which brings me to my next point...

3) They Don’t Yet Have Expertise

Let’s quickly review some key differences between the UK and US insurance markets:

  1. Approximately 80% of car insurance is purchased through comparison sites in the UK vs under 5% in the US.
  2. There is one very business-friendly pricing regulatory body in the UK versus state-level, sometimes aggressive, regulation in the US.
  3. The UK is an efficient market for consumers, the US is not. This means margins are tighter for UK advertisers, as evidenced by the fact that CPCs in the UK are about a third of what they are in the US.

As you can see, these markets are completely different animals. Despite the seemingly low barriers for entry in the UK, Google still felt compelled to acquire BeatThatQuote to better understand the market. Yet, it still took them a year and a half post acquisition before they launched Advisor.

I spoke with an executive at a top-tier UK insurance comparison site earlier this week about Google’s entry. He mentioned that Google wanted to acquire a UK entity primarily for its general knowledge of the market, technology, and infrastructure (API integrations). He said, “Given [Google’s] objectives, it didn’t make sense for them to acquire a top tier site (ie - gocompare, comparethemarket, moneysupermarket, confused) so they acquired BeatThatQuote, which was unknown to most consumers but had the infrastructure in place for Google to test the market effectively.”

It’s very unlikely BeatThatQuote will be of much use for the US market. Google will need to build its product from the ground up. Beyond accruing the knowledge of a very complex, and nuanced market, they will need to acquire or build out the infrastructure. In the US there are no public rate APIs for insurance carriers; very few insurance comparison sites actually publish instant, accurate, real-time rates. Google will need to understand and navigate its way to the rates (though it’s not impossible). It will take some time to get carriers comfortable and then of course build out the technology. Insurance carriers, like most financial service companies, can be painfully slow.

Conclusion

I do believe Google will do something with insurance at some point in the US. Of the various challenges the company currently faces, I believe the high opportunity cost is the toughest to overcome. However, the market will shift. As true insurance comparison options continue to mature, consumers will be searching exclusively for comparison sites (see travel), and carriers will no longer be able to effectively compete at the scale they are now -- driving down the market for CPCs and thus lowering the opportunity cost.

This opportunity cost is much lower however for other search engines where average car insurance CPC’s are lower. If I am Microsoft or Yahoo, I am seriously considering using my valuable real estate to promote something worthwhile in insurance. There is currently a big void for consumers as it relates to shopping for insurance. A rival search engine can instantly differentiate themselves from Google overnight in one of the biggest verticals. This may be one of their best opportunities to regain some market share.

Comparing Backlink Data Providers

Since Ayima launched in 2007, we've been crawling the web and building our own independent backlink data. Starting off with just a few servers running in our Directory of Technology's bedroom cupboard, we now have over 130 high-spec servers hosted across 2 in-house server rooms and 1 datacenter, using a similar storage platform as Yahoo's former index.

Crawling the entire web still isn't easy (or cheap) though, which is why very few data providers exist even today. Each provider makes compromises (even Google does in some ways), in order to keep their data as accurate and useful as possible for their users. The compromises differ between providers though, some go for sheer index size whilst others aim for freshness and accuracy. Which is best for you?

This article explores the differences between SEOMoz's Mozscape, MajesticSEO's Fresh Index, Ahref's link data and our own humble index. This analysis has been attempted before at Stone Temple and SEOGadget, but our Tech Team has used Ayima's crawling technology to validate the data even further.

We need a website to analyze first of all, something that we can't accidentally "out". Search Engine Land is the first that came to mind, very unlikely to have many spam links or paid link activity.

So let's start off with the easy bit - who has the biggest result set for SEL?

The chart above shows MajesticSEO as the clear winner, followed by a very respectable result for Ahrefs. Does size matter though? Certainly not at this stage, as we only really care about links which actually exist. The SEOGadget post tried to clean the results using a basic desktop crawler, to see which results returned a "200" (OK) HTTP Status Code. Here's what we get back after checking for live linking pages:

Ouch! So MajesticSEO's "Fresh" index has the distinct smell of decay, whilst Mozscape and Ayima V2 show the freshest data (by percentage). Ahrefs has a sizeable decay like MajesticSEO, but still shows the most links overall in terms of live linking pages. Now the problem with stopping at this level, is that it's much more likely that a link disappears from a page, than the page itself disappearing. Think about short-term event sponsors, 404 pages that return a 200, blog posts falling off the homepage, spam comments being moderated etc. So our "Tenacious Tim" got his crawler out, to check which links actually exist on the live pages:

Less decay this time, but at least we're now dealing with accurate data. We can also see that Ayima V2 has a live link accuracy of 82.37%, Mozscape comes in at 79.61%, Ahrefs at 72.88% and MajesticSEO is just 53.73% accurate. From Ayima's post-crawl analysis, our techies concluded that MajesticSEO's crawler was counting URLs (references) and not actual HTML links in a page. So simply mentioning http://www.example.com/ somewhere on a web page, was counting as an actual link. Their results also included URL references in JavaScript files, which won't offer any SEO value. That doesn't mean that MajesticSEO is completely useless though, I'd personally use it more for "mention" detection outside of the social sphere. You can then find potential link targets who mention you somewhere, but do not properly link to your site.

Ahrefs wins the live links contest, finding 84,496 more live links than MajesticSEO and 513,733 more live links than SEOmoz's Mozscape! I still wouldn't use Ahrefs for comparing competitors or estimating the link authority needed to compete in a sector though. Not all links are created equal, with Ahrefs showing both the rank-improving links and the crappy spam. I would definitely use Ahrefs as my main data source for "Link Cleanup" tasks, giving me a good balance of accuracy and crawl depth. Mozscape and Ayima V2 filter out the bad pages and unnecessarily deep sites by design, in order to improve their data accuracy and showing the links that count. But when you need to know where the bad PageRank zero/null links are, Ahrefs wins the game.

So we've covered the best data for "mentions", the best data for "link cleanup", now how about the best for competitor comparison and market analysis? The chart below shows an even more granular filter, removing dead links, filtering by unique Class C IP blocks and removing anything below a PageRank 1. By using Google's PageRank data, we can filter the links from pages that hold no value or that have been penalized in the past. Whilst some link data providers do offer their own alternative to PageRank scores (most likely based on the original Google patent), these cannot tell whether Google has hit a site for selling links or for other naughty tactics.

Whilst Ahrefs and MajesticSEO hit the top spots, the amount of processing power needed to clean their data to the point of being useful, makes them untenable for most people. I would therefore personally only use Ayima V2 or Mozscape for comparing websites and analyzing market potential. Ayima V2 isn't available to the public quite yet, so let's give this win to Mozscape.

So in summary

  • Ahrefs - Use for link cleanup
  • MajesticSEO - Use for mentions monitoring
  • Mozscape - Use for accurate competitor/market analysis

Juicy Data Giveaway

One of the best parts of having your own index, is being able to create cool custom reports. For example, here's how the big SEO websites compare against each other:

"Index Rank" is a ranking based on who has the most value-passing Unique Class C IP links across our entire index. The league table is quite similar to HitWise's list of the top traffic websites, but we're looking at the top link authorities.

Want to do something cool with the data? Here's an Excel spreadsheet with the Top 10,000 websites in our index, sorted by authority: Top 10,000 Authority Websites.


Rob Kerry is the co-founder of Ayima, a global SEO Consultancy started in 2007 by the former in-house team of an online gaming company. Ayima now employs over 100 people on 3 continents and Rob has recently founded the new Ayima Labs division as Director of R&D.

Consultant to Agency - What I Learned From the Jump

I've been in the online marketing space since 1998. Somewhere around the year 2000, I stumbled into affiliate marketing. I played in very competitive spaces via SEO from the get go - and ranked. In 2007, in order to scale my affiliate marketing efforts, I co-founded MFE Interactive, a website publishing company, and built out several affiliate brands.

I'd always done consulting here and there throughout the years, but never on a regular basis. To be honest, I liked (and still do like) the affiliate (on your own schedule and no one to answer to but your bank account) lifestyle.

In 2009 I made my first foray into running a consulting company. I quickly found out that there was a lot to making the jump from consultant to agency - a lot of which I hadn't thought about, hadn't properly positioned myself for and I decided to sell my shares less than two years after venturing into that realm.

After 18 months of what my friends like to call "semi-retirement" and living very comfortably off the passive income I'd spent nearly a decade developing, I decided once again to start an agency and officially launched PushFire in May of 2012 and we're already a team of 13 and growing.

But this time I knew a bit more about what I was getting into and as a result, had positioned myself better for the task. I figured I'd share with you what I've learned about making the jump from occasional consultant to agency over the last three years in hopes that maybe someone else can be better prepared for "the jump" if and when they decide to take it.

Deciding Whether to Go Solo or with a Partner

I personally know what I'm good at and what I'm not. I couldn't see launching an agency - at least one you want to experience quick growth - without having a partner (unless you want to invest the salary to have someone handle a "partner" position as a paid employee). There is simply too much for one person to do for them to do it all alone - and fast.

My personal weakness lies in operations. I don't like being chained to the office every day and travel too much promoting the agency to be the person managing operations. My personal strength lies in business development, growth and strategy. My weaknesses make me a horrible COO. My strengths make me a good CEO. I've found that the absolute key to creating a successful partnership lies in making sure that your partner has strengths where you DON'T. In PushFire, my partner Sean and I compliment each other very well. I'm a veteran with SEO and link building. He's great with PPC management (something completely foreign to me). I'm good at business development and client strategy. He actually enjoys (and is good at) managing the staff and clients. That makes him a fantastic COO.

Before you rush to launch an agency solo, ask yourself if you can really handle every aspect of running said agency (or are willing to hire to fill the gaps). If not, ask yourself who you know that would be a great COMPLIMENT to your skill set. And then make sure you vet that they actually have the skills you think they do and that you can work as a team without wanting to kill each other and being "locked" into a company from a public perspective. Work quietly together for a few months and see how it goes (that is what Sean and I did for about 3 months). And if all goes well, make it official.

Business Formation and Operating Agreement

Once you decided to make it official you need to form your business. I actually own part of an incorporation service (an accounting firm owns the other half) so I got my advice on what KIND of company to form from my partners in that site since I didn't know all the intricacies of owning a business in Texas (where I'd recently moved). If you're not sure of what kind of company will work best for you (Incorporation, Limited Liability Company, S Corporation, etc) be sure to consult with an accountant or attorney to figure it out. It's a pain to change after the fact.

If you are forming your business with a partner, it is absolutely imperative that you have an Operating Agreement from day one. IMPERATIVE. The Operating Agreement defines your ownership (if it's not a corporation which issues shares), your roles and your responsibilities. Be sure to include what happens should a partner want to leave, should you want a partner to leave, should a partner die, should a partner get divorced - EVERY POSSIBLE THING THAT COULD GO WRONG SHOULD HAVE AN AGREED UPON SOLUTION IN THE OPERATING AGREEMENT AS SOON AS YOU BECOME AN OFFICIAL COMPANY.

I don't care if your partner is your parent, sibling, friend - you need an Operating Agreement and you need one from day one. Sean and I are married and we STILL have an Operating Agreement that details out every possible scenario and what happens in the event of it. And if there is one area where you stretch the budget and pay a lawyer (and NOT use some free template online) it is for the Operating Agreement if you enter into a partnership.

The Business Paperwork

Next up you'll need to file all that awesome paperwork with the IRS, state and in some cases even your county. Getting an EIN, getting a sales tax number, and getting local operating licenses (or even finding out if they're required). And if you're hiring employees, then you'll need to file paperwork to pay unemployment taxes, etc. I personally hired a local accountant to ensure we didn't miss anything in regards to these. I'd rather pay a modest hourly fee now than much more expensive government penalties later.

Business Insurance

If you plan to have an office and employees (which is likely because you decided to no longer be a sole consultant), then you're going to want to get insurance. The basics would be General Liability and Property Insurance and Workers' Compensation Insurance.

Additionally, because what we do for a living as online marketers is not an exact science, you'll likely want to look into getting Errors and Omissions (E&O) insurance too.

The GLP and Workers' Comp insurance was fairly easy to find and get setup. E&O was another story. Most insurance agencies I spoke with didn't handle "digital marketing firms" and it took me a long time to find a recommendation to a company that not only provided E&O for people who do what we do, but also was willing to include copyright infringement into the policy (say for an employee using a picture or content they don't have permission to use, unbeknown to you). I finally was referred to TechInsurance and was able to get all three insurance policies via them.

For the record, I was not compensated in any way for mentioning them - I just had a REALLY hard time finding an E&O provider and they had all the coverage I needed and at what I thought was a fair price. Cost for the policies will vary on a multitude of factors, including your personal experience at what we do, if you've ever been sued, etc.

Also know that if you plan to take on Fortune companies as clients, this insurance - and proof of having it - will be a standard requirement and they usually request that your GLP and E&O insurance covers you in the 1-2 million dollar range.

The Legalities

As an agency, you're going to need contracts if you weren't using them as a consultant. And you're going to want them to be drawn up by (or at least overlooked and approved by) an ACTUAL LAWYER.

We had a Master Services Agreement (MSA) drawn up as well as a Statement of Work (SOW) for each service type we provide (which at the moment is SEO, Link Building and Promotion and PPC).

We also had a Mutual Non-Disclosure Agreement (NDA) created. Additionally, if you plan to use contractors or employees, you'll need contracts drawn up for each (one for employees and one for contractors). While some clients require you to use THEIR contracts (they like to keep any legal disputes in their home territory) many clients will not have these types of contracts and you will need to provide them.

For the record, I don't "hold" clients into contracts. If a client wants to stop using our services they can do so at any time. We have a 30 day notice "out" clause (for either side) in our standard MSA. But we still have contracts that clearly state what we've been hired to do and what our (and the client's) responsibilities are. Even if you don't have clients signing "one year deals" etc, you still should have contracts. Cover Your Ass - it's a statement to live by as a business owner.

Finding Office Space

Since you're opening an agency, that means you plan to have employees - otherwise you'd remain a consultant. Office space is a tricky issue for a brand new company. You often don't need a lot of space in the beginning, but if your company does well and finds itself quickly expanding, you could find yourself outgrowing your initial space soon.

I'd recommend you'd do your best to find office space (at least initially) with a short term lease (which for office space is usually 1-2 years). Also, since most of your business - at least in the beginning - will be over the Internet, you shouldn't kill your budget trying to rent a Madison Avenue worthy space in the beginning (whether you should do it at ANY time is up to you).

We took a 1 year lease in an industrial building with a killer Chicago loft like interior and a great kitchen. From the outside, it looks like a trucking company (because we're next to one). But it's got a great look and feel on the inside and 90% of our clients will never come to our office anyway. The one year lease was key because we were way too small for the space when we took it and will be way to big for the space when our 1 year lease is up.

Additionally, don't stress too much over location. I talk with a lot of folks that ask us when we'll be moving from the small town we're in (Katy, TX) to the "big city" ten minutes away (which is Houston, TX). Sean and I just discussed this the other day and I don't know that we'll ever make that "move" so to speak. It is much easier to get local press coverage and be a "top" employer in a smaller town. And again, most of our clients will never come to our office anyway. I take my cue from Marty Weintraub, who, rather than ditch Minnesota for the more "tech" scene states as a newly minted Inc 500 company, instead chose to become a pillar business there.

Contractors Vs. Employees

I was very adamant from the day we launched that we were going the in-house, local employee route. It is tempting to work with long distance contractors - especially when you know they're talented but would never move. As a consultant, I utilized long distance contractors for years (and all of our long term contractors are "grandfathered in" to this new decision).

But if you plan to grow an agency, it's my opinion that you need people in-house to effectively do it. Especially when it comes to management positions. It's simply much easier to call a company meeting with in-house staff then to arrange a Skype call between 13 people. It's much easier to develop positive relationships and company camaraderie as well.

What to Know about Hiring and Having Employees

Hiring is a task you pretty much only learn via experience. You have to make sure you find people who will fit in with the company culture you want to build - so you'll need to put some thought into what that is before you start posting "help wanted" ads.

To attract great employees we've learned two things. The first is not to skimp on paying for a job posting, especially if you live in a smaller town. We post our ads on Monster.com and haven't been disappointed in the quality of applicants we've received by doing so. Prior attempts using more local services were a waste of time, especially when looking for people with online marketing and/or technical skills - they're all looking online.

Secondly, you need to offer benefits if you want to be competitive with the other companies around you. A great company culture and an exciting position usually don't make up for a lack of health benefits in the United States. We looked to our banking service to get us recommendations for small business health insurance.

They introduced us to Digital Insurance who got us a great quote for health insurance for our growing team (again, I'm only mentioning them because we found them to be awesome and extremely helpful). When looking at health insurance keep in mind that - at least here in Texas - you need 75% participation in your plan and need to pay a minimum of 50% towards the health insurance premiums of all your covered employees.

To give us an edge over competing employers, we decided to get a higher quality plan with a low co-pay and lower deductible and contribute more than the required 50%. Make sure that you consider your health insurance costs for your employees when deciding on salaries. Even if you don't have health insurance for the first few hires, when you DO implement, you'll have to contribute for everyone, regardless of if their salary took it into account.

Additionally, once you're past having one or two employees, you're likely going to need an HR manual. Our accountant was able to get us a standard HR Manual we were able to edit to fit our specific needs - and once again, have a lawyer look over the final product.

We also work hard to keep the team motivated. From team building events with prizes (our latest was laser tag, our next outing is bowling) to performance incentives (this month, we're giving away the New iPad as a performance bonus), you'll need to ensure your team is emotionally satisfied in addition to being financially satisfied to keep retention high. We appreciate our team and their dedication to the company and do our best to show them that.

Creating Internal Processes and Tools

Hiring employees means you're going to need to train them. In the beginning, you'll likely do this by doing it verbally, but when you get to the point that you're hiring frequently, you'll want internal training documents for your new team members to read first and for you to answer questions about later. And different jobs will likely require different processes and training documentation. We've been creating this as we go. But we've found that a lack of written documentation can cause confusion and frustration. So the sooner you can get everything on pen and paper, the better.

Additionally, at some point you're going to find yourself doing a lot of repeated basic processes that could be better handled by legitimate automation. We just hired our first developer for PushFire to begin building internal tools to not only make our team's job easier, but to make it less mundane as well. Be sure to keep an eye when hiring on if you're hiring because of a genuine need or because your current team is wasting time doing things they don't need to do. When the latter occurs, I'd look into hiring a developer to fill those productivity gaps with automation. We're already seeing the benefits of making our team's life easier.

In the meantime - don't try and reinvent the wheel. There are tons of great tools out there that can make your team more productive. From Raven Tools to Ontolo to HighRise to tons of other services - there is likely someone, somewhere with a tool to make your specific team's job easier. Seek them out. Then hire someone to build what ISN'T available as you grow.

The Books

My opinion? Never do the books yourself. EVER. Because saving yourself a few hundred to a few thousand in accounting fees could cost you BIG BUCKS down the road. We use FreshBooks for our invoicing and have an accountant who then downloads the FreshBooks data into Quickbooks.

I find FreshBooks easier (though I used Quickbooks until recently) and she prefers Quickbooks. Our accountant provides us with a Profit and Loss (P&L) statement every month and keeps track of our invoicing and cash flow. This allows us to ask her any information we need to know financially while keeping our eyes focused on the business growth and day to day operations. For now, we outsource accounting, but we know that at some point we will need to take it in house as we grow.

We also utilize the payroll services at our bank (Wells Fargo) because it's easy and they pay all the required taxes for us. Our accountant still runs our payroll, but through their service. Additionally, most payroll companies offer you a guarantee that if you're ever hit for them improperly accounting for taxes, that's on them and not you. To me, it's worth the (what I consider) small fee to utilize the payroll services.

I'm Still Learning

I'm by no means the definitive source on making the move from an individual consultant to an agency. I can't offer advice on financing or funding because we've bootstrapped ourselves the whole way. But I hope the above let's you know some of what to prepare for and what you'll need, at the very minimum, to launch a successful consulting agency.

Lastly, DREAM BIG. DO GOOD WORK. BE A GOOD PERSON, PARTNER, BOSS, CLIENT AND SERVICE PROVIDER.

P.S. If you live in, near or are willing to relocate to Houston? We're hiring. ;-)

The Social Media Ponzi Bubble Implodes

The Next Google?

Facebook had their first tranche of insider lock ups expire yesterday & the stock ended off over 5%. Anyone who has ever invested for a significant period of time knows what the following graphic looks like: the collapse of a bubble.

What has caused such a poor performance for Facebook?

For starters, this couldn't have helped:

If they committed to spending big bucks with Facebook, how could they be assured a return on their investment?

Mr. Zuckerberg's response, according to one of the attendees: "That's a great question and we should probably have an answer to that, shouldn't we?"

Also harming Facebook...

The Real Next Google

Users do not want social in search, but even if they did Google can turn it on with a flick of a switch.

If you want to invest in "the next Google" at a valuation above $100 billion then the best way to do so is to buy Google.

I won't claim that Google's growth there has also passed through to online publishers. It many cases it has not, as Google has begun dominating their own results & pushing competitors below the fold.

SEO is Harder than Ever

Breaking into search with a new site is harder than ever. That is reflected in the static nature of the ecommerce market and just how many ill informed opinions there are about Google's various updates.

Unless you are already well trusted or are willing to hack websites, brute force SEO is getting much harder. Even getting a boatload of exposure like the following graph shows may have zero impact on Google rankings.

Other important trends are:

This does not mean that the opportunity of SEO has disappeared, rather that strategy becomes far more important as the market grows more challenging.

Public Relations

Social media is sold as being revolutionary, but its impact is generally more marginal. What matters is funding the baseline message that then gets syndicated across networks.

Due to the Filter Bubble (& format concision) most people won't question the depths of where they are wrong or dig deep into the background of a story, but rather syndicate the payola headline & biased research that PR professionals wanted them to see.

Out-of-context facts only need to sound good in 140 characters.

Reputation Management

Occasionally a company can be so idiotic that their Progressive(ly) incompetent behavior creates a categorical example of failing their customers. But that sort of failure only matters if it gets shared frequently on blogs & media sites off the social media platforms.

I haven't heard of anyone spending big money to try to have a Tweet rank lower, but people spend significantly trying to drive down bad search results.

Most Tweets are largely forgotten after a few days. A bad search result can create a progressive self-reinforcing problem that lives on as long as a brand does.

Social Media Platforms Begin Lockdown

It isn't just Facebook that has had problems. A number of the other social stocks have tanked.

The problem with social media is that it's performance hasn't been particularly stellar thusfar & they have only just begun to start screwing over people playing on their platforms. A big part of what caused Zynga to miss so badly on their last quarterly result was:

"Facebook made changes to their platform that favored new game discovery," he said. As a result, Zynga users "did not remain engaged and did not come back as often."

That change is in addition to gutting companies that specialized in optimizing Facebook pages & other companies which worked closely with Facebook. Further, Facebook's edgerank limits how many of your subscribers see your own message. They want you to pay once to build a following & then pay again to access the audience of followers you already built.

It is not just Facebook that is locking down their ecosystem. Twitter is headed down the same path: "I sure as hell wouldn’t build a business on Twitter, and I don’t think I’ll even build any nontrivial features on it anymore."

Many mobile start ups are also suffering from the same "saturated ecosystem" problem.

More Social Media Sites Launch

The economic recovery has been uneven & while the above platforms are imploding it hasn't stopped some of the founders from creating more platforms that will also compete for attention.

Why Social Media Isn't as Exciting As Claimed

All Users Are Not Created Equal

There is a difference between targeted search traffic & the stuff that people sell as "unlimited traffic for $6."

Social media can drive some conversions with coupons, but it can also make people (who would have converted anyway) expect coupons and discounts to purchase. Part of the problem with attributing anything to social media is so much of it can be attributed to activity bias. Anyone who follows you & similar business & so on is going to be more likely to convert in those areas. That they at some point in time were on a large social network doesn't mean that the social network added any value to the sequence or caused a conversion.

Even if you know exactly how influential people are it still wouldn't mean that you would be able to influence them (generally the more popular someone is the less receptive they are to pitches). And generally speaking traffic on your site is worth more than traffic from social media sites, as it is already more targeted. This is why traffic exchange systems suck...those atop the pyramid suck most the real value out of it while those lower in the system give away their visitors for scraps.

The #1 rule of online traffic is that relevancy is more important than volume.

False Sense of Closeness & Empathy (Cuts Both Ways)

Online petitions have a low cost (go nowhere & click a mouse), so even in large numbers they usually don't mean much. Whereas people who go through barriers to entries & jump over hurdles are far more committed to a goal.

With sites like Twitter there can be a wow factor in that there is a false sense of closeness, but in reality many celebrities pay others to tweet for them and sell tweets.

And every bit as fake as the "celebrity who really cares about you" there are also the enraged non-customers who try to leverage social media to level the playing field. But in most cases those were never going to be good relationships anyhow. For most people the best solution is to ignore them.

Hits Can Be Somewhat Unpredictable

In addition to the fickle here today, gone tomorrow nature of social media, the results are typically quite unpredictable. What is even more challenging is that you can optimize for relevancy or virality, but to try to guarantee one you usually have to sacrifice signifcantly on the other. That means that either you can get links & audience, or you can create some conversions, but it is quite hard to do both.

Further, popularity on such networks tends to fade quickly (unless you keep going back to the well). But at any point in time even newer networks can decide to change how they feature you & cut out whoever they want to, and the more often you keep going back to the same network the more beholden you become to it. Invariably all these social networks that start off as being somewhat open close down & control the ecosystem to boost monetization as growth slows.

Signal Creation vs Amplification

It is easy to point to success like Double Fine & Ouya as proof of the power of some of these networks, but some of that success is due to past success. Anyone who loved playing Psychonauts would love to invest in helping to create another release.

P&G can lay off some of their marketing department because their brands already have such a strong share of voice across all mediums.

And Louis CK can sell a million Dollars worth of his own downloads and a hundred thousand tickets fast because he is already well liked.

Mainstream media writers can offer tips on how to have a dead cat bounce on Twitter. That isn't so hard for the mainstream media to do given how much they dominate Twitter trends & the top shared stories on Facebook. However if you don't have an organic audience channel & a built in cumulative advantage then likely either your story will go nowhere, or even if you share something great what will end up happening is someone else with more distribution will rewrite your story and displace you as the lead source.

Social media can have value as a signal amplification tool, but if you do not already have a separate audience base (via email, RSS, or some other similar channels) then time spent on social would likely be better spent building up some of those other channels first. If you are not building off an organic audience channel then social media promotions will typically fall flat.

Dominate a Small Pond

I don't think I would have done well with SEO if I spent most of my time on the largest sites when I was new to the industry. What helped me along was joining the great crew on SearchGuild who taught me a lot in a short period of time. On smaller sites we can become a bigger fish in a small pond.

The fatal attraction with large sites is that the audience is large, but it is largely inaccessible. The largest sites are the most appealing to the least interesting people. Or, put another way, we are most alike where we are the most vulgar & the most unique where we are the most refined. This is why even when we are on the large sites we typically pay far more attention to what our friends say or do than the ads on those platforms that take thousands of impressions to generate a single click.

There is nothing wrong with spending some time on social sites for fun, but if it becomes the bulk of your publishing time & effort you are probably contributing far more than you get back. Especially when you consider that a lot of the deep insights & continuations of stories that once happened on blogs has fell by the wayside for quick temporary Tweets that disappear into nothingness. Many companies have mistakenly abandoned blogging & will have to experience the pain of starting over when some of these networks go away to appreciate the depth of the error.

Why Marketers Promote Social Media

Addiction to "the New"

If you promote things that are new that buys further coverage because you are seen as being innovative.

Twitter allowed spam & had few people employed fight it. Why? More "users" equates to a higher growth rate, which equates to a higher market valuation on subsiquent investment rounds. Twitter stated that in 2009, 11% of their tweets were spam.

During a social media ponzi bubble a whitepaper about Twitter of Facebook has sizzle because it allows you to leach off the story of that broader platform. And so long as those companies are raising money or trying to go public they want to show the maximum growth possible, so they are unlikely to crack down on forms of marketing manipulation that help growth their platform size and valuation. After they are public though & growth has slowed their approach toward controlling their platform will become much more adversarial.

Google has been public for nearly a decade now & if you speak in the language of SEO that is a term that has already been well defined through the dominant market player.

A Desire to be Seen as a Broader Service

If you are only seen as being about "SEO" then anytime Google forces drastic changes onto the market you are seen as being of limited value & thus at great risk of being washed away. This is even more risky if you are leveraging up and trying to raise funding. But if you claim to be more generalist it allows the frog to turn into a prince, as you have more "growth" opportunities in the near future.

Give it a Different Name

A lot of people try to slag off SEO for self-promotion & then say "don't do spam like the SEOs, instead do x."

And if you read off the list of items that are represented in the "x" invariably it reads like an SEO checklist.

So why do people try to redefine SEO? A number of reasons:

  • if they can create a new term that they "own" then anyone who shares it is building the value of their company
  • they can use polarizing marketing to capture attention & then differentiate themselves from what they actually do by claiming to be doing something else
  • some of the most egregious SEO spammers (eg: Jason Calacanis) never could have got away with running their projects as they were without first distancing themselves from the SEO market

The MLM Factor

In most MLM schemes step 1 is often "follow us" with step 2 being "spread our message" (or, feed us your young, get your friends to hate you, sell your soul, etc.)

This same factor is baked into social media services. Rather than going directly to money though it uses attention as an intermediary.

I am not saying that asking people to follow you is necessarily bad, but if you tell people that social media will change the world and that they should follow you for tips then of course that is a great way to get a bunch of desperate, ignorant & shameless newbs to syndicate your spin. If those people are re-defining old school SEO techniques using a new vernacular they are both the customer (buying into the re-marketing of old concepts) and the product (evangelist spreading false gospel & generating social proof of value).

The above message is never stated in the various "correlation analysis" charts that aim to prove the value of social media to SEO.

Given how easy it is to manipulate social media, even if they are not doing well it is easy for someone like Ellory Bennette to sell the image of success.

Noise vs Signal

There are loads of ways to create a core baseline social "signal" on the cheap. Newt Gingrich was called out for having some fake Twitter followers. There are boatloads of services & tools out there targeting all the social networks & free hosts: Facebook, Twitter, MySpace, YouTube, Blogspot, Wordpress, Tumblr, StumbleUpon, Reddit, Digg, Pligg, and even Pinterest.

Given how Newt got "called out" for having fake followers, I wouldn't be surprised to see some marketers buying fake followers for other convenient targets to create a story to sell.

Selling a Bag of Smoke

While composing this, a spam email hit my inbox stating the following:

It's a fact: more people find out about your business on Facebook or Twitter than on search engines. Making these sites work maybe tricky for you, but it s business as usual for us. Let us improve your visibility and enhance your image. It s part of our complete Internet Marketing package. We ll be more than your friends --- we ll be your partners."

Social metrics are easily gamed. If you just want numbers not only are they sold by the social networks as ad units, but they can be had in bulk on sites like Fiverr.

Probably the best comment I have ever read about the "bag of smoke" concept was from Will Spencer:

SEO's like to sell social signals as ranking factors because social media marketing is an easy product to deliver while collecting good profit margins.

The fact that it doesn't work... doesn't seem to bother those people.

The "good guys" in the SEO business aren't the people who parrot Google's lies to a wider audience; the "good guys" in the SEO business are the guys who make their clients money.

Ignorance of Relevancy

Search engines may put out research about social networks like Twitter, but would Google count Twitter as a primary relevancy signal without owning Twitter? Color me skeptical.

Even more laughable than SEOs selling social media as the key to SEO is their open ignorance of the political nature of various relevancy signals.

  • Does Facebook sell likes? Yes. Why would Google want to subsidize a competing ad network? It isn't hard to notice Google's dislike for Facebook through their very public black PR campaigns.
  • The same sort of "why would I subsidize a competitor" issue is also in place with Twitter. They sell retweets & follows, so why would Google want to subsidize that?
  • Google counts YouTube ad views as organic views, but they own it & they only rolled out universal search *after* they acquired YouTube.

In summary...

Google Copyright Transparency Report

Google timed a nice Friday evening release to update of their policy toward copyright infringement.

Starting next week, we will begin taking into account a new signal in our rankings: the number of valid copyright removal notices we receive for any given site. Sites with high numbers of removal notices may appear lower in our results.

Wow. Sounds like trouble. Surely that means that YouTube's rankings are about to get torched.

Oh, nope. One quick exemption for the video king:

This data presents information specified in requests we received from copyright owners through our web form to remove search results that link to allegedly infringing content. It is a partial historical record that includes more than 95% of the volume of copyright removal requests that we have received for Search since July 2011. It does not include:

  • requests submitted by means other than our web form, such as fax or written letter
  • requests for products other than Google Search (e.g, requests directed at YouTube or Blogger)
  • requests sent to Google Search for content appearing in other Google products (e.g., requests for Search, but specifying YouTube or Blogger URLs).

Google does not state where the thresholds will be set & grants blanket immunity for themselves, yet they (illegitimately) emphasize that they are being transparent.

Only copyright holders know if something is authorized, and only courts can decide if a copyright has been infringed; Google cannot determine whether a particular webpage does or does not violate copyright law. So while this new signal will influence the ranking of some search results, we won’t be removing any pages from search results unless we receive a valid copyright removal notice from the rights owner. And we’ll continue to provide "counter-notice" tools so that those who believe their content has been wrongly removed can get it reinstated. We’ll also continue to be transparent about copyright removals.

YouTube vs Sites Cleaner Than YouTube

Courts have ruled that embedding a YouTube video is not copyright infringement. The EFF has mentioned that embedding a video is simply a link.

And yet, a UK student faces up to 10 years in jail in the US for founding a crowdsourced site which links to sites that allow you to watch TV online.

Kim DotCom suffered a militant raid on his house & had his assets frozen for running MegaUpload, which was a tiny spec of dirt compared to the size of YouTube.

On the copyright front YouTube was rotten from the start:

  • "In a July 19, 2005 e-mail to YouTube co-founders Chad Hurley and Jawed Karim, YouTube co-founder Steve Chen wrote: 'jawed, please stop putting stolen videos on the site. We’re going to have a tough time defending the fact that we’re not liable for the copyrighted material on the site because we didn’t put it up when one of the co-founders is blatantly stealing content from other sites and trying to get everyone to see it.'"
  • "Chen twice wrote that 80 percent of user traffic depended on pirated videos. He opposed removing infringing videos on the ground that 'if you remove the potential copyright infringements... site traffic and virality will drop to maybe 20 percent of what it is.' Karim proposed they 'just remove the obviously copyright infringing stuff.' But Chen again insisted that even if they removed only such obviously infringing clips, site traffic would drop at least 80 percent. ('if [we] remove all that content[,] we go from 100,000 views a day down to about 20,000 views or maybe even lower')."
  • "In response to YouTube co-founder Chad Hurley’s August 9, 2005 e-mail, YouTube co-founder Steve Chen stated: 'but we should just keep that stuff on the site. I really don’t see what will happen. what? someone from cnn sees it? he happens to be someone with power? he happens to want to take it down right away. he get in touch with cnn legal. 2 weeks later, we get a cease & desist letter. we take the video down.'"
  • "A true smoking gun is a memorandum personally distributed by founder Karim to YouTube’s entire board of directors at a March 22, 2006 board meeting. Its words are pointed, powerful, and unambiguous. Karim told the YouTube board point-blank:
    'As of today episodes and clips of the following well-known shows can still be found: Family Guy, South Park, MTV Cribs, Daily Show, Reno 911, Dave Chapelle. This content is an easy target for critics who claim that copyrighted content is entirely responsible for YouTube’s popularity. Although YouTube is not legally required to monitor content (as we have explained in the press) and complies with DMCA takedown requests, we would benefit from preemptively removing content that is blatantly illegal and likely to attract criticism.'"
  • "A month later, [YouTube manager Maryrose] Dunton told another senior YouTube employee in an instant message that 'the truth of the matter is probably 75-80 percent of our views come from copyrighted material.' She agreed with the other employee that YouTube has some 'good original content' but 'it’s just such a small percentage.'"
  • "In a September 1, 2005 email to YouTube co-founder Steve Chen and all YouTube employees, YouTube co-founder Jawed Karim stated, 'well, we SHOULD take down any: 1) movies 2) TV shows. we should KEEP: 1) news clips 2) comedy clips (Conan, Leno, etc) 3) music videos. In the future, I’d also reject these last three but not yet.'"

Broader Copyright Questions

There still are a lot of murky questions in Google's "transparency."

  • If a person embeds an image from Imgur, ImageShack, TinyPic, PhotoBucket or elsewhere & the page that has a hotlink gets a DMCA how does that count?
  • If a brand is large enough does it take many DMCAs to get hit?
  • Is there any analysis of the underlying business model of the site? What happens to document storage sites like DocStoc & Scribd, or even image sites like Pinterest?
  • What happens to sites that link at penalized sites too frequently?
  • What happens to ad networks that frequently fund such copyright violations?

HUGE Impact on the Web

Has anyone registered DMCASEO.com & DMCA-SEO.com yet? ;)

In terms of impact on the web for publishers, this change is every bit as big as Florida, Panda & Penguin. It may not seem so at first (as it will take time for market participants to consider the uses) but this is a huge deal. Consider some of the following scenarios...

  • You try to create something like YouTube for another form of content (Pinterest?) and it gets hit as spam for following Google's lead.
  • You offer a free blogging platform that competes with Blogspot, but it gets hit as spam for following Google's lead.
  • You decide to create a project like Google's book scanning project & you get hit as spam for following Google's lead.
  • You run an ad network & start growing quickly. As you grow some sketchier publishers enter your ad network. Like Google AdSense, a large portion of your ad network is filled with sites that have copyright violations on them. Suddenly working with your ad network gets people hit as spam because your business model is too similar to Google's.
  • You create a new social network & are struggling to compete with Google's preferential ranking & hard coded placements of their own network. You make your network more open to encourage growth & you get hit as spam.
  • If You are Amazon or eBay you can afford premium featured content to pull up your other listings. But if you can't afford their cost structure & hire freelance writers or work with outsourced workers to create some of your content & they use some copyright work without you knowing. But does Amazon now have to vigilantly review their reviews for plagiarism?
  • A competitor licenses some of their content as Creative Commons for years & doesn't mind wide use of it. Then you use it & one day they see you as a competitive threat and remove their Creative Commons license & bulk DMCA you. Or you have a lifetime syndication deal with a company, they later change the policy & claim that your documents are forged.
  • Getty images presumes you didn't license an image that you did & files a DMCA. At some point there is no purpose in targeting the webmaster or host...just go direct to Google knowing that you can create the equivalent of a "patent trolling" styled business model where you create a business model where it is cheaper for people to pay to have the issue resolved the quick way before they lodge a formal complaint. Some organizations might even have a subscription service set up where you pre-pay for immunity.
  • A former employee who wrote content for you claims you used it without permission. Or that same former employee used pirated images & longish quotes from other sources that they didn't disclose to you that they now highlight via DMCA.
  • You license data from a source & they do a mid-contract change leveraging the small print & have a bot lined up to send 40,000 DMCAs against you if you do not agree to the higher pricepoint.
  • Google is considering making an investment in your site & you want too much money. As an edge case near the threshold of this copyright limit you know you have immunity if you join the borg, but lack it if you don't work with them.
  • Big media players that play in the gray area will be fine, but smaller sites that try a similar model will be sunk by DMCAs and/or legal fees.
  • Your leading competitor realizes that your blog publishes comments by default with editorial review (and that even later has lax review) and then they file DMCA reports against you. Or they could just grab chunks of content from Google's leaderboard of complainers and post them into your web forum, knowing that those companies will file a DMCA report against you.
  • A site has some content public & some behind a paywall. With a page partially indexed, how does Google respond to DMCA requests when the alleged infraction is behind a registration wall or paywall?
  • A competitor (inspired by Google no doubt) hires off shore "contractors" to copy your site & then file DMCA reports against you in bulk. How long until people start uploading their own content to file their own DMCAs against certain sites with user generated content?
  • Even if your site is 100% legal, a combination of ignorance & crowd-driven vigilante justice can still take you down.
  • Any site that offers interactive features & has user generated content is at risk of being labeled as spam unless they have tight editorial control over user generated content. And at the same time, Google can enter vertical after vertical with scrape & displace garbage knowing that they don't have those editorial costs due to their self-granted blanket immunity.
  • If you do not register your sites with Google & counter claims (even bogus ones) then you are seen as being a spammer. And if you register with Google then when they don't like something one site does they can hit other sites all at the same time. No point going to the host or registrar, go direct to Google & start building up negative karma.

Why did Google feel the need to grant themselves blanket immunity from the policy?

That question was largely missing among the fanboi blogs & journalists who were encouraged by Google's "transparency."

24 Karat Pyrite On Sale for Only $100 an Ounce

If YouTube is going to win big, then that's a great place to invest, right?

Maybe not.

Some venture capitalists are investing in YouTube channels, but that is a fool's game.

  • Google is also investing in select channels (like Machinima). It is quite hard to outperform Google in returns while investing into a platform that they control & thus have better data on than you ever could.
  • As YouTube's dominance increases (and it will now that competing platforms with a similar business model will be smeared as spam), you can count on them offering premium partners crappier revenue share deals in years to come. They will offer nice deals to Warner Bros. & such, but the independent smaller players will get cut out of the ecosystem in much the same way as they did in Google's organic search results.
  • Google, prince of transparency (for everyone but Google), requires that premium publishers *not* disclose the terms of their deals: "The Partner Program forbids participants to reveal specifics about their ad-share revenue. Rates can vary depending on the size and demographics of the partner’s audience and an array of other metrics."

Note that I don't claim YouTube is a bad host for your own content, but that I am skeptical in applying the VC model to it with a belief that you can out-invest Google on their own site; particularly when they own the dominant platform, control the non-public revenue share rates, invest in competing channels & can offer free promotion + higher rates to anyone they invest into in order to dominate the category.

And the issue isn't just video either. The same dynamic can apply to just about any other infrastructural layer. For instance, Google could buy out a torrent site (say like uTorrent) and have that site gain immediately immunity for being part of the borg, while other sites that compete now absorb both greater editorial filtering costs & greater risks that destroy their ROI.

As Google continues to lock down search, you can expect more smart publishers to hedge investments in search and YouTube with investments in proprietary non-search applications that Google can't take away.

The Devil is in the Details

"We are optimistic that Google’s actions will help steer consumers to the myriad legitimate ways for them to access movies and TV shows online, and away from the rogue cyberlockers, peer-to-peer sites, and other outlaw enterprises that steal the hard work of creators across the globe. We will be watching this development closely — the devil is always in the details — and look forward to Google taking further steps to ensure that its services favor legitimate businesses and creators, not thieves." - Michael O’Leary, Senior Executive Vice President for Global Policy and External Affairs of the Motion Picture Association of America, Inc.

The concerned with Google pitching themselves as the preeminent authority on copyright is they have consistently played both sides of the fence.

When Google was competing against YouTube, this was how they viewed copyright internally.

Business Objectives Drive "Relevancy" Signals

Google is a big player in business online and off. They can sell private data exclusively & their online profits are so huge that they are now buying auto loan bonds.

Now that Google wants to sell premium content they (sort of) respect copyright (& are willing to hold the rest of the web to a higher standard than themselves to create this impression).

I have long believed that relevancy signals were often politically driven & that internal business development goals often lead or create various signals. Certainly that was obvious when Google+ was hardcoded in the search results. It was equally true when Knol outranked the original content sources. Google frequently pretends to be (belligerently) unaware of externalities, but when the issues impact their own business they gain an elevated sense of importance.

And these business objectives not only influence the relevancy algorithms, but also the editorial guidelines.

And even while Google is rolling out this "copyright violators are spammers" algorithm (which they are exempt from) they still chug on with their ebook offering:

They posted several of my 41 books up as free downloads (some were missing a few pages at most a single chapter) It took several e-mails from me pointing out that they were infringing copyright before they took them down. During the time my books were free on Google my sales of e-books fell dramatically. " - K C Watkins

When Google started scanning books an internal document stated: “[we want web searchers interested in book content to come to Google not Amazon” ... or, as put another way, in that same document, “[e]verything else is secondary … but make money.”

How is Search Spam Defined?

Sharing is caring!

Please share :)

Embed code is here.

What is Spam?

Creative Broken Link Building Tips with Jon Cooper

Here are some quick tips on how you can use blogrolls to compose a list of as many related blogs as possible, then checking those blogs to see if any of them return 404s.

A good free tool to use for finding blogs is the SoloSEO link tool, which will pull up blogs (and other assorted advanced search operators) based on the keyword you input.

After going through the ways to build the list, I’ll run through a few ways you can use it.

Step #1: Find a few blogs

Start off by finding a few related blogs that have blogrolls. The more blogs & the longer the blogrolls of each, the better. This is our seed list that will soon multiply itself.

Step #2: Multiply your list

Take the URLs of these blogs and throw them into Buzzstream’s blogroll list builder. In the example below, I just started off with one (an HR blog):

Once you hit Go, it searches the blog(s) and finds every blog in their blogroll (note: I was having issues with it in Chrome, so if you do as well, switch browsers):

Step #3: Rinse and repeat

Next, download the results as CSV. Open it up in Excel, then copy & paste the blogroll URLs back into the list builder tool (you might have to refresh/reopen the page).

Keep doing this until you have a sizeable list. The bigger the better, but as you keep expanding, you’ll run into the issue of irrelevant blogs entering the list, so just keep that in mind.

Step #4: Check the status of the URLs

Next, throw your list of URLs into Citation Lab’s URL Status Checker tool. This will check to see if any of the URLs in the blogroll are 404s.

Once the report is finished, you can export it as a CSV.

Step #5: Pick your poison

Now it’s up to you how you want to use this list for broken link building. Here are a few popular options:

1. Blogroll Links

Go down the list of 404s and plug them into any of the bigger link tools on the market, Open Site Explorer, Ahrefs.Com, or MajesticSEO. Scan their top links for any that are coming from a homepage. These are almost always blogroll links.

Go to these homepages and use the Check My Links chrome extension, because if one link in their blogroll is broken, then there’s usually a few others.

From there, reach out to the bloggers letting them know of the broken links. Then ask them if one of them could be replaced with a link to your blog since it’s related.

2. Dead Content Links

Once again, plug the 404s into the link tool of your choice. This time however, instead of checking their links, click on Top Pages section in the tool.

Find their most linked to content, double check each to make sure the page is no longer available, then plug those URLs into Archive.org to see what content used to be there.

Next you’re going to rewrite the content, but do your best to make it even better. If it’s a little outdated, then update it.

This content will not only attract links on its own with proper promotion (the old one did, the new one probably will as well), but you can now use this for broken link building.

Take the URLs of the broken, linked-to content and plug it into your link tool(s). Go down the list and find the most valuable links to that content, then reach out to the webmaster/blogger of those sites and let them know that page is broken.

Tell them that “you took the burden” of recreating it, and that for the sake of their readers, they should update the broken link by now linking to you.

Other purposes

You can also use the initial list of 404s to see if any of those domains are:

  • Expired & available to register
  • Available to purchase in auctions
  • Available to outright purchase

If they have enough links to them, you can put some content up and include a few links back to you. If you’re going to do this, make sure you put content up on their Top Pages, since these are already loaded with link juice.

Finally, you can take that list of blogrolls, remove all the 404s & duplicates, and use the Mozscape API (with excel) to find the most authoritative blogs in your niche. From there, build relationships, ask for product reviews, or anything else you can think of.

Final thoughts

So many of the tools we have ready at our fingers can be used in various combinations. Don’t be afraid to experiment.

What do you think of this process? What do you think can be improved? I’d love to hear your thoughts below!

Bio

Jon Cooper is an SEO consultant and the author of Point Blank SEO, a link building blog. Follow him on Twitter @pointblankseo.

A Quick Look at Cell Phone SERPs & the Mobile SEO 'Opportunity'

Mobile Ad CTR

Worstream recently put out an infographic where they suggested that 64.6% of search result clicks on highly commercial keywords are clicks on AdWords ads. Shortly before Google's quarterly announcement RKG put out their digital marketing report. In it they highlight how search ad CTR differs by device.

What causes a higher CTR on cell phones & tablets? A smaller search interface, which allows ads to dominate a larger portion of the screen real estate.

Screen Real Estate

Vertical iPhone = 1/3 of an organic listing above the fold.

Horizontal iPhone = all ads above the fold.

Vertical iPad is about 2/3 ads above the fold.

Horizontal iPad has about half of a single organic listing above the fold.

Vertical Kindle is about 2/3 ads.

Horizontal Kindle is 100% ads above the fold.

And the above interfaces are not going to look any less ad heavy as Google adds paid inclusion shopping results.

Controlling the Ecosystem

Google offers sitelinks when they think a search query is navigational in nature. In spite of that, for some brands they will still show 3 AdWords ads above the organic search results, in an attempt to force the brand to re-buy their own brand equity.

If you control what is above the fold (and can get away with serving nothing but ads above the fold) you can make a lot of money.

Curious case of small business and SEO

We all read the advice online: don’t build crappy links. Don’t use short term benefit tactics in SEO. But do we always heed that advice? Can we always afford to?

The latest reality check came in the shape of a small online business in the UK, Children’s Furniture Store (CFS). Jane Copland  tweeted about an online letter in which they announce that, due to Penguin update, they are forced to close their business down.

This really got me. Firstly, I hate to see a small business go under. These people put their hearts and souls into the business and it breaks my heart to see them being closed especially due to changes in Google algo. Furthermore, it seems from their closing letter that they were a victim of bad SEO advice and that reflects poorly on all of us. We have enough attention seekers out there calling us out for asshattery as it is so I would rather be pictured as someone who helps small businesses rather than the one that puts them under.

A lot of people started reaching out to Children Furniture Store’s twitter account, offering help and advice. Unfortunately, it was too late for them; they have already started folding up their business and have ceased trading.

I am sure this is not the only case that has or will have happened. As a matter of fact as a result of my activity on twitter around this, I was contacted by another small business asking for help on similar issues. Other people I know encounter these situations on weekly basis.

So why is this happening? Who is to blame for this? A business is closing down, people are losing their jobs, we can’t just dismiss it as “that’s life” and “business is hard”. We cannot learn anything from this case and other similar cases if we do not take a hard look at all the possible culprits responsible for these situations and try to understand what could have been done to prevent this from happening:

This is the list of guilty parties, according to my opinion, ranked by a decreasing amount of responsibility:

The business owner

The business owner is the most responsible party here. They probably didn’t mind when the money was rolling in and never thought about the “what if” scenario. These are the things that they did wrong:

  1. Never ever put all the eggs in one basket – I think this is the most common and widespread piece of advice given to website and general business owners, yet people manage to ignore it again and again. Had CFS had various sources of traffic (which they could have developed with the profits from the organic traffic) or even had they started developing offline business, Google Penalty would have hurt much less. This is true even if you are not using blatantly spammy SEO techniques, you never know where Google’s business goals may be tomorrow and when the line between what is kosher and what isn’t is constantly moving, you never know when you will find yourself on the other side of the line. Having additional sources of traffic/business immunizes (relatively) you against this scenario. Sometimes you have to bite the bullet and PAY for the traffic – for example Paid Search. Building a social presence would help too. Luckily they HAD kept their mailing list and were able to sell any leftover inventory using it – but mail is a good channel to optimize sales too.
  2. Get educated – there is a lot of SEO information out there. No one can follow all of it. But it is your prerogative as an online business to keep abreast of the most important best practices and pitfalls within the marketing channel that is providing you with the majority of your income. Had this business done their due diligence, they would know not to rely on only one stream of traffic, they would know that the practices used by their SEO provider are shady at best, they would know that they are paying too little for the SEO services for them to safely provide them with edge over their competition in their niche. They would also know what to do when shit hits the fan and not wait for a full year for the second hit which will ultimately decimate their business.


    In this case, the business owner did say that they spent a lot of time trying to read on the internet about similar issues – apparently they didn’t find any “real” advice. Should Business Owners learn to navigate online information a bit better? Or should we, as an industry, make sure that the information found on these issues is top notch? But more about that further down. In this particular case, the owner of the business did several things – tried reading about the possible problem, turned to an independent SEO (who told her to let the site die and start anew) and fired the agency that was probably the cause of all this. Still there was much more to be done and I hope other businesses will act differently in similar situations.
  3. Reach out – as their “we are closing the business” letter started circulating, more and more people started saying that they are willing to help. In a matter of minutes, both in public and private channels, a picture of what needs to be done to help this website started emerging. Getting this kind of analysis from industry experts can cost a lot of money, but if a business owner harnesses the benefits of the SEO community, either through Twitter, SEOBook Forum, Google Webmaster Central forums, SEOMoz Q&A forum, G+, Facebook groups, etc., they can get a pretty clear picture about what hit them and what needs to be done. They would be more aware of the risk levels involved with the SEO strategies they were using and would be able to move away from them much earlier, making the cleanup a more viable option. With all the misgivings of this industry, it has some of the most generous and helping people in it and this can be a tremendous asset for small businesses that are struggling to come with terms with the challenges involved in promoting your website in organic results.

SEO Company

  1. Spammy strategies – one look at the CFS’ backlink profile shows patterns of a backlink network.



    Further conversations with people that are connected to the company showed that this is indeed the case. Bunch of footer links, clearly paid-for blog posts, sidebar sitewide links from non-related sites in non-English languages… You took a small business that doesn’t know what they are doing, promised them wonders at three-digit monthly recurring price and it worked for a while. Did you warn them about the risks? Did you tell them that if Google decides to target these link-building practices, their whole business can go down the drain? Or did you encourage them to enjoy the party while it lasts? Did you instruct them to take the profits of these short-sighted tactics and invest them in diversifying their traffic sources? No you didn’t. You are no better than a drug dealer, reaping profits from the lack of knowledge of unsuspecting client, allowing them to risk their whole business and you should be ashamed of yourself for that. You sir, are an ass hat. 
  2. No responsibility – as the graph attached above shows, the CFS site was hit at two occasions, one in May 2011 and the other in May 2012. According to them, they have stopped working with you by the time WMT warning notices have arrived. Do you think that releases you from the responsibility for your work? What did you do in between those two dates? Did you take responsibility for CFS situation? Did you instruct them on how to fix their situation? How did you allow a business that found itself in a shitty situation, partially due to your actions, to get to the point where they have to close their doors? Do you honestly not care that people are going to be jobless because of the bad advice you have provided?

Google

Yes Google.

By allowing crappy linking strategies to work for so long, they have created a situation where the only viable option to stay competitive in certain niches was to join the bandwagon and use spammy links. You can stand on your soapbox only for only that long and preach “whitehat” techniques while your competitors are laughing all the way to the bank and cashing in. So yes, at some point they will probably be penalized, but until then they will have developed enough capital to be able to safely switch to some other domain/SEO strategy and have developed their brand to the point where they are practically immune from algorithmic changes. You have created a situation in which following your Best Practices was a financially unviable option for a lot of small businesses and for this you carry a part of the blame

Furthermore, you should realize that the information you give out about these penalties is not read only by sinister SEOs spending their days and nights trying to reverse engineer your precious algorithm. Why is it so hard to tell the business owner what is it they are getting penalized for? Tell them “your site has a large amount of paid links/unnatural anchors. You can find these links marked with a huge red exclamation mark in your WMT link report. Get rid of them”. Doesn’t Google have a responsibility of providing decent, informed content around these sort of penalties so that  a business owner can refer back to the source? When they penalize a business – shouldn’t it be their responsibility to say EXACTLY why? Is a bland, notification in GWMT sufficient?

When you Google “Penguin” or “Panda” etc – shouldn’t Google’s own written guidelines on recovery be ranked at top positions, so no one else gets scammed? Yes, it is not all Google’s fault that these businesses were told that it is OK to do whatever it takes to rank. Yes, Google does not owe anyone anything but it would be a sign of goodwill towards those that provide the content of the web for Google to crawl and serve ads on.

The SEO Community

How is the SEO community responsible? By greatly diluting the information space in our industry. The number of inane posts, all written in the same “10 ways unrelated-X affects your SEO-Related-Y” format, all based on conjectures and rehashed hearsay, make it almost impossible for a non-industry person to get to the meaningful information. I have seen articles with link building strategies that were covered in 2006 being peddled as “current” and “cutting edge” in 2012.

Without knowing the authors, companies they work for, their level of experience and history of their posting, there is no way that a person who doesn’t spend significant amounts of time wading through the noise created in the SEO space can know what is reliable and what not. Furthermore, the lack of propensity to call out crap information when we see one, complete avoidance of confrontation within the industry, limiting critical discussion on quality of content behind gated walls of private Skype chats and limited Facebook groups, makes the pruning of this jungle of nonsense an impossible task and for that all of us bear some part of responsibility.

I am really sad for CFS. It depresses me that a business can go under so easily from causes that could have been prevented. There are real people behind these websites, making their living, in spite of Google doing a lot to make their success harder (by promoting big brands and at a switch of an algorithm button making previously acceptable and successful practices - damaging). I hope that this post will help other businesses make sure that they are doing everything possible not to find themselves in a similar situation.

Many thanks to Rishi for helping with editing and some background info.


Branko Rihtman has been optimizing sites for search engines since 2001 for clients and own web properties in a variety of competitive niches. Over that time, Branko realized the importance of properly done research and experimentation and started publishing findings and experiments at SEO Scientist. Branko is currently responsible for SEO R&D at RankAbove, provider of a leading SEO SaaS platform – Drive.

SWOT Analysis for Web Publishers

The rapid changes in the search industry over the last sixteen months have left many web publishers wondering whether they should pivot their business models or exist the industry entirely. This is a difficult question for business owners who have invested years of their lives and much of their wealth in firms which may no longer be viable contenders in the "new" search industry.

SWOT analysis is a technique which business owners can use to strategically analyze their businesses in relation to their competitors and the marketplace as a whole. SWOT stands for Strengths, Weaknesses, Opportunites, Threats.

  • Strengths are attributes of the organization which provide an advantage in the marketplace.
  • Weaknesses are attributres of the organization which cause a disadvantage in the marketplace.
  • Opportunities are actions the organization could take to create an advantage in the marketplace.
  • Threats are events which could happen in the environment and cause the organization to be disadvantaged.

The first two areas, Strengths and Weaknesses, focus primarily on the internal attributes of the organization. The last two areas, Opportunities and Threats, focus primary on how the organization may be affected by external events.

Specifics for Web Publishers

Many firms in the same industry will share similar Strengths and Weaknesses. Even more so, most firms in any industry will be responding to similar Opportunities and Threats.

Strengths and Weaknesses

Take a look at your organization. If you feel that your organization has an attribute which makes it stronger than it's competitors, add that to your Strengths list. If you feel that your organization has an attribute that makes it weaker than it's competiors, add that item to your Weaknesses list.

  • Access to Funding
  • Brand Recognition
  • Domain Authority
  • Industry Connections
  • Technical Skills
  • Marketing Savvy
  • Vertical Expertise

Examples of Strengths might include:

  • We have ready access to venture capital
  • We own a widely recognized brand name
  • We own a PageRank 8 domain
  • I have Matt Cutts on speed dial
  • Our technical team members are experts in our platforms, development tools, and applications
  • Our marketing team members can make linkbait about lug nuts go viral
  • We invented this niche and our competitors have no hope of ever catching up

Examples of Weaknesses might include:

  • Our working capital is limited to what's in my wallet
  • Our top domain is a hyphenated .us domain
  • We're hoping to gain PageRank at the next update
  • Matt Cutts blocked me on Twitter
  • Our technical team is outsourced to Pakistan
  • Our marketing team is outsourced to Bangladesh
  • I read a book about this niche and it seems very exciting

Opportunities and Threats

The same event might be an Opportunity or a Threat, depending upon how your organization can respond to it. Search is a zero-sum game. For every winner, there must be a loser.

Take a look at your organization. If you feel that your organization has the ability to benefit from a coming change in the business environment, add that to your Opportunities list. If you believe that your organization is at risk from a coming change, add that to your Threats list.

  • Our niche (travel, local, etc...) is being taken over by Google (unless you are Google)
  • Our niche is being persecuted (gambling, medication) or promoted (green energy, section 8 housing) by the government
  • Our niche is being regulated by the government, which benefits large companies and hurts small ones
  • Our niche is being increasingly dominated by the top brands (unless you are one of the top brands)
  • Our niche is growing (iPads) or shrinking (Blackberries)
  • Profitability in this niche is rising (medical training) or falling (almost everything else)
  • Some marketing tactics may be filtered or penalized (directory submissions, blog commenting, profile building)
  • Significant competitors are entering (or leaving) the niche

Examples of Opportunities might include:

  • Legislation could force consumers or businesses to buy our goods and services
  • Government regulation could force small competitors out of the market, and we're a large competitor
  • Google is increasingly ranking the top brands for all searches, and we're a top brand
  • Our niche is growing
  • Profitability in the niche is rising
  • Our marketing tactics are being increasingly rewarded by the search engines
  • Our niche has significant barriers to entry which prevent competitors from entering the market

Examples of Threats might include:

  • Legislation could make our business illegal in our country
  • Government regulation could force small competitors out of the market, and we're one of those small competitors
  • Google is increasingly ranking the top brands for all searches, and we're not a top brand
  • Our niche is shrinking
  • Profitability in the niche is falling -- unless you can operate on thinner margins than your competitors and take their market share when they fail
  • Our marketing tactics are being increasingly filtered or penalized by the search engines
  • One of our competitors just did an interview with Forbes bragging about the high profit margins in this niche

Responding to the Results of Your Analysis

After listing your Strengths, Weaknesses, Opportunities, and Threats you should have a pretty good idea where your business stands. From here, it's time to take advantage of this new knowledge.

The web publishing industry is currently undergoing a major contraction. Some organizations will choose to continue in this business, while others will choose to pivot into related business or to exit the industry entirely. AdSense publishers may decide to move into affiliate marketing or selling white label products. Web publishers may decide to halt development on their own projects and offer their services as SEO's to large enterprises. Entrepreneurs may simply close their companies and accept positions with larger firms.

If your niche is travel, which Google is slowly taking over and Wikimedia is considering a push into, you might consider moving to a different niche, pivoting your web publishing business into an SEO firm, or moving into the nascent eBook market. If your niche is 3D printers, you might seek funding to stake out early market share in a niche that may be about to cross the chasm from the early adopter stage of development.

If you have deep knowledge, experience, and connections in your niche, you might try to stick with it and be the last man standing after your weaker competitors have failed. If your knowledge is less niche focused and more related to publishing and marketing, you might sell SEO services or take a job with one of the huge multinational brands which Google is currently favoring in the SERPs.

If you have access to large amount of venture capital, you might take advantage of that to become one of the large brands which Google prefers to rank. With enough funding, anything can be ranked well in Google. I would caution, however, against entering a niche which is likely to be on Google's roadmap. Google, in being able to control the order of search results, has an unbeatable advantage in promoting their own properties (YouTube, Google+, etc...).

As margins in the industry are falling in our race to the bottom, you may even find a significant competitive advantage in having a lower cost structure than your competitors. Lower costs create larger amounts of retained earnings which can be used to fuel development and growth.

Summary

The two most important aspects of SWOT analysis are to be honest with yourself and to take action based upon your analysis. As Virgil wrote, fortune favors the bold. Be bold in your honesty and your actions and fortune will smile upon you.


Will Spencer is the CEO of MemeBridge and Alpha Geek at The Tech FAQ.

Pages