A Change to Nofollow

Last month Google announced they were going to change how they treated nofollow, moving it from a directive toward a hint. As part of that they also announced the release of parallel attributes rel="sponsored" for sponsored links & rel="ugc" for user generated content in areas like forums & blog comments.

Why not completely ignore such links, as had been the case with nofollow? Links contain valuable information that can help us improve search, such as how the words within links describe content they point at. Looking at all the links we encounter can also help us better understand unnatural linking patterns. By shifting to a hint model, we no longer lose this important information, while still allowing site owners to indicate that some links shouldn’t be given the weight of a first-party endorsement.

In many emerging markets the mobile web is effectively the entire web. Few people create HTML links on the mobile web outside of on social networks where links are typically nofollow by default. This reduces the potential signal available to either tracking what people do directly and/or shifting how the nofollow attribute is treated.

Google shifting how nofollow is treated is a blanket admission that Penguin & other elements of "the war on links" were perhaps a bit too effective and have started to take valuable signals away from Google.

Google has suggested the shift in how nofollow is treated will not lead to any additional blog comment spam. When they announced nofollow they suggested it would lower blog comment spam. Blog comment spam remains a growth market long after the gravity of the web has shifted away from blogs onto social networks.

Changing how nofollow is treated only makes any sort of external link analysis that much harder. Those who specialize in link audits (yuck!) have historically ignored nofollow links, but now that is one more set of things to look through. And the good news for professional link auditors is that increases the effective cost they can charge clients for the service.

Some nefarious types will notice when competitors get penalized & then fire up Xrummer to help promote the penalized site, ensuring that the link auditor bankrupts the competing business even faster than Google.

Links, Engagement, or Something Else...

When Google was launched they didn't own Chrome or Android. They were not yet pervasively spying on billions of people:

If, like most people, you thought Google stopped tracking your location once you turned off Location History in your account settings, you were wrong. According to an AP investigation published Monday, even if you disable Location History, the search giant still tracks you every time you open Google Maps, get certain automatic weather updates, or search for things in your browser.

Thus Google had to rely on external signals as their primary ranking factor:

The reason that PageRank is interesting is that there are many cases where simple citation counting does not correspond to our common sense notion of importance. For example, if a web page has a link on the Yahoo home page, it may be just one link but it is a very important one. This page should be ranked higher than many pages with more links but from obscure places. PageRank is an attempt to see how good an approximation to "importance" can be obtained just from the link structure. ... The denition of PageRank above has another intuitive basis in random walks on graphs. The simplied version corresponds to the standing probability distribution of a random walk on the graph of the Web. Intuitively, this can be thought of as modeling the behavior of a "random surfer".

Google's reliance on links turned links into a commodity, which led to all sorts of fearmongering, manual penalties, nofollow and the Penguin update.

As Google collected more usage data those who overly focused on links often ended up scoring an own goal, creating sites which would not rank.

Google no longer invests heavily in fearmongering because it is no longer needed. Search is so complex most people can't figure it out.

Many SEOs have reduced their link building efforts as Google dialed up weighting on user engagement metrics, though it appears the tide may now be heading in the other direction. Some sites which had decent engagement metrics but little in the way of link building slid on the update late last month.

As much as Google desires relevancy in the short term, they also prefer a system complex enough to external onlookers that reverse engineering feels impossible. If they discourage investment in SEO they increase AdWords growth while gaining greater control over algorithmic relevancy.

Google will soon collect even more usage data by routing Chrome users through their DNS service: "Google isn't actually forcing Chrome users to only use Google's DNS service, and so it is not centralizing the data. Google is instead configuring Chrome to use DoH connections by default if a user's DNS service supports it."

If traffic is routed through Google that is akin to them hosting the page in terms of being able to track many aspects of user behavior. It is akin to AMP or YouTube in terms of being able to track users and normalize relative engagement metrics.

Once Google is hosting the end-to-end user experience they can create a near infinite number of ranking signals given their advancement in computing power: "We developed a new 54-qubit processor, named “Sycamore”, that is comprised of fast, high-fidelity quantum logic gates, in order to perform the benchmark testing. Our machine performed the target computation in 200 seconds, and from measurements in our experiment we determined that it would take the world’s fastest supercomputer 10,000 years to produce a similar output."

Relying on "one simple trick to..." sorts of approaches are frequently going to come up empty.

EMDs Kicked Once Again

I was one of the early promoters of exact match domains when the broader industry did not believe in them. I was also quick to mention when I felt the algorithms had moved in the other direction.

Google's mobile layout, which they are now testing on desktop computers as well, replaces green domain names with gray words which are easy to miss. And the favicon icons sort of make the organic results look like ads. Any boost a domain name like CreditCards.ext might have garnered in the past due to matching the keyword has certainly gone away with this new layout that further depreciates the impact of exact-match domain names.

At one point in time CreditCards.com was viewed as a consumer destination. It is now viewed ... below the fold.

If you have a memorable brand-oriented domain name the favicon can help offset the above impact somewhat, but matching keywords is becoming a much more precarious approach to sustaining rankings as the weight on brand awareness, user engagement & authority increase relative to the weight on anchor text.

It has been a while since Google has had a major algorithm update.

They recently announced one which began on the 12th of March.

This week, we released a broad core algorithm update, as we do several times per year. Our guidance about such updates remains as we’ve covered before. Please see these tweets for more about that:https://t.co/uPlEdSLHoXhttps://t.co/tmfQkhdjPL— Google SearchLiaison (@searchliaison) March 13, 2019

What changed?

It appears multiple things did.

When Google rolled out the original version of Penguin on April 24, 2012 (primarily focused on link spam) they also rolled out an update to an on-page spam classifier for misdirection.

And, over time, it was quite common for Panda & Penguin updates to be sandwiched together.

If you were Google & had the ability to look under the hood to see why things changed, you would probably want to obfuscate any major update by changing multiple things at once to make reverse engineering the change much harder.

Anyone who operates a single website (& lacks the ability to look under the hood) will have almost no clue about what changed or how to adjust with the algorithms.

In the most recent algorithm update some sites which were penalized in prior "quality" updates have recovered.

Though many of those recoveries are only partial.

Many SEO blogs will publish articles about how they cracked the code on the latest update by publishing charts like the first one without publishing that second chart showing the broader context.

The first penalty any website receives might be the first of a series of penalties.

If Google smokes your site & it does not cause a PR incident & nobody really cares that you are gone, then there is a very good chance things will go from bad to worse to worser to worsterest, technically speaking.

“In this age, in this country, public sentiment is everything. With it, nothing can fail; against it, nothing can succeed. Whoever molds public sentiment goes deeper than he who enacts statutes, or pronounces judicial decisions.” - Abraham Lincoln

Absent effort & investment to evolve FASTER than the broader web, sites which are hit with one penalty will often further accumulate other penalties. It is like compound interest working in reverse - a pile of algorithmic debt which must be dug out of before the bleeding stops.

Further, many recoveries may be nothing more than a fleeting invitation to false hope. To pour more resources into a site that is struggling in an apparent death loop.

The above site which had its first positive algorithmic response in a couple years achieved that in part by heavily de-monetizing. After the algorithm updates already demonetized the website over 90%, what harm was there in removing 90% of what remained to see how it would react? So now it will get more traffic (at least for a while) but then what exactly is the traffic worth to a site that has no revenue engine tied to it?

That is ultimately the hard part. Obtaining a stable stream of traffic while monetizing at a decent yield, without the monetizing efforts leading to the traffic disappearing.

A buddy who owns the above site was working on link cleanup & content improvement on & off for about a half year with no results. Each month was a little worse than the prior month. It was only after I told him to remove the aggressive ads a few months back that he likely had any chance of seeing any sort of traffic recovery. Now he at least has a pulse of traffic & can look into lighter touch means of monetization.

If a site is consistently penalized then the problem might not be an algorithmic false positive, but rather the business model of the site.

The more something looks like eHow the more fickle Google's algorithmic with receive it.

Google does not like websites that sit at the end of the value chain & extract profits without having to bear far greater risk & expense earlier into the cycle.

Thin rewrites, largely speaking, don't add value to the ecosystem. Doorway pages don't either. And something that was propped up by a bunch of keyword-rich low-quality links is (in most cases) probably genuinely lacking in some other aspect.

Generally speaking, Google would like themselves to be the entity at the end of the value chain extracting excess profits from markets.

RIP Quora!!! Q&A On Google - Showing Questions That Need Answers In Search https://t.co/mejXUDwGhT pic.twitter.com/8Cv1iKjDh2— John Shehata (@JShehata) March 18, 2019

This is the purpose of the knowledge graph & featured snippets. To allow the results to answer the most basic queries without third party publishers getting anything. The knowledge graph serve as a floating vertical that eat an increasing share of the value chain & force publishers to move higher up the funnel & publish more differentiated content.

As Google adds features to the search results (flight price trends, a hotel booking service on the day AirBNB announced they acquired HotelTonight, ecommerce product purchase on Google, shoppable image ads just ahead of the Pinterest IPO, etc.) it forces other players in the value chain to consolidate (Expedia owns Orbitz, Travelocity, Hotwire & a bunch of other sites) or add greater value to remain a differentiated & sought after destination (travel review site TripAdvisor was crushed by the shift to mobile & the inability to monetize mobile traffic, so they eventually had to shift away from being exclusively a reviews site to offer event & hotel booking features to remain relevant).

It is never easy changing a successful & profitable business model, but it is even harder to intentionally reduce revenues further or spend aggressively to improve quality AFTER income has fallen 50% or more.

Some people do the opposite & make up for a revenue shortfall by publishing more lower end content at an ever faster rate and/or increasing ad load. Either of which typically makes their user engagement metrics worse while making their site less differentiated & more likely to receive additional bonus penalties to drive traffic even lower.

In some ways I think the ability for a site to survive & remain though a penalty is itself a quality signal for Google.

Some sites which are overly reliant on search & have no external sources of traffic are ultimately sites which tried to behave too similarly to the monopoly that ultimately displaced them. And over time the tech monopolies are growing more powerful as the ecosystem around them burns down:

If you had to choose a date for when the internet died, it would be in the year 2014. Before then, traffic to websites came from many sources, and the web was a lively ecosystem. But beginning in 2014, more than half of all traffic began coming from just two sources: Facebook and Google. Today, over 70 percent of traffic is dominated by those two platforms.

Businesses which have sustainable profit margins & slack (in terms of management time & resources to deploy) can better cope with algorithmic changes & change with the market.

Over the past half decade or so there have been multiple changes that drastically shifted the online publishing landscape:

• the shift to mobile, which both offers publishers lower ad yields while making the central ad networks more ad heavy in a way that reduces traffic to third party sites
• the rise of the knowledge graph & featured snippets which often mean publishers remain uncompensated for their work
• higher ad loads which also lower organic reach (on both search & social channels)
• the rise of programmatic advertising, which further gutted display ad CPMs
  
• the rise of ad blockers
• increasing algorithmic uncertainty & a higher barrier to entry

Each one of the above could take a double digit percent out of a site's revenues, particularly if a site was reliant on display ads. Add them together and a website which was not even algorithmically penalized could still see a 60%+ decline in revenues. Mix in a penalty and that decline can chop a zero or two off the total revenues.

Businesses with lower margins can try to offset declines with increased ad spending, but that only works if you are not in a market with 2 & 20 VC fueled competition:

Startups spend almost 40 cents of every VC dollar on Google, Facebook, and Amazon. We don’t necessarily know which channels they will choose or the particularities of how they will spend money on user acquisition, but we do know more or less what’s going to happen. Advertising spend in tech has become an arms race: fresh tactics go stale in months, and customer acquisition costs keep rising. In a world where only one company thinks this way, or where one business is executing at a level above everyone else - like Facebook in its time - this tactic is extremely effective. However, when everyone is acting this way, the industry collectively becomes an accelerating treadmill. Ad impressions and click-throughs get bid up to outrageous prices by startups flush with venture money, and prospective users demand more and more subsidized products to gain their initial attention. The dynamics we’ve entered is, in many ways, creating a dangerous, high stakes Ponzi scheme.

And sometimes the platform claws back a second or third bite of the apple. Amazon.com charges merchants for fulfillment, warehousing, transaction based fees, etc. And they've pushed hard into launching hundreds of private label brands which pollute the interface & force brands to buy ads even on their own branded keyword terms.

They've recently jumped the shark by adding a bonus feature where even when a brand paid Amazon to send traffic to their listing, Amazon would insert a spam popover offering a cheaper private label branded product:

Amazon.com tested a pop-up feature on its app that in some instances pitched its private-label goods on rivals’ product pages, an experiment that shows the e-commerce giant’s aggressiveness in hawking lower-priced products including its own house brands. The recent experiment, conducted in Amazon’s mobile app, went a step further than the display ads that commonly appear within search results and product pages. This test pushed pop-up windows that took over much of a product page, forcing customers to either click through to the lower-cost Amazon products or dismiss them before continuing to shop. ... When a customer using Amazon’s mobile app searched for “AAA batteries,” for example, the first link was a sponsored listing from Energizer Holdings Inc. After clicking on the listing, a pop-up window appeared, offering less expensive AmazonBasics AAA batteries."

Buying those Amazon ads was quite literally subsidizing a direct competitor pushing you into irrelevance.

And while Amazon is destroying brand equity, AWS is doing investor relations matchmaking for startups. Anything to keep the current bubble going ahead of the Uber IPO that will likely mark the top in the stock market.

Some thoughts on Silicon Valley's endgame. We have long said the biggest risk to the bull market is an Uber IPO. That is now upon us.— Jawad Mian (@jsmian) March 16, 2019

As the market caps of big tech companies climb they need to be more predatious to grow into the valuations & retain employees with stock options at an ever-increasing strike price.

They've created bubbles in their own backyards where each raise requires another. Teachers either drive hours to work or live in houses subsidized by loans from the tech monopolies that get a piece of the upside (provided they can keep their own bubbles inflated).

"It is an uncommon arrangement — employer as landlord — that is starting to catch on elsewhere as school employees say they cannot afford to live comfortably in regions awash in tech dollars. ... Holly Gonzalez, 34, a kindergarten teacher in East San Jose, and her husband, Daniel, a school district I.T. specialist, were able to buy a three-bedroom apartment for $610,000 this summer with help from their parents and from Landed. When they sell the home, they will owe Landed 25 percent of any gain in its value. The company is financed partly by the Chan Zuckerberg Initiative, Mark Zuckerberg’s charitable arm."

The above sort of dynamics have some claiming peak California:

The cycle further benefits from the Alchian-Allen effect: agglomerating industries have higher productivity, which raises the cost of living and prices out other industries, raising concentration over time. ... Since startups raise the variance within whatever industry they’re started in, the natural constituency for them is someone who doesn’t have capital deployed in the industry. If you’re an asset owner, you want low volatility. ... Historically, startups have created a constant supply of volatility for tech companies; the next generation is always cannibalizing the previous one. So chip companies in the 1970s created the PC companies of the 80s, but PC companies sourced cheaper and cheaper chips, commoditizing the product until Intel managed to fight back. Meanwhile, the OS turned PCs into a commodity, then search engines and social media turned the OS into a commodity, and presumably this process will continue indefinitely. ... As long as higher rents raise the cost of starting a pre-revenue company, fewer people will join them, so more people will join established companies, where they’ll earn market salaries and continue to push up rents. And one of the things they’ll do there is optimize ad loads, which places another tax on startups. More dangerously, this is an incremental tax on growth rather than a fixed tax on headcount, so it puts pressure on out-year valuations, not just upfront cash flow.

If you live hundreds of miles away the tech companies may have no impact on your rental or purchase price, but you can't really control the algorithms or the ecosystem.

All you can really control is your mindset & ensuring you have optionality baked into your business model.

• If you are debt-levered you have little to no optionality. Savings give you optionality. Savings allow you to run at a loss for a period of time while also investing in improving your site and perhaps having a few other sites in other markets.
• If you operate a single website that is heavily reliant on a third party for distribution then you have little to no optionality. If you have multiple projects that enables you to shift your attention toward working on whatever is going up and to the right while letting anything that is failing pass time without becoming overly reliant on something you can't change. This is why it often makes sense for a brand merchant to operate their own ecommerce website even if 90% of their sales come from Amazon. It gives you optionality should the tech monopoly become abusive or otherwise harm you (even if the intent was benign rather than outright misanthropic).

As the update ensues Google will collect more data with how users interact with the result set & determine how to weight different signals, along with re-scoring sites that recovered based on the new engagement data.

Recently a Bing engineer named Frédéric Dubut described how they score relevancy signals used in updates

As early as 2005, we used neural networks to power our search engine and you can still find rare pictures of Satya Nadella, VP of Search and Advertising at the time, showcasing our web ranking advances. ... The “training” process of a machine learning model is generally iterative (and all automated). At each step, the model is tweaking the weight of each feature in the direction where it expects to decrease the error the most. After each step, the algorithm remeasures the rating of all the SERPs (based on the known URL/query pair ratings) to evaluate how it’s doing. Rinse and repeat.

That same process is ongoing with Google now & in the coming weeks there'll be the next phase of the current update.

So far it looks like some quality-based re-scoring was done & some sites which were overly reliant on anchor text got clipped. On the back end of the update there'll be another quality-based re-scoring, but the sites that were hit for excessive manipulation of anchor text via link building efforts will likely remain penalized for a good chunk of time.

Update: It appears a major reverberation of this update occurred on April 7th. From early analysis, Google is mixing in showing results for related midtail concepts on a core industry search term & they are also in some cases pushing more aggressively on doing internal site-level searches to rank a more relevant internal page for a query where they homepage might have ranked in the past.

On Friday Google's Gary Illyes announced Penguin 4.0 was now live.

Key points highlighted in their post are:

• Penguin is a part of their core ranking algorithm
• Penguin is now real-time, rather than something which periodically refreshes
• Penguin has shifted from being a sitewide negative ranking factor to a more granular factor

Things not mentioned in the post

• if it has been tested extensively over the past month
• if the algorithm is just now rolling out or if it is already done rolling out
• if the launch of a new version of Penguin rolled into the core ranking algorithm means old sites hit by the older versions of Penguin have recovered or will recover anytime soon

Since the update was announced, the search results have become more stable.

No signs of major SERP movement yesterday - the two days since Penguin started rolling out have been quieter than most of September.— Dr. Pete Meyers (@dr_pete) September 24, 2016

They still may be testing out fine tuning the filters a bit...

Fyi they're still split testing at least 3 different sets of results. I assume they're trying to determine how tight to set the filters.— SEOwner (@tehseowner) September 24, 2016

...but what exists now is likely to be what sticks for an extended period of time.

Penguin Algorithm Update History

• Penguin 1: April 24, 2012
• Penguin 2: May 26, 2012
• Penguin 3: October 5, 2012
• Penguin 4: May 22, 2013 (AKA: Penguin 2.0)
• Penguin 5: October 4, 2013 (AKA Penguin 2.1)
• Penguin 6: rolling update which began on October 17, 2014 (AKA Penguin 3.0)
• Penguin 7: September 23, 2016 (AKA Penguin 4.0)

Now that Penguin is baked into Google's core ranking algorithms, no more Penguin updates will be announced. Panda updates stopped being announced last year. Instead we now get unnamed "quality" updates.

Volatility Over the Long Holiday Weekend

Earlier in the month many SEOs saw significant volatility in the search results, beginning ahead of Labor Day weekend with a local search update. The algorithm update observations were dismissed as normal fluctuations in spite of the search results being more volatile than they have been in over 4 years.

There are many reasons for search engineers to want to roll out algorithm updates (or at least test new algorithms) before a long holiday weekend:

• no media coverage: few journalists on the job & a lack of expectation that the PR team will answer any questions. no official word beyond rumors from self-promotional marketers = no story
• many SEOs outside of work: few are watching as the algorithms tip their cards.
• declining search volumes: long holiday weekends generally have less search volume associated with them. Thus anyone who is aggressively investing in SEO may wonder if their site was hit, even if it wasn't.
  The communications conflicts this causes between in-house SEOs and their bosses, as well as between SEO companies and their clients both makes the job of the SEO more miserable and makes the client more likely to pull back on investment, while ensuring the SEO has family issues back home as work ruins their vacation.
• fresh users: as people travel their search usage changes, thus they have fresh sets of eyes & are doing somewhat different types of searches. This in turn makes their search usage data more dynamic and useful as a feedback mechanism on any changes made to the underlying search relevancy algorithm or search result interface.

Algo Flux Testing Tools

Just about any of the algorithm volatility tools showed far more significant shift earlier in this month than over the past few days.

Take your pick: Mozcast, RankRanger, SERPmetrics, Algaroo, Ayima Pulse, AWR, Accuranker, SERP Watch & the results came out something like this graph from Rank Ranger:

One issue with looking at any of the indexes is the rank shifts tend to be far more dramatic as you move away from the top 3 or 4 search results, so the algorithm volatility scores are much higher than the actual shifts in search traffic (the least volatile rankings are also the ones with the most usage data & ranking signals associated with them, so the top results for those terms tend to be quite stable outside of verticals like news).

You can use AWR's flux tracker to see how volatility is higher across the top 20 or top 50 results than it is across the top 10 results.

Example Ranking Shifts

I shut down our membership site in April & spend most of my time reading books & news to figure out what's next after search, but a couple legacy clients I am winding down working with still have me tracking a few keywords & one of the terms saw a lot of smaller sites (in terms of brand awareness) repeatedly slide and recover over the past month.

Notice how a number of sites would spike down on the same day & then back up. And then the pattern would repeat.

As a comparison, here is that chart over the past 3 months.

Notice the big ranking moves which became common over the past month were not common the 2 months prior.

Negative SEO Was Real

There is a weird sect of alleged SEOs which believes Google is omniscient, algorithmic false positives are largely a myth, AND negative SEO was never a real thing.

As it turns out, negative SEO was real, which likely played a part in Google taking years to roll out this Penguin update AND changing how they process Penguin from a sitewide negative factor to something more granular.

@randfish Incredibly important point is the devaluing of links & not "penalization". That's huge. Knocks negative SEO out. @dannysullivan— Glenn Gabe (@glenngabe) September 23, 2016

Update != Penalty Recovery

Part of the reason many people think there was no Penguin update or responded to the update with "that's it?" is because few sites which were hit in the past recovered relative to the number of sites which ranked well until recently just got clipped by this algorithm update.

When Google updates algorithms or refreshes data it does not mean sites which were previously penalized will immediately rank again.

Some penalties (absent direct Google investment or nasty public relations blowback for Google) require a set amount of time to pass before recovery is even possible.

Google has no incentive to allow a broad-based set of penalty recoveries on the same day they announce a new "better than ever" spam fighting algorithm.

They'll let some time base before the penalized sites can recover.

Further, many of the sites which were hit years ago & remain penalized have been so defunded for so long that they've accumulated other penalties due to things like tightening anchor text filters, poor user experience metrics, ad heavy layouts, link rot & neglect.

What to do?

So here are some of the obvious algorithmic holes left by the new Penguin approach...

• only kidding
• not sure that would even be a valid mindset in the current market
• hell, the whole ecosystem is built on quicksand

The trite advice is to make quality content, focus on the user, and build a strong brand.

But you can do all of those well enough that you change the political landscape yet still lose money.

“Mother Jones published groundbreaking story on prisons that contributed to change in govt policy. Cost $350k & generated $5k in ad revenue”— SEA☔☔LE SEO (@searchsleuth998) August 22, 2016

Google & Facebook are in a cold war, competing to see who can kill the open web faster, using each other as justification for their own predation.

Even some of the top brands in big money verticals which were known as the canonical examples of SEO success stories are seeing revenue hits and getting squeezed out of the search ecosystem.

And that is without getting hit by a penalty.

It is getting harder to win in search period.

And it is getting almost impossible to win in search by focusing on search as an isolated channel.

I never understood mentality behind Penguin "recovery" people. The spam links ranked you, why do you expect to recover once they're removed?— SEOwner (@tehseowner) September 25, 2016

Efforts and investments in chasing the algorithms in isolation are getting less viable by the day.

Obviously removing them may get you out of algorithm, but then you'll only have enough power to rank where you started before spam links.— SEOwner (@tehseowner) September 25, 2016

Anyone operating at scale chasing SEO with automation is likely to step into a trap.

When it happens, that player better have some serious savings or some non-Google revenues, because even with "instant" algorithm updates you can go months or years on reduced revenues waiting for an update.

And if the bulk of your marketing spend while penalized is spent on undoing past marketing spend (rather than building awareness in other channels outside of search) you can almost guarantee that business is dead.

"If you want to stop spam, the most straight forward way to do it is to deny people money because they care about the money and that should be their end goal. But if you really want to stop spam, it is a little bit mean, but what you want to do, is break their spirits." - Matt Cutts

Inorganic SERPs

A few weeks back Google introduced literally organic-free search results on mobile devices in the travel vertical. Google is now deepening that organic-free offering, announcing their new mobile travel guides would launch in 201 cities.

If you live outside of the United States it can be hard to appreciate just how ad heavy some of Google's search results have become in key ad categories.

Plenty of Room in Hotel California

When Google rolled out the 4 AdWords ads above the organic results layout they mentioned it would mostly appear on highly commercial search terms like New York Hotels. Hotels are one of the most profitable keyword themes, because:

• the searches tend to be fairly late funnel
• the transactions are for hundreds of dollars
• OTAs and other intermediaries often get somewhere between 10% to 30% of the transaction

Google search results for hotels not only contain 4 AdWords ads, but they also have price ads on the "organic" local listings. That gives Google a second bite at the apple on monetizing the user.

Click on any of those prices and you get sent to a beautiful(ly ugly) ad heavy click circus page like the following.

As Google has displaced those sorts of markets, portals like Yahoo! have announced the shutdown of some of their vertical offerings:

today we will begin phasing out the following Digital Magazines: Yahoo Food, Yahoo Health, Yahoo Parenting, Yahoo Makers, Yahoo Travel, Yahoo Autos and Yahoo Real Estate.

Direct Marketing Budgets vs Brand Ad Budgets

Google recently had another vertical search program which paralleled their hotel offering which focused on finance. It allowed users to compare things like credit cards, home loans, auto insurance policies, and other financial offers. They acquired BeatThatQuote, hard coded aggressive placements for themselves near the top of the search results, increased the size of these custom ad units - and then killed them off.

Why would Google invest hundreds of millions of Dollars in vertical search only to kill the offering?

It turns out the offering was too efficient from an advertiser perspective, so it didn't drive enough yield for Google.

If it is a lead-based product the ad rates are set by rational lead values. There is no brand manager insisting on paying $120 a click because "we HAVE TO be #1 in Google for auto insurance."

If Google does lead generation and sells the lead off exclusively they get paid precisely once for the consumer. Whereas if Google scrubs many aggregators from the market & allows searchers to click on one brand at a time they get to monetize the user many times over and take advantage of any irrational bidders in the ecosystem.

As long as Google is monetizing brand advertising budgets they can insert many layers of fat into the ad stack.

(Really broad broad match, enhanced campaigns, fat-thumb mobile clicks, mobile app clicks, re-targeted ads for products which were already purchased, endless auto-play YouTube video streams with ads in them, etc.)

Riding the Google Waves

Google's vertical ad offerings may come and go, the biases behind the relevancy algorithms may shift, and the ecosystem constantly has some number false positives. As search engines test out various features & shift their editorial policies some companies get disrupted and are forced to change their business models, while other companies get disrupted and outright disappear.

Google's move into auto insurance might have been part of the reason Bankrate decided to exit the business. But Google exiting the Google Compare business and adding a 4th text AdWords ad slot above the organic search results a few days before Bankrate reported results caused BankRate's stock to slide by as much as 47%.

Brand Building to Lower Risk

Part of the SEO value of building a brand is the strength of the brand awareness helps you rank better across whatever portion of the search ecosystem Google has not yet eaten, while lowering your risk of becoming a false positive statistic. Branded-related searches should (in theory) also provide some baseline level of demand which insulates against ranking shifts on other keywords. And having a brand name rather than a generic business name allows one to go from one market to the next.

Just be Apple...

Computers.com won't magically morph into MP3player.com then CellPhone.com then Tablet.com then Watch.com, but Apple was able to move from one market to the next with ease due to consumer familiarity and loyalty toward their brand.

Investing in building brand awareness is often quite expensive & typically requires many years of losses to eventually see positive returns. Trends come and go, and with them so do associated brands.

Heavily invest in the wrong trend & die.

Wait too long to invest in an important trend & die.

Few companies are able to succeed in field after field after field.

For every Apple-like example, there are dozens of losers. Look at how many computer companies shifted to an emphasis on higher margin laptops, then sold off their laptop divisions for almost nothing and chased cell phones for growth. While they outsourced everything and relied on a faux open source software provider they guaranteed their own death. Look at how some of the mobile companies are valued at almost nothing, or those that have been bought & gutted like Motorola or Nokia. There are only 3 somewhat strong mobile manufacturers:

• Apple - the source of the original iPhone which Google worked so hard to copy
• Samsung - the company which has remained profitable enough that Google publishes opposition research against them in spite of being a Google partner
• Xiaomi - a priced-to-perfection startup in the Chinese market where Google has been prohibited from competing in

Adding Apple management to another company does not guarantee success.

The Financial Crisis & Brand

When the financial crisis happened about 8 years ago Google saw both their revenue growth rate and their stock price crash. Direct marketers receded with the consumer, but many pre-approved brand ad campaigns continued to run. Google's preferred custom shifted away from direct marketers toward large global brands.

When the economy started to recover, Google was quick to ban 30,000 affiliates from the AdWords auction.

When Trends Take Off

As trends become obvious & companies succeed wildly, competitors chase them.

The tricky part is the perception of success & lasting success are not one and the same.

Remember when Demand Media was allegedly profitable as hell? That was sales material for the pump-n-dump IPO & their stock has only corrected about 99% since then.

Since dumping that profitable as hell company on the public they've only had to invest in removing about 2.4 million articles from eHow.

The site is still torched by the Panda algorithm.

And they are still losing money. ;)

Companies like Mahalo which chased eHow also washed up on the rocks. They've since pivoted to YouTube, to mobile apps, to email & perhaps should re-brand to Pivot, Inc.

Groupon was another surefire trend. They're off about 84% from their peak & most the Groupon clones have went under, while Groupon has divested of most of their acquisition-driven international expansion. Numerous other coupon & flash sale sites which haven't yet went under laid off many people and are off significantly from their peaks or were sold for a song.

Trends come and go. Baseball cards are largely a thing of the past. So are Pet Rocks, Cabbage Patch Kids, and Beanie Babies.

Perhaps soon independent single author blogs and SEO-driven publishing business models will be added to the list. ;)

Copycats & Trademark Infringement

Some brands have a strong staying power. But even if those brands are highly valued, they still face competition from knock offs.

If you shop at big box stores in the United States you may have no awareness of the following product.

Look a bit closer at that image & you'll see it wasn't LEGO, but rather LEBQ.

Sales for Le Bao Quan are not sales for the core LEGO brand, the consumer gets acclimated to an artificially low price point, and imagine what sort of a traumatic impact it might have for a child if their first LEGO-like toy looks like a pig fresh from the butcher's shop.

The key difference between that sort of stuff and gray areas monetized by the big online platforms is you may have to go to third world to find the sketchy physical products in the real world; whereas the big online platforms all have some number of sketchy globally accessible offers at any point in time. Here are just a few examples:

• Alibaba, generally
• eBay banning a whistleblower who highlighted counterfeit goods
• dangerous weapons on Amazon.co.uk
• Google pushing ads for illegal steroids, sketchy fake locksmiths, & fake product support services with trademark terms in the ad headlines

Monetizing Brand (Retailer)

At the core, all these platform plays are both brands unto themselves & places where third party brands get monetized.

The start up costs to have leverage to work with brands in an official partnership can be quite significant. Just look at how much Jet.com has raised and how much hustle they've used to get in the game, even with their massive burn rate.

Part of why Apple has such strong margins is their brand is so strong they can dictate terms and control the supply chain. Others are willing to give them the majority of the profits because carrying them completes the catalog and helps the retailers sell other, weaker goods where the retailers have higher profit margins.

And even then, when you get outside their core products, there are listings for fake OEM Apple stuff all over the web.

Luckily when fake products use spammy titles on Amazon the reviewers will quickly highlight if they are of inferior quality. But if they look authentic & work, it can be hard for the brands to know unless they proactively track everything. And as that demand gets filled, if there is a negative experience it may lead to customer complaints about the brand, whereas if there are no complaints & the product works it still leaves less money for the brand which is being arbitraged.

"The Internet doesn't change everything. It doesn't change supply and demand." - Andy Grove

Other players with weaker brands and a roll reversal on who needs who can quickly find themselves in a pickle.

Monetizing Brand (Financeer)

Some companies die slowly, as accountants drive strategy & they outsource their key points of differentiation and become unremarkable. When Yahoo! turned their verticals into thin "me too" outsourced plays they made it easy for Google to offer something of a similar quality, which in turn left the Yahoo! vertical properties without much distribution.

As Yahoo! struggles, some investors want to buy the core Yahoo! business so Yahoo! can exit the web business while being a holding company for Alibaba and Yahoo! Japan stock.

In an age of declining interest rates, zero interest rates (or even negative rate) policies some investors look to buy brands, streamline operations (mass firings & outsourcing), lever them up on debt & then sell them back off. Some companies like Burger King have cycled through public and private ownership multiple times.

Brands can be purchased just like links. Everything has a price and a value which shifts with the market.

Good to great to gone.

Monetizing Brand (Affiliate)

Some retailers have symbiotic relations with brands they sell, while other platforms may compete more aggressively with those whose products they sell. The same is true with affiliates. Affiliates can genuinely add value & drive new distribution for brands, or they can engage in lower value arbitrage, where they push the brand to pay for what was already owned by it through shady techniques like cookie stuffing.

One of the most one-sided and biased hate-filled perspectives I've ever seen about affiliates is Lori Weiman's guest columns at Search Engine Land.

Just the same, some merchants treat affiliates honestly and fairly, while other merchants have a pattern of scamming their affiliates through lead shaving, adjusting revenue share without telling the affiliates, and a host of other sketchy behaviors.

Monetizing Brand (Search Engine)

Search engines allow competitors or resellers to bid on branded keywords, which creates an auction bidding environment for many branded terms. Typically Google offers the official site / brand clicks at a significant discount for these terms in order to encourage them to compete in the ad marketplace & to help shift some of the organic click mix over to paid clicks.

Google has also tried a number of other initiatives to boost their monetization of branded keywords. A partial list of such efforts includes:

• increasing the CPCs charged on branded terms, particularly when ad extensions are enabled
• a test of banner ads from brands which were merged with organic listings (though this effort was quickly dumped due to lack of driving revenues as it didn't allow for auction dynamics to drive prices upward - similar to the reason Google Advisor was shut down)
• shifting branded traffic streams through to product listing ads
• displacing organic results with more ads on mobile devices & preferring house listings for vertical search efforts like local to drive the organic results below the fold
• adding other distracting eye candy to mobile results including the knowledge graph and "also searched for" links pointing at competing businesses
• allowing syndicated search partners to use harder to notice ad labeling
• allowing syndicated search partners to use more ads above their organic search results

Sophisticated vs Unsophisticated SEM

Many poorly managed AdWords accounts managed by large ad agency ultimately end up far more damaging to brands than the efforts from "shady" affiliates. The set up (which is far more common than most would care to believe) revolves around the ad agency arbitraging the client's existing brand, falsely claiming the revenue generated by that spend to be completely incremental & then get a percent of spend management fee on that spend. The phantom profits which are generated from those efforts are further applied to bidding irrationally high on other terms, to once again pick up more percent of spend management fees.

Savvy search marketers separate the value of traffic from branded and unbranded terms to take a more accurate view of the interaction between investments in paid search and organic search.

Both eBay and Google have done studies on the incrementality of paid search clicks.

eBay being a large brand found they didn't see much incrementality [PDF]. Search Google for eBay and they won't run AdWords ads. eBay still participates in product listing ads / shopping search for other products they carry.

Google (of course) found much more incrementality with paid search ads. While they conducted their internal study and suggested it would be too hard or expensive for most advertisers to conduct such a study, they also failed to mention that the reason it would be expensive for an advertiser to perform such a test is because Google intentionally & explicitly decided against offering those features inside the AdWords platform. It is the same reason Google shut down Google Advisor / Google Compare - offering it doesn't provide Google a guaranteed positive yield when compared against not offering it.

One thing Google did note about seeing higher rates of incremental clicks in their study was when there was increased space between the listings there tended to be a higher rate of incremental ad clicks. This is part of why we see AdWords ads getting larger with more extensions & there being so many features in mobile which push the organic results below the fold.

The same Lori Weiman who hates affiliates is currently running (literally) an 8-part series on why you should bid on your brand keywords.

If anyone other than a search engine monetizes brand that might be bad, but if the search engines do it then going along with the game is always the right call.

Owning the Supply Chain

"The true victory (the true 'negation of the negation') occurs when the enemy talks your language." - Slavoj Zizek

The opposite is also true. If you are a brand who is being dictionary attacked by an ad network, the brand quickly shifts from an asset to a liability.

"The only thing that I'd rather own than Windows is English, because then I could charge you two hundred and forty-nine dollars for the right to speak it." - Scott McNealy

Google owns English and Spanish and German and ...

Canon is pushed below the fold for their own brand query -- pic.twitter.com/Rx303fqn8d— Dr. Pete Meyers (@dr_pete) March 7, 2016

Is your control over the supply chain strong enough that you can afford to be below the fold for your own brand?

While you think about that, other pieces of the supply chain are merging in key verticals to better combat the strength of search ad networks.

• Expedia, Travelocity & Orbitz
• Zillow & Trulia
• Staples, OfficeMax & OfficeDepot

How much are you willing to pay Google for each click for a brand you already own?

When does that stop being worth it?

During the next recession many advertisers will find out.

Added: Within days of writing the above post Google was once again found running ads promoting phishing campaigns, even though the ads arbitrage Google's branded keyword terms.

@dr_pete See the first result. They are phishing information. This people are crazy! what you think? pic.twitter.com/DAIh31aQpV— Hiren vaghela (@Hirendream) March 17, 2016

Apparently that issue isn't something new either.

@Hirendream @aaronwall @dr_pete Reported phishing in Adwords on this term to Google about one year ago...— C Byrne (@SEOTipsnTricks) March 18, 2016

Back in 2009 Google executives were scared of not being able to retain talent with stock options after Google's stock price cratered with the rest of the market & Google's ad revenue growth rate slid to zero. That led them to reprice employee stock options. That is as close as Google has come to a "near death" experience since their IPO. They've consistently grown & become more dominant.

In November of 2009 I cringed when I saw the future of SEO in Google SERPs where the organic results were outright displaced & even some of the featured map listings had their phone numbers removed.

Investing in Search

In 2012 a Googler named Jon Rockway was more candid than Googlers are typically known for being: "SEO isn't good for users or the Internet at large. ... It's a bug that you could rank highly in Google without buying ads, and Google is trying to fix the bug."

It isn't surprising Google greatly devalued keyword domain names & hit sites like eHow hard. And it isn't surprising Demand Media is laying off staff and is rumored to be exploring selling their sites. If deleting millions of articles from eHow doesn't drive a recovery, how much money can they lose on the rehab project before they should just let it go?

Breaking spirits works!

"If you want to stop spam, the most straight forward way to do it is to deny people money because they care about the money and that should be their end goal. But if you really want to stop spam, it is a little bit mean, but what you want to do, is break their spirits." - Matt Cutts

Through a constant ex-post-facto redefinition of "what is spam" to include most anything which is profitable, predictable & accessible, Google engineers work hard to "deny people money."

Over time SEO became harder & less predictable. The exception being Google investments like Thumbtack, in which case other's headwind became your tailwind & a list of techniques declared off limits became a strategy guidebook.

Communications got worse, Google stopped even pretending to help the ecosystem, and they went so far as claiming that even asking for a link was spam. All the while, as they were curbing third party investment into the ecosystem ("deny them money"), they work on PR for their various investments & renamed the company from Google to Alphabet so they can expand their scope of investments.

"We also like that it means alpha‑bet (Alpha is investment return above benchmark), which we strive for!" - Larry Page

From Do/Know/Go to Scrape/Displace/Monetize

It takes a lot of effort & most people are probably too lazy to do it, but if you look at the arch of Google's patents related to search quality, many of the early ones revolved around links. Then many focused on engagement related signals. Chrome & Android changed the pool of signals Google had access to. Things like Project Fi, Gogle Fiber, Nest, and Google's new OnHub router give them more of that juicy user data. Many of their recently approved patents revolve around expanding the knowledge graph so that they may outright displace the idea of having a neutral third party result set for an increasing share of the overall search pie.

Searchers can instead get bits of "knowledge" dressed in various flavors of ads.

This sort of displacement is having a significant impact on a variety of sites. But for most it is a slow bleed rather than an overnight sudden shift. In that sort of environment, even volunteer run sites will eventually atrophy. They will have fewer new users, and as some of the senior people leave, eventually fewer will rise through the ranks. Or perhaps a greater share of the overall ranks will be driven by money.

Jimmy Wales stated: “It is also false that ‘Wikipedia thrives on clicks,’ at least as compared to ad-revenue driven sites… The relationship between ‘clicks’ and the things we care about: community health and encyclopedia quality is not nothing, but it’s not as direct as some think.”

Most likely the relationship *is* quite direct, but there is a lagging impact. Today's major editors didn't join the site yesterday & take time to rise through the ranks.

As the big sites become more closed off the independent voices are pushed aside or outright disappear.

If Google works hard enough at prioritizing "deny people money" as a primary goal, then they will eventually get an index quality that reflects that lack of payment. Plenty of good looking & well-formatted content, but a mix of content which:

• is monetized indirectly & in ways which are not clearly disclosed
• has interstitial ads and slideshows where the ads look like the "next" button & the "next" button is colored the same color as the site's background
• is done as "me too" micro-reporting with no incremental analysis
• is algorithmically generated

Celebrating Search "Innovation"

There has been a general pattern in search innovation. Google introduces a new feature, pitches it as being the next big thing, gets people to adopt it, collects data on the impact of the feature, clamps down on selectively allowing it, perhaps removes the feature outright from organic search results, permanently adds the feature to their ad units.

This sort of pattern has happened so many times it is hard to count.

Google puts faces in search results for authorship & to promote Google+, Google realizes Google+ is a total loser & disconnects it, new ad units for local services show faces in the search results. What was distracting noise was removed, then it was re-introduced as part of an ad unit.

I'm confused didn't Google pull authorship cuz faces in the SERPS was a bad experience for the users? pic.twitter.com/mI2NdyGzd7— Michael Gray (@graywolf) July 31, 2015

The same sort of deal exists elsewhere. Google acquires YouTube, launches universal search, offers video snippets, increases size of video snippets. Then video snippets get removed from most listings "because noise." YouTube gets enlarged video snippets. And, after removing the "noise" of video stills in the search results Google is exploring testing video ads in the search results.

Some sites which bundle software got penalized in organic search and are not even allowed to buy AdWords ads. At an extreme degree, sites which bundled no software, but simply didn't link to an End User Agreement (EULA) from the download page were penalized. Which leads to uncomfortable conversations like this one:

Google Support: I looked through this, and it seemed that one of the issues was a lack of an End User Agreement (EULA)

Simtec: An EULA is displayed by the setup program before installing starts. Also, the end user license agreements are linked to from here http://www.httpwatch.com/buy/orderingfaq.aspx#licensetypes

Google Support: Hmm, They do want it on the download page itself

Simtec: How come there isn’t one here? google.co.uk/chrome/browser/desktop/

Google Support: LOL

Simtec: No really?

Google Support: That’s a great question

Of course, it goes without saying that much of the Google Chrome install base came from negative option software bundling on Adobe Flash security updates.

Google claimed helpful hotel affiliate sites should be rated as spam, then they put their own affiliate ads in hotel search results & even recommended hotel searches in the knowledge graph on city name searches.

Google created a penalty for sites which have an ad heavy interface. Many of Google's search results are nothing but ads for the entire first screen.

Google search engineers have recently started complaining about interstitial ads & suggested they might create a "relevancy" signal based on users not liking those. At the same time, an increasing number of YouTube videos have unskippable pre-roll ads. And the volume of YouTube ad views is so large that it is heavily driving down Google's aggregate ad click price. On top of this, Google also offers a survey tool which publishers can lock content behind & requires users to answer a question before they can see the full article they just saw ranking in the search results.

"Everything is possible, but nothing is real." - Living Colour

Blue Ocean Opportunity

Amid the growing ecosystem instability & increasing hypocrisy, there have perhaps been only a couple "blue ocean" areas left in organic search: local search & brand.

And it appears Google might be well on their way in trying to take those away.

For years brand has been the solution to almost any SEO problem.

I wonder how many SEOs working for big brands have done absolutely nothing of value since 2012 yet still look like geniuses to executives.— Ross Hudgens (@RossHudgens) August 7, 2015

But Google has been increasing the cost of owning a brand. They are testing other ad formats to drive branded search clicks through more expensive ad formats like PLAs & they have been drastically increasing brand CPCs on text ads. And while that second topic has recently gained broader awareness, it has been a trend for years now: "Over the last 12 months, Brand CPCs on Google have increased 80%" - George Michie, July 30, 2013.

There are other subtle ways Google has attacked brand, including:

• penalties on many of the affiliates of those brands
• launching their own vertical search ad offerings in key big-money verticals
• investing billions in "disruptive" start ups which are exempt from the algorithmic risks other players must deal with
• allowing competitors to target competing brands not only within the search results, but also as custom affinity audiences
• linking to competing businesses in the knowledge graph

Google has recently dialed up monetization of local search quite aggressively as well. I've long highlighted how mobile search results are ad heavy & have grown increasingly so over time. Google has recently announced call only ad formats, a buy button for mobile ads, local service provider ads, appointment scheduling in the SERPs, direct hotel booking, etc.

And, in addition to all the above new ad formats, recently it was noticed Google is now showing 3 ads on mobile devices even for terms without much commercial intent, like [craft beer].

I like how this new-ish search box takes up a ton of space and puts all these ads right in the prime viewing area pic.twitter.com/CcYdW118gf— Jared McKiernan (@jaredmckiernan) August 18, 2015

Now that the mobile search interface is literally nothing but ads above the fold, early data shows a significant increase in mobile ad clicks. Of course it doesn't matter if there are 2 or 3 ads, if Google shows ad extensions on SERPs with only 2 ads to ensure they drive the organic results "out of sight, out of mind."

Earlier this month it was also noticed Google replaced 7-pack local results with 3-pack local results for many more search queries, even on desktop search results. On some of these results they only show a call button, on others they show links to sites. It is a stark contrast to the vast array of arbitrary (and even automated) ad extensions in AdWords.

Why would they determine users want to see links to the websites & the phone numbers, then decide overnight users don't want those?

Why would Google determine for many years that 7 is a good number of results to show, and then overnight shift to showing 3?

If Google listed 7 ads in a row people might notice the absurdity of it and complain. But if Google only shows 3 results, then they can quickly convert it into an ad unit with little blowback.

You don't have to be a country music fan to know the Austin SEO limits in a search result where the local results are now payola.

Try not to hurt your back while looking down for the organic search results!

Here are two tips to ensure any SEO success isn't ethereal: don't be nearby, and don't be a business. :D