New Google Maps, Yahoo! & RackSpace, About.com for Sale

Feb 8th

Google Maps:
New version out. Danny Sullivan has more on the offering.

RackSpace:
May not play well with Yahoo!

About.com for Sale:
Bidding ends today. Price between $350 to $500 million. Bidders: Google, Yahoo!, Ask Jeeves, AOL & New York Times.

Google Semantically Related Words & Latent Semantic Indexing Technology

Feb 4th

Many people have been noticing a wide shuffle in search relevancy scores recently. Some of those well in the know attribute this to latent semantic indexing. Even if they are not using LSI, Google has likely been using other word relationship technologies for a while, but recently increased its weighting. How Does Latent Semantic Indexing Work?
Latent semantic indexing allows a search engine to determine what a page is about outside of specifically matching search query text.

A page about Apple computers will likely naturally have terms such as iMac or iPod on it.

Latent semantic indexing adds an important step to the document indexing process. In addition to recording which keywords a document contains, the method examines the document collection as a whole, to see which other documents contain some of those same words. LSI considers documents that have many words in common to be semantically close, and ones with few words in common to be semantically distant. This simple method correlates surprisingly well with how a human being, looking at content, might classify a document collection. Although the LSI algorithm doesn't understand anything about what the words mean, the patterns it notices can make it seem astonishingly intelligent. source

By placing additional weight on related words in content, or words in similar positions in other related documents, LSI has a net effect of lowering the value of pages which only match the specific term and do not back it up with related terms.

LSI vs Semantically Related Words:
After being roasted by a few IR students and scientists I realized that many SEOs (like me) blended the concepts of semantically related words with latent semantic indexing, and due to constraints of the web it is highly unlikely that large scale search engines are using LSI on their main search indexes.

Nonetheless, it is overtly obvious to anyone who studies search relevancy algorithms by watching the results and ranking pages that the following are true for Google:

  • search engines such as Google do try to figure out phrase relationships when processing queries, improving the rankings of pages with related phrases even if those pages are not focused on the target term

  • pages that are too focused on one phrase tend to rank worse than one would expect (sometimes even being filtered out for what some SEOs call being over-optimized)
  • pages that are focused on a wider net of related keywords tend to have more stable rankings for the core keyword and rank for a wider net of keywords

Given the above, here are tips to help increase your page relevancy scores and make your rankings far more stable...

Mix Your Anchor Text!
Latent semantic indexing (or similar technologies) can also be used to look at the link profile of your website. If all your links are heavy in a few particular phrases and light on other similar phrases then your site may not rank as well.

Example Related Terms:
Many of my links to this site say "SEO Book" but I also used various other anchor text combinations to make the linkage data appear less manipulative.

Instead of using SEO in all the links some of them may use phrases like
search engine optimization
search engine marketing
search engine placement
search engine positioning
search engine promotion
search engine ranking
etc.

Instead of using book in all the links some other good common words might be
ebook
manual
guide
tips
report
tutorial
etc.

How do I Know What Words are Related?
There are a variety of options to know what words are related to one another.

  • Search Google for search results with related terms using a ~. For example, Google Search: ~seo will return pages with terms matching or related to seo and will highlight some of the related words in the search results.

  • Use a lexical database
  • Look at variations of keywords suggested by various keyword suggestion tools.
  • write a page and use the Google AdSense sandbox to see what type of ads they would try to deliver to that page.
  • Read the page copy and analyze the backlinks of high ranking pages.

Google Sandbox and Semantic Relationships:
The concept of "Google Sandbox" has become synonymous with "the damn thing won't rank" or whatever. The Sandbox idea is based upon sites with inadequate perceived trust taking longer to rank well.

Understanding the semantic relationships of words is just another piece of the relevancy algorithms, though many sites will significantly shift in rankings due to it. The Google sandbox theory typically has more to do with people getting the wrong kinds of links or not getting enough links than it does with semantic relationships. Some sites and pages are hurt though by being too focused on a particular keyword or phrase.

Where do I learn more about Latent Semantic Indexing?
A while ago I read Patterns in Unstructured Data and found it was wrote in a rather plain english easy to understand manner.

Brian Turner also listed a good number of research papers in this thread.

Forum Coverage:

Selected Forum Quotes:
BakedJake

I'm not about to go post my research and examples on a public forum. But, I'll warn you now - if you're not varying your anchor text, and you're not writing pages synonymous with your term that don't contain the term you're targetting, you're going to be in a world of hurt within the next 90 days.

We've been tracking this update for the last 6 months. I was surprised to see it happen now - I honestly didn't expect it until next month or March, but it's here.

BakedJake

I have a page about "baby clothes". I link to my site 100 times with the anchor text "baby clothes"

I now pull out the words "baby clothes" and all the links pointing to my site with the words "baby clothes"

Do I still have footing to rank for that term "baby clothes" after you've run some sort of semantic analysis on it?

That's my simplistic explanation. I think they're doing something very similar, but taking links into account like that and maybe even devaluing some links on the "main" term...

valeyard

Well, if it hasn't changed by Monday I'm going out to buy a black hat.

If irrelevant junk is what Google wants then irrelevant junk is what it's gonna get. :-(

dataguy

Man I'm glad I diversified my sites. I think I will work on diverifying some more...

andy_boyd

Google Inc. is all about money. And IMHO ... so are Yahoo Inc. and Microsft Corp.. As webmasters we are the people who build sites and depend on these money hungry companies, who at the heels of the hunt, put their interests miles ahead of ours.

Chico_Loco

My main concern with this new update is that if you search for my brand name (and there are quite a few that do based on referrals), then right now my site does not even rank. Our brand name is perhaps the best in my industry, and Google are, in my opinion, diluting my brand name and causing my company money. The first result for my brand name is a spammy page which is a "scraper site" which is actually SERP's page from somewhere - so that's basically useless.

The Hidden or Not so Hidden Messages:

  • If you are entirely dependant on any single network and a single site for the bulk of your income then you are taking a big risk. Most webmasters would be best off to have at least a couple of income streams to shield themselves from algorithm changes.

  • If you are new to SEO you are best off optimizing your site for MSN and Yahoo! off the start and then hoping to later rank well in Google.
  • Make sure you mix your anchor text to minimize your risk profile. Even if you are generally just using your site name as your anchor text eventually that too can hurt you.
  • Search algorithms and SEO will continue to get more complicated. But that makes for many fun posts ;)

Update: a few additional tools recommended in our comments and the comments at ThreadWatch

Google AdWords / AdSense Shakeup, Free Link Renting Guide, Ask Jeeves Blog

AdSense and AdWords shakeup:

found on ThreadWatch

SearchGuild birthday awards:
fun stuff

I was nominated but was beat out by Orion. a real shame that I do not know more about fractal spam and semantic co-occurance...

Free Link Renting Guide:
Patrick Gavin offers free link renting tips (PDF link)

Complacency:
Tim Converse (from Yahoo!) calls out Marissa Mayer (from Google). I am sure there are lots of fun dialogs between the various engines employees.

Ask Jeeves:
creates their obligitory blog.

When You Can't Rank for Your Own Name...

Feb 3rd

So I was looking for a site of a well known SEO in Google and he does not show up for his site name.

I remembered a few others that this happened to recently and spoke to a friend who has seen a bunch of this. It appears that this is a rather common occurance now, where sites that are aggressively improving their rankings stop showing up for their keyword and sometimes their site name.

I looked at some of the keywords for this site and some of the deep pages are ranking poorly for his primary terms in Google, but they are outranking the home page (which heavily targets those same terms and is absolutely burried). None of his pages rank for his site name.

I suppose this is a good way for Google to attack people selling competing advertising systems that manipulate their index. Rank them lowly for their keywords AND remove them from the index for their site name.

If people do not show up for their own name it hurts their brand. On the web AND off the web their entire brand is diminished by not showing up for their own name.

Then the only way these people can show up for their own name and brand is by buying in on AdWords, and if you have a strong brand that can become a competitive landscape and those costs can add up quick.

Pretty damn cool self regulating system if you are Google, but kinda sucky for joe average SEO company. :(

Google Referral Program & Google Karma

Feb 2nd

Google has launched an affiliate program.

  1. One of your visitors clicks on the graphic or link and is taken to a Google sign-up page.

  2. That person signs up for an AdWords account or applies to become an AdSense publisher.
  3. Advertisers qualify as completed referrals after they spend $20 with AdWords. Publishers qualify after they earn $75 in AdSense revenue.
  4. Every month, Google calculates the number of completed referrals you have directed to Google.
  5. Once you accrue $100 (five completed referrals) or more, you will receive a check. Google only issues checks once a month (for details, see the FAQ).

I already applied, but am uncertain as to how long it will take to be accepted. In 8 days I may also get to be a Google Advertising Professional.

Their stock is well over $200 and I got 50 free Gmail invites if anyone wants one just shoot me an email.

Google karma continues to brew... ;)
Google Karma.

Google Strong 4th Quarter, Yahoo! Japan Blogs, Australian SEM Conference

Google 4th Quarter:

Yahoo! Japan Blogs:
Yahoo Japan has beaten Yahoo to the blogosphere

Down Under:
Australian SEM Conference

DMOZ Post:
NickW finds Black Knight's what is wrong with DMOZ post ;)

Google AdWords API Beta

Google have launched their Google AdWords API. From their introduction page:

Google's free AdWords API service lets developers engineer computer programs that interact directly with the AdWords server. With the applications created, advertisers and third parties can more efficiently - and creatively - manage their large AdWords accounts and campaigns.

Flexible and Functional
What can you do with the AdWords API? This all depends on your programming genius and clients' advertising needs. Some possibilities might include:

  • Generating automatic keyword, ad text, URL, and custom reports

  • Integrating AdWords data with databases, such as inventory systems
  • Developing additional tools and applications to help you manage accounts

It works in many language and its quota limits will be based on the size and spend of your account. You need a My Client Center account to sign up. Here is some of their support questions.

coverage at

New AdSense Feature, Yahoo! Video Search, Peter Norvig Talks Semantics & Spam

Jan 25th

New AdSense Beta Feature:
change to ads about feature allows you to switch the ads to a different topic. example here: http://www.consumeraffairs.com/health/hearing/

Video Killed the Search Star:
in your mind and in your car. search for Yahoo! videos wherever you are...

wonder what effect that will have on the porn industry?

here is a cool video of Jobs introducing the Mac (looted from ThreadWatch)

Paid By Google:
Ben Goodger, Lead Engineer Mozilla Firefox

Spam: an Issue of Semantics:
Peter Norvig discusses semantic web ontologies

Google Offers Free Cross Platform Tracking System, Anil Dash Rants about SEOs

Jan 22nd

Google Tracking Cross Platforms:
Google offers up a free cross platform tracking system. You can track banner impressions, email campaigns, and other pay per click search accounts all from inside the Google AdWords system. Why do that?

  • by being first to market with a free tool they lock in mind share and build a user base

  • they get the valuable market data of knowing how their system competes with other ad systems...thus allowing them to further learn from other systems and make systems such as smart pricing as smart as they can be.
  • it further positions their product line as the default starting point for online marketing.
  • saves their advertisers money so they have more money to spend.
  • also build good karma points with many new marketers

Google understands that they more information they have the more they are worth, and that it does not hurt them to be branded as the one stop shop for targeted advertisements. You got to hand it to Google for making freely available something which others charge for. I have not yet tried it, but soon may :) link with more information requires login

Anil Dash: Voice of the Bloggers:
He rants about the Link Condom site going into the typical SEOs are scumbags speech, but Danny Sullivan drops in for a guest visit and sets him straight.

Go Danny!!!

ThreadWatch SEO Conference, Google Trademark Case in France, RubberStamped Listed in DMOZ, WikiPedia adopts NoFollow Tags, AdWor

Another SEO Conference:
Lots of good stuff at Threadwatch, including the announcement that ThreadWatch to have a free SEO conference end of May.

Google Loses Trademark Case in France:
A French court has ruled that Google must refrain from using the trademarks of European resort chain Le Meridian Hotels and Resorts to trigger keyword ads.

DMOZ Lists Directories: Rubber Stamped & WebAtlas...
Were both recently listed in DMOZ.

Peter D gets help from "the man" himself, and quickly finds that you can't be a successful person in the SEO space without having at least 1 hate thread from the fine folks at IHU.

In spite of Doug's whining to DMOZ Rubberstamped is still listed.

Stop the Spread of Viral Linkage Data:
Link Condom...the WikiPedia is one of the first sites to adopt the new policy :(

AdWords Changes to Come:
Google to Give AdWords API to Advertisers
Google is about to unveil a completely revamped Adwords/Adsense program to counter inroads from competitors such as Kanoodle

Pages






    Email Address
    Pick a Username
    Yes, please send me "7 Days to SEO Success" mini-course (a $57 value) for free.

    Learn More

    We value your privacy. We will not rent or sell your email address.