Apple Search

Google, Google, Google

For well over a decade Google has dominated search to where most stories in the search sphere were about Google or something on the periphery.

In 2019 Google generated $134.81 billion in ad revenues.

When Verizon bought core Yahoo three years ago the final purchase price was $4.48 billion. That amount was to own their finance vertical, news vertical, web portal, homepage, email & web search. It also included a variety of other services like Tumblr.

Part of what keeps Google so dominant in search is their brand awareness. That is also augmented by distribution as defaults in Chrome and Android. Then when it comes to buying search distribution from other players like Mozilla Firefox, Opera or Apple's Safari they can outbid everyone else as they are much better at monetizing tier 2 markets and emerging markets than other search companies are since they have such strong ad depth. Even if Bing gave a 100% revshare to Apple they still could not compete with Google in most markets in terms of search monetization.

Apple as a Huge Search Traffic Driver

In 2019 Google paid just under £1.2 billion in default payments for UK search traffic. Most of that went to Apple. Historically when Google broke out their search revenues by region typically the US was around 45% to 46% of search ad revenue & the UK was around 11% to 12%, so it is likely Google is spending north of $10 billion a year to be the default search provider on Apple devices:

Apple submitted that search engines do not pay Apple for the right to be set as the primary default search engine on its devices. However, our assessment is that Google does pay to be the primary default on Apple devices. The agreement between Google and Apple states that Google will be the default web search provider and the same agreement states that Google will pay Apple a specified share of search advertising revenues. We also note that Google does not pay compensation to any partners that set Google Search as a secondary option. This further suggests that Google’s payment to Apple is in return for Apple setting Google as the primary default.

Apple is glad to cash those checks & let Google handle the core algorithmic search function in the web browser, but Apple also auto-completes many searches from within the address bar via various features like website history, top hit, news, Siri suggested website, suggested sites, etc.

A Unique Voice in Search

The nice thing about Apple powering some of those search auto-complete results themselves is their results are not simply a re-hash of the Google search results so they can add a unique voice to the search marketplace where if your site isn't doing as well in Google it could still be promoted by Apple based on other factors.

High-traffic Shortcuts

Apple users generally have plenty of disposable personal income and a tendency to dispose of much of it, so if you are an Android user it is probably worth having an Apple device to see what they are recommending for core terms in your client's markets. If you want to see recommendations for a particular country you may need to have a specialized router targeted to that country or use a web proxy or VPN.

Most users likely conduct full search queries and click through to listings from the Google search result page, but over time the search autocomplete feature that recommends previously viewed websites and other sites likely picks up incremental share of voice.

A friend of mine from the UK runs a local site and the following shows how the Apple ecosystem drove nearly 2/3 of his website traffic.

His website is only a couple years old, so it doesn't get a ton of traffic from other sources yet. As of now his site does not have great Google rankings, but even if it did the boost by the Apple recommendations still provides a tailwind of free distribution and awareness (for however long it lasts).

For topics covered in news or repeat navigational searches Apple likely sends a lot of direct visits via their URL auto-completion features, but they do not use the feature broadly into the tail of search across other verticals, so it is a limited set of searches that ultimately benefit from the shortcuts.

Apple Search Ranking Factors

Apple recently updated their search page offering information about Applebot:

Apple Search may take the following into account when ranking web search results:

  • Aggregated user engagement with search results
  • Relevancy and matching of search terms to webpage topics and content
  • Number and quality of links from other pages on the web
  • User location based signals (approximate data)
  • Webpage design characteristics

Search results may use the above factors with no (pre-determined) importance of ranking. Users of Search are subject to the privacy policy in Siri Suggestions, Search & Privacy.

I have seen some country-code TLDs do well in their local markets in spite of not necessarily being associated with large brands. Sites which do not rank well in Google can still end up in the mix provided the user experience is clean, the site is useful and it is easy for Apple to associate the site with a related keyword.

Panda-like Quality Updates

Markets like news change every day as the news changes, but I think Apple also does some Panda-like updates roughly quarterly where they do a broad refresh of what they recommend generally. As part of those updates sites which were once recommended can end up seeing the recommendation go away (especially if user experience declined since the initial recommendation via an ad heavy layout or similar) while other sites that have good engagement metrics get recommended on related searches.

A friend had a website they sort of forgot that was recommended by Apple. That site saw a big jump on July 9, 2018 then it slid back in early August that year, likely after the testing data showed it wasn't as good as some other site Apple recommended. They noticed the spike in traffic & improved the site a bit. In early October it was widely recommended once again. That lasted until May of 2019 when it fell off a cliff once more. They had monetized the site with a somewhat spammy ad network & the recommendation mostly went away.

The recommendations happen as the person types and they may be different for searches where there is a space between keywords and the word is ran together. It is also worth noting Apple will typically recommend the www. version of a site over the m. version of a site for sites that offer both, so it makes sense to ensure if you used separate URLs that the www version also uses a responsive website design.

Indirect Impact on Google

While the Apple search shortcuts bypass Google search & thus do not create direct user signals to impact Google search, people who own an iPhone then search on a Windows computer at work or a Windows laptop at home might remember the site they liked from their iPhone and search for it once more, giving the site some awareness that could indirectly bleed over into impacting Google's search rankings.

Apple could also eventually roll out their own fully featured search engine.

Overcoming Webmaster Depression

This year is a rather easy year to be depressed. ;)

COVID-19, fearmongering media, polarized hyper-charged social media, mass unemployment, lockdowns that killed exercise routines and social connections, loss of hope / purpose / meaning, a guy who stuck a gun in the belly area of a pregnant woman overdosing on fentanyl shortly after he passed counterfeit currency, that broader background being utterly ignored so outrage could fuel widespread rioting with a man in dreadlocks kicking a man sitting in the street unconscious & other bonus random drive by shootings where actual heroes are murdered at random, cities being burned down, communist anarchy, social "justice" movements founded on the idiotic idea of improving society by ripping apart the family unit, etc.

This post is not a suicide letter, but an ode to reality of accepting today for what it is. :D

Last year was the first year where I managed an office with a bunch of employees in it. When the office opened my email inbox had under 2,000 emails built up in it over a 16 year period of working on the web. Far from inbox zero, I am now above 20,000. I think in a Bill Gates interview about a half year ago I smiled after hearing his sort of EGT was how his email inbox was doing. I timed that office opening almost perfectly for COVID-19 so I could have all the stress and cost associated with training a team, setting up a ton of computers, creating workflow, ... and then none of the benefits as the office would get shut down shortly after things began to operate smoothly. :D

By the end of last year a was a bit (err...lot) on the fat side from working too much, too much stress, and exercising too little. My weight and the length of my fuse are reciprocals.

In the past I used to harness negative energy into a form of rage to fuel drive, but now that I am over 40 I find it much harder to live that way. I've already had a number of near death experiences (including one when my wife was pregnant with our only child) and think at some point living that rage-drive way is just shitty. Just say no to endless rage.

So when it was obvious this year was largely going to be dog crap, I started to look internally instead of externally & figured it made more sense to improve health & mood than to fight the gravity of the global depression we are currently living through.

Exogenous Shocks

When things change out of nowhere they can end up dramatically changing the social and economic order.

Many such changes are utterly arbitrary and orthogonal to the concepts of fairness, justice, human decency, etc.

Some parties are politically connected & shielded from actual market forces.

As a self-employed person living overseas I am certainly not one of those protected parties. That said, my family and the people who work for me look to me and hope I can help shield them from some of the crap reality served up this year.

As a rule, when exogenous shocks happen those who are not politically connected get screwed hardest.

Smaller firms tend to under-perform larger firms: "As the earnings season draws to a close, companies within the Russell 2000 stock index — the small-cap benchmark — have reported an aggregate loss of $1.1bn, compared to profits of almost $18bn a year earlier, according to data provider FactSet. Meantime, the much bigger companies within the benchmark S&P 500 index have posted a 34 per cent aggregate drop in earnings, to $233bn."

Poorer people are more likely to lose their jobs.

Emerging markets tend to get hit harder than developed markets. Which only adds to the powder keg of instability as the food price inflation tied to falling incomes makes many people rather desperate.

etc.

As people get desperate violence increases & many governments get overthrown.

Central banks printing cash to prop up the financial markets only increases the divide further.

That increased income & wealth inequality makes "the system" only feel that much more fraudulent, which in turn acts as a powder keg to fuel more arbitrary misdirected violence.

Tesla now has a $340 billion market capitalization. They remain unprofitable outside of harvesting tax credits.

Beyond fueling increased violence, the sky high numbers for FOMO stocks also lead some people to feel like they are failures for only slightly succeeding or just getting by.

Others pile in to trashy cryptocurrencies in an attempt to catch up where they only further compound their losses.

Waiting Things Out

It is worth noting many of the jobs that are gone are gone for good.

We may very well be facing a global depression:

"The pandemic has created a massive economic contraction that will be followed by a financial crisis in many parts of the globe, as nonperforming corporate loans accumulate alongside bankruptcies. Sovereign defaults in the developing world are also poised to spike. This crisis will follow a path similar to the one the last crisis took, except worse, commensurate with the scale and scope of the collapse in global economic activity. And the crisis will hit lower-income households and countries harder than their wealthier counterparts. ... In all of the worst financial crises since the mid-nineteenth century, it took an average of eight years for per capita GDP to return to the pre-crisis level. (The median was seven years.) ... The last time all engines failed was in the Great Depression; the collapse this time will be similarly abrupt and steep."

If you can't afford to feed your family of course you have to solve that problem first. But if you are not absolutely financially desperate then this can be a good year to win in ways other than finances & only worry about money after other things are in a better place.

This is a good year to find meaning through various types of self-improvement and doing lots of small & kind things for the people around you. Yesterday was a good day to buy your wife flowers. So is today. Tomorrow is a good day to buy a friend a surprise gift.

One of the best books you can read about developing positive personal habits is Charles Duhigg's The Power of Habit. It is 8 years old now but it is still a great read.

Pushing for broad structural changes in a crisis through ideology which removes ordinary feedback loops often ends up creating only further injustice with the campaign "hero" looking like their polar opposite. Ideology pushed hard enough wraps around to the other side.

When things are absolutely screwed the world over it is better to focus on improving yourself and your family rather than promoting arbitrary extrajudicial justice and burning things down further.

Here are the steps I took to improve a good bit so far this year.

Coronavirus Lockdowns

When I saw a video of a guy walking down the street in Wuhan cough blood and fall over dead I immediately ordered facemasks for everyone in my extended family. I also bought facemasks and gloves into the office for workers. As it turns out gloves were largely a non-winner because using them is more likely to spread virus and bacteria, but the intent was good.

Cygnus recommended taking the supplement quercetin & so did Dr. Zev, so I do that.

When lockdowns were announced I hoarded months worth of baby formula so I know my daughter would be ok & bought her a couple birthday presents in case the lockdowns were extended repeatedly. They were, so that worked out ok.

When lockdowns ended I bought a ton of different toys for my daughter so I could share them with her and make up for the limited outside contact for the time being. I also brought my lead graphic & web designer a dual monitor computer to his house to improve his efficiency.

Any day where there is not a lockdown I try to make the most of it knowing another couple months or quarter year can disappear arbitrarily.

Making the most out of the day for me often means doing something positive on the health front & meaning front right away. Things like getting food for my daughter or going for a walk are big wins early in the day as we tend to slow down and get tired as the day drags on.

Health / Fitness

Early in the year when I could use the gym I was walking at a brisk pace for about an hour a day while reading books and listening to podcasts.

After gyms were forced to be closed I started walking outside. Initially this was often to get groceries or various baby supplies, though I continued to walk daily even when there wasn't a real direct need just to keep mood up with all the ridiculous crap going on in the world. I used to think the Philippines was way too hot when I had to drive everywhere, but even if it is hot as hell it isn't bad to be out in the sun and heat so long as you are only walking especially if the walk has a purpose which helps your loved ones in some way.

Walking regularly with nothing else going on can be boring as hell, of course, so to offset the boredom I bring my iPhone and have some Airpod Pro earbuds with their killer noise canceling features. When nobody is near me I sometimes pull down my face mask and jog or sprint for a while to add variety to the day. I also sometimes make people's ears bleed by singing along in an effort to share the joy of whatever I am listening to. :D

There are many awesome acoustic songs on YouTube. Revisiting unheard versions of songs you liked a long time ago can make the lyrics more powerful.

Some of the spoken-word song introductions are quite powerful: "everyone wants you to forget you are gonna die, because if they convince you your not gonna die you waste your time doing what they want you to do. Spend money on what they're selling. ... one day I'm gonna die, but before then I'm gonna live, live, live, the way I want to live and I hope you do too."

Whenever I exercise I usually have caffeine as well. I view it a bit like a band aid or kick start, but I try to only use it either explicitly when walking or when intensely focusing on work.

If my back hurts from sitting at the chair too long that is a cue to get up and take a break even if it is a short one to go play with my daughter.

Sometimes I will walk two or three times throughout the day to break up the monotony.

Most my exercise is walking or jogging, but occasionally I will do a few push ups or sit ups.

In a world of gloom it is hard to look in the mirror and see a steaming pile of garbage which is not well maintained and feel good about yourself.

You know what sacrifices you have made and what the costs were, but it is easy to go down the path of resentment if outcomes are subpar and beyond your control in the short term.

If you don't feel alive you aren't. :D

It's a lifeless life, with no fixed address to give
But you're not mine to die for anymore
so I must live

Diet

I try to eat salad, Indian food, quiche, nuts, beef jerky, and all sorts of other foods where carbohydrates are sort of only incidental and are not core to the dish.

Anything that looks/smells/feels/sounds like sugar, rice, potatoes, bread, derivatives thereof, etc. I consider to be poison / systemic inflammation / weight gain and try to skip it.

I also consider drinking calories to be a disaster as the glycemic index on things like a soda are through the roof.

If you are fat and eat a lot of carbs you are repeatedly spiking your blood sugar, then it crashes, then you are hungry again. This habit & addictive cycle works on some of the same neural pathways that hardcore drugs do.

Sometimes I still do eat a bit of peanut butter or chocolate or frozen chocolate dipped in peanut butter, though I try not to use it meal replacement style very often & try not to be "full jar now empty" Aaron. Three tips on that front are to eat peanut butter using a chop stick so you eat it slower, eat small pieces of chocolate, and freeze the chocolate before eating so it takes a while to chew and you realize just how much you are eating. :D

When I wake I often wait at least 4 or 5 hours before eating my first meal. In some cases I stretch that out to 6 or 8.

Communicating

I know a lot of people are in a bad state this year, so I try to offset that at least slightly by overcommunicating.

I send my mom pictures or videos of my daughter every day as she told me those help her sleep better at night and her watch even shows her blood pressure is lower and she feels much more well rested the next morning. I have bought my daughter a ton of extra clothes to wear just so my mom gets a bit more variety in the pictures and my daughter will have a ton of memories to sort through when she is older.

Our daughter has quite a bit of energy so sometimes she makes communicating with my wife hard. Sometimes we have better luck texting back and forth if something is urgent and then discuss it in more detail over email or when our daughter is taking a nap.

A lot of people around me have recently went through hardships beyond the financial uncertainties many are facing.

  • Our web designer's mom had a heart attack then got COVID-19 but I think she is ok now.
  • Our lead writer had a friend younger than I who after going to the hospital with COVID-19.
  • Our lead programmer's parents recently had their house broken into with some of their sentimental jewelry stolen & he is the glue guy for the whole family.
  • One of my buddies recently broke up with his long time girlfriend.

I am sure there are a lot more similar stories that I have not been told yet. So as a rule of thumb I sort of consider that if people have historically been good its ok to give them more leeway this year & be extra kind.

Mental Health

One of the cheapest & easiest wins in terms of quality of life is setting your grounding from a perspective of feeling lucky so that you are appreciative & try to be a better version of yourself. Episode 504 of This American Life shares an inspiring story about Emir Kamenica.

"These stories we tell about ourselves, they're almost like our infrastructure, like railroads or highways. We can build them almost any way we want to. But once they're in place, this whole inner landscape grows up around them.

So maybe the point here is that you should be careful about how you tell your story, or at least conscious of it. Because once you've told it, once you've built the highway, it's just very hard to move it. Even if your story is about an angel who came out of nowhere and saved your life, even then, not even the angel herself can change it." - Michael Lewis

I generally am not a fan of taking prescription drugs to solve symptoms of larger underlying problems as in many cases those can cause additional bonus problems. I get that some people need various drugs to get by and survive, though outside of caffeine I typically try not to drink much or do much of anything else that can add more instability or create more bonus issues.

The above said, I think my baseline mood (especially if I am not in great health) tends to be a bit darker than average.

The early web was quite cool and you could do things like email Tim Berners-Lee and get a response, or someone would read your site and see you mentioned Carl Sagan and shoot you an email like this one:

I wrote the first modern book on depression in 1980. It was the first book to present depression as a biochemical disease, rather than a 'mental' illness (whatever that is). And, I was the one who introduced Carl Sagan to television as a local TV personality in L. A., Carl was a good family friend who came to watch a taping of my PBS show, he got really intense when he realized what a medium for communication TV was, and I introduced him to the GM of the station, that's how he got to TV. He was more of a scientist than an actor, I coached him on TV persona. He was a very intense person, and did not have a big ego; he was always open to new information, whether it came from experiences or ideas. He would have loved living now.

To solve both depression and weight gain problems, try an over-the-counter nutrient called 5HTP. The Walmarts here sell the least expensive and best pills. Take about nine a day for about nine days, you will notice you haven't felt the urge to eat all day and you don't have as much depression symptoms; the griffonia seed from which 5HTP is made increases serotonin in the brain.

Then a follow up after I asked about the FDA ban of L-Tryptophan:

Now something gets clearer! When tryotophan was banned because of one supposedly contaminated batch, I used every tiny bit of influence I had as a journalist, talked to every politician I could get in touch with. It was like going up against a brick wall. I wrote articles, did everything, could not understand at all why the nutrient was being banned for one bad batch in Japan and why resistance to overturning the ban was so solid. I even tried to obtain the animal version, and was told it 'wasn't the same,' yet according to a chemical analysis, it was. Now I understand....

My book is "Depression, How to Recognize It, Cure It and Grow From It, Prentice Hall hardback, Simon Schuster paperback.

She also mentioned

Depression research is such big business that I feel they don't want to find a real cure. The way the research should have gone is to study the chemical makeup of depression, then match the medication effect to different brain hormones (as well as cortisol-though it's not a biogenic amine, it's a definite precursor), and find accurate ways of testing which hormone or combination thereof is/are out of balance, so the correct medication can be prescribed right off the bat. So, if it's a seratonin imbalance, the doc gives one medication, if it's monomaine oxadase, the patient gets another, and so on. Prosac is like a huge blanket device, rather than an accurate laser beam going to the exact place it is needed.

Depression research really hasn't progressed that much in the last 20 years, imho.

I know a big part of my improved mood was from taking 5-HTP along with Vitamin B & Vitamin C just before bed. When I take those I can fall asleep a bit quicker, sleep about an hour less, wake up feeling more refreshed, and am less hungry the following morning. If I had to guess, I would say the 5-hydroxytryptophan contributed to my recent 40 pound weight loss more than anything else did.

Anyhow, I would not recommend 5-HTP for anyone who is on SSRIs, MAO inhibitors, or many other drug classes (talk to your doctor first, etc.). But I figured a lot of people feel like crap this year so I should mention it has worked well for me.

Before writing this blog post I also recommended it to a few other people.

Our lead content writer was down after her friend died & I recommended it to her. She said she felt a difference the very next day.

Our backend developer took some after I told him about it and said his personal doom loop he was going through was better within 2 days.

I do not think it is a magic cure-all or would work for everyone, but if you are a bit down combining a bit of 5-HTP with exercise, healthy diet, sleep, etc. can help you improve your worldview and outlook a bit to get through the challenging times we are going through.

My only complaint (glass is always at least half empty :D) would be that as I have discarded that sort of rage cycle I find it easier to be distracted and harder to focus on work. If you love what you do focus comes automatic, but if you don't then you do sometimes have to trick yourself a bit into being productive if you literally could be retired for life. But I suppose most people would say that is an absurd "problem" to complain about.

My only solution to the above is watching MJ on MJ. :D

Ending on a Positive Note

Destruction leads to a very rough road but it also breeds creation
And earthquakes are to a girl's guitar, they're just another good vibration
And tidal waves couldn't save the world from Californication

If you are reading this blog post you are almost certainly involved in some part of web development, content production, internet marketing and/or e-commerce.

Ultimately as the world is reshaped you will benefit as long as you get through the current period as literally *everything* is moving online.

Given that the big platform monopolies are now getting the PR black eyes they deserve for their locked down ecosystems there is a good chance the web will be a much better place in the next half-decade.

The number of people rushing to become their own bosses is at a record level. Many will fail, but many will innovate and create new markets as they have no choice but to succeed. As more things move online, attention merchant platforms keep breaking culture into smaller and smaller chunks to fuel increasingly distorted views of reality that cater toward confirmation bias and rage.

At some point people will tire of the feed-based never-ending stream and want things they can complete. The growth of Neflix and their streaming competitors reflects the desire for something longer and more in-depth.

Some of legacy print media brands with high cost structures are now recycled selling marked-up garbage in parallel markets.

The combination of these trends will drive an increased appreciation for authenticity & the desire for human connection.

Long ago my original SEO mentor stated:

This is what I think, SEO is all about emotions, all about human interaction. People, search engineers even, try and force it into a numbers box. Numbers, math and formulas are for people not smart enough to think in concepts.

I think the best brands, the best sites have a large portion of their founders personality in them. Never be afraid to be yourself, after all there are 1/2 billion people on the www, not all of them have to agree with you. Concentrate on the ones that share your views, concentrate on making their experience the very best it can be, the rest forget them.

Or to put it another way, the best sites say - this is what we do, this is how we do it, if you don't like it go somewhere else.

Ultimately though I think it comes down to desire and the will to win.

He later sold his business for a life changing sum, so unlike his favorite football club, I guess he had the will to win. The question remains if he will purchase the football club and "fix" them. :D