It's a battle between monsters - the might of Google pitched against some of the largest brands in the world. Anyone see Godzilla vs. King Kong? This is Amazilla vs. King Goog (well, Amazon et al - think any large online retailer). I wanted to do that as Googzilla vs. King Amazong but then I found a picture of lizards too good to pass up (see below).
I believe there could be a war coming and it's going to be one to watch. What does the search world look like when the carnage is over? I don't know but, in a second I'll present some scenarios. First, the background:
- Increasingly, Google is encroaching into the markets of the largest web brands. There are companies who get large proportions of their revenue through search (paid and natural) for whom Google is not just a channel, but also only one step away from a competitor. For example, they have the one-box and Google Books for book searches (e.g., for me, a search for John Steinbeck has a one-box with three Google Books listings) and the payment method.
- The official best practice for on-site tactics found in the webmaster guidelines have strayed (as Rand noted recently) away from just 'think of the users' into doing many things specifically for the search engines (Google in particular).
- There is starting to be tough talk from Google about tactics that have been in place for years and are innocuous from a user's perspective but which treat the search engines differently, such as Amazon's redirects of internal navigation information in the URL that are cloaked for Googlebot. This came out at SMX Advanced, where Matt Cutts commented and there was a bit of a song and dance about the issue. There is a lot of talk from Google, but currently, I still see Amazon ranking pretty well...
Google should be pretty good at thinking through unintended consequences of its actions. Some basic game theory insights (which we know they are good at over at the big G) tell us what to expect with nofollow, for example.
Nofollow has changed the link landscape to such a degree that it is starting to have the opposite effect of the intended one - when there is less incentive to get a link, it becomes ever more editorial. The quality of outbound links from Wikipedia, for example, is now actually pretty high as the incentive to game them has decreased. I would go so far as to say that on average, external nofollow links (i.e., not those you use to point at your privacy policy) might be higher value than un-nofollowed links.
As the quality increases, isn't that a signal you'd want to use in the algorithm? But it's only useful while it's not obvious that it's being used. A dilemma, and not the first example of a situation where Google's interests are not aligned with websites'.
Other unintended consequences they need to watch out for include what happens when they step into being a publisher / content creator and compete with those who use them as a sales channel.
So what happens next?
What happens when they push the giant lizards (and its friends) too far?
There is an old saying, that you if you owe the bank a million dollars, the bank owns you, but that if you owe the bank a billion dollars, you own the bank.
Some large internet brands have the power to take on the might of Google and actually hurt it. For a start, I can't imagine a site like Amazon.com getting booted out of the index. (I'm sure someone is going to bring up BMW and other examples in the comments, but I stand by this assertion. I think it would hand too much advantage to Yahoo! and Microsoft - do you fancy explaining to your non-SEO friends and relatives that they can't find stuff on Amazon through Google?)
Are we going to see some really big brands stand up to Google? Well, Amazon still has their cloaked redirect in place (try visiting this url as a regular user and as googlebot - really - check out that page. That product is AWESOME - and the inspiration for the space Godzilla in the title of the post), and you can see that they're still ranking pretty well. Is it just posturing, or has the lizard slashed the monkey? I like to think they have been asked to remove the cloaking and have said something along the lines of "Actually, we think this is the best for our users - we're keeping it." The thing is that the redirect takes you to the same page (bar minor formatting) and is the page anyone clicking through from Google will see - doesn't seem too bad to me. The extra stuff on the end of the URL for users tells Amazon that the user clicked through from Amazon's internal search (as far as I can tell).
You can see some big brands going down this route as well with the egregious link-selling going on by some of the largest brands in the world. They are sticking it to the big G and saying, "Bring it on." I'm not going to name them, but I have seen huge multi-national brands with blatant, off-topic anchor text homepage links that are not nofollowed and without a doubt are paid-for. Google might have manually stopped those links from passing juice, but they certainly haven't taken any stronger action (leading to an interesting 'caveat emptor' point - but that might be one for another post).
We are all aware that there are blackhat tactics out there, but until recently, Google could comfortably define blackhat in such a way that it was only really practised by non-brand sites (or rogue SEOs on brand sites). Increasingly, we are reaching a stage where almost any brand site is guilty of something that is against the guidelines. In a world where everyone is guilty of something, the people in power can dole out retribution on a whim.
I'm not saying that is happening at the moment, but if I were on the board of a multi-national e-commerce site making hundreds of millions of dollars a year through our natural search channel, you can bet I would be thinking about the risks - and what happens if the big monkey comes any closer.
Crazy outcome - the one in the film
It's the final show-down. The monkey has taken it too far. The lizard is properly cross.
(Thanks to futuristmovies via flickr).
If Google stepped too far into the space of its customers and the people for whom it is two sales channels (paid and natural search), and natural search traffic started dropping, for example because there was always a one-box advertising a Google product, so:
- Amazon is upset at the book and product advertising
- Wikipedia is cross with Knol
- Ebay is disappointed because of gebay (G doesn't own an auction site, do they? Bear with me here)
- Newspapers are upset by Google News
- change robots.txt: User-agent: googlebot, disallow: /
- add an interstitial advert on all pages of Amazon, Wikipedia, Ebay, NY Times, all Yahoo! and Microsoft properties, etc. to say "Google no longer has any of these brands in its search results. We suggest you use Yahoo! or Live"
Most likely outcome
OK. So the big fight probably won't happen. Unfortunately, I think the most likely short-term outcome is a stand-off, in which big brands approximately toe the line, step over occasionally and are not punished, but don't push it too hard. In this situation, the small webmasters lose - they are scared of what they can and can't do when the guidelines say one thing and they can find Fortune 500 companies doing something else.
I am currently in a quandary about what to suggest to clients when it comes to cloaking, for example. We all know there are white hat uses of cloaking that shouldn't really be a problem to the search engines. But they are technically against the guidelines. I thought that was a real technicality and there was no risk if not done maliciously and the on-page copy was essentially the same, but the comments about Amazon's cloaking have made me think that isn't true.
Under this scenario, one thing to be expected is that we are going to continue to see large brands buying and selling links, and rankings being achieved using bought links with only the occasional slap-down to keep the proletariat in line.
If I were Ebay or Amazon, would I buy links? Well, put it this way, you can bet I'd sponsor an ipod competition or two...
Any resemblance to a real movie plot is entirely coincidental. I have not seen Godzilla vs. King Kong and nor am I likely to.
P.S. Tom pointed me to two interesting links - one from Ciaran on a similar subject and one about Epic 2014/2015 referenced by Ciaran.
I'm not so sure this is all that hard to understand. Google is not just a search engine. It's a media platform, a media company. Funny things happen when you go public and suddenly have to answer to shareholders, etc. Amazon and Ebay are public companies. Why are there rules for the small guys but not the big guys? Because this is capitalism and money speaks. It's kinda like that insurance commercial where they show people in some posh situation and then the announcer says "if you can have that for this price (show the same people now in some lower-class reality), why wouldn't you?".
Same situation here. If the common joe-blow less than $10 million a year business could live outside the rules for less than $150,000 a year in online marketing and not need public shareholders, why wouldn't they? But these big companies have marketing budgets that are easily 10 times that amount. Heck, $150,000 is payroll for 1 or maybe 2 employees.
You could also say the same thing about life. Some people are rich and never went to college. Does that mean everyone should just say, forget about college? Forget about a high school degree? No - MOST people need to still play by the rules. No different for the rest of us in the Internet marketing world.
Great analysis, I really enjoyed reading this. It should be interesting to watch how far Amazon et all will push the limits, as I agree - Google can't just remove them from the index.
With regards to nofollow, I think you are right that the nofollowed links are often of higher quality. Its long been my suspicion, and I suspect many others, that some sites nofollow'd links are "live" so to speak. StumbleUpon profiles are the first that come to mind, as I've had a couple of sites do great on SU, get toolbar pagerank, and have the Googlebot crawling them hourly despite having virtually no non-SU links. I'd put Wikipedia on that list as well.
On another note: the EPIC 2014 transcript is cool, I don't know how I never saw it. Does anyone have a working link to the animation?
I think you may have misinterpreted my argument. Sorry if I wasn't clear. I'm not particularly railing against one rule for the big guy and one rule for the little guy. I think it's unfortunate, but that's life (I'm as free market as anyone and some of our clients are big guys!).
I'm saying what happens when one guy pushes another too far...?
Hi Will,
Here is another one Google will miss. Trulia (the largest real estate listing portal) is cloaking links to their city real estate keyword pages from local newspaper and other syndication partners' sites (absolute Google violation). Here is the Sphinn story about how it works. Is it absolutely against Google guidelines? Yes. Will Google do a darn thing about it? Not in a million years. Why? The dude who is the VC financer for Trulia also financed Google. Will Trulia rule every single "City Real Estate" keyword? yes. Will Google search results suck due to this Corporate BS? I sure as heck hope so.
GRRR, interesting post.
RAR - newspapares never take on Google (except Belgian/French ones maybe). Newspapers too scared of how Google change whole game, RRRGHAR. Terrified that they might end up losing all their traffic RARR.
AARRRGGGHH eBay already get in fight with Google. GRRRRAR, PayPal vs Checkout anyone? Who would lose out of Wiki/Google fight GRHHRR? Think Google SMASH Wiki!
Whole white-hat/blackhat thing becoming increasingly difficult to define as almost no SEO is done for user any more, no matter what some might say ROAR!
Should make for ROAR, GRRRR, interesting ride though.
Hat tip to this amazing review for the stupidity of my comment.
Edited for ROARiness
Thanks Ciaran. That comment was almost unreadable, but actually contained some good stuff. Well done!
"and what happens if the big monkey comes any closer"
I hope that's not a reference to me -I'm trying to slim down but the Ben & Jerry's doesn't seem to be reduced fat!
I like working on movie sites; reminds me to nudge more of them into working with us and making everyone think that the movie is half-decent!
:o)
Rob
Will - I think Google is willing to go pretty far to protect the quality of its index, but they're never going to be making stupid moves just to penalize a big brand site for a technical vioaltion of guidelines. Amazon is serving essentially the same experience to search engines and users, and there are dozens, if not hundreds of sites doing the same thing. Cloaking can be completely "white hat," it's always got to be about the question of intent, IMO.
As to your scenario of big brands shutting down Google - I could see this if enough publishers or merchants of a separate type formed their own conglomerates on the web and announced "we're no longer findable through any search but our own." If just 10 of the top 30 newspapers did this, and 30 of the top 50 online retailers joined up and claimed to be only accessible via a new search engine (in which they all had a stake), that could make the search game a little more interesting. Note to Microsoft - think about using this strategy once you make your engine good enough to compete :)
BTW - Does this remind anyone else of the old "Use AOL keyword..." phrase inserted into every promotion/ad in the US?
well said, once again Rand.
Will, your perspective on search is amazing. Your tips are often out of the box but make sense, and I love it! Distilled is obsiously a great company, and if you're ever in the same area as me I'd stop anything to have a conversation with any one of ya.
Thank you Fred. I think that's a little over the top, but I appreciate your comments nonetheless :)
don't be modest.
Rand, you could advertise on every billboard in Washington and they still wouldn't get the message. :)
Now, you see, I agree with everything you said there Rand, 100%. Or I did. Until Google got upset with Amazon's cloaking (I don't know if you saw the sessions at Advanced when it got raised - but they definitely feel it shouldn't be happening). While I feel that their cloaking probably benefits pretty much everyone, Google *are* trying to push this "all cloaking all bad all the time" mantra and yet, they're not pushing that hard...
All true but, as Will says, if Matt decided that something wasn't best for the index, no matter the intent, then the rules get changed.
Obviously I didn't see the session he mentioned and don't remember it cropping up in Twitter coverage (which is how I experienced SMX Advanced vicariously) but would be really interested to see a summary of that session if anyone knows of one.
Oh yeah, ROAOAOAOAOORRRRRGHHGGH!
Good observation. I agree.
Once again - I agree. BMW is not a relevant comparison to extremely, highly, online transaction oriented Amazon.
Very interesting post Will. So much material to think about. I'm just curious - do you knock this stuff out between answering pro questions or running a business? ;) I suspect you could use some sleep.
Thanks again.
Sleep? Mmmmmm. Sleeeeep.
I'm hoping for some of that this weekend.
I actually wrote most of this blog post on the train. Then I had to go online to do some digging around (delegated the cloaking redirect finding to Tom to give credit where it's due, and Lucy proof-read it for me!).
Now - curry is ordered and I'm stopping for the evening after just one more site review...
Curry!!!! Yes. Thanks for that Will.
You just sealed my plans for the evening. I was trying to think of something to bring home for my girlfriend for dinner (she just had surgery yesterday), and the Clay Pit in Austin has the best Tikka Masala and Curry!
I owe you one...
My pleasure. Happy to help. Enjoy your curry :)
Its a good point Will,
As to people getting together - I know a fair few e-commerce travel companies (of the big order) were pretty peeved about the Adwords trademark thing. I dont think its unforeseeable that Amazon or similar sized companies in certain verticals decide to rail against Google.
Regarding the big man/little man - its in the offline world that we see this the most - politics, law, government, planning permisions... etc.. Tho mostly I think its the middle people who get screwed, big enough to be noticed and made an example of, not big enough to scare of the big Gorilla...
Is it just me or is there a "beware Google" vibe in the woods these days?
oh yeah - awesome pic - this'd be my Google kicking mechazilla :)
Excellent post Will; I'd not really considered it before, but you're totally right, the only companies who are likely to overthrow Google at the moment are the big brands that searchers expect to find in the results. Hence Google letting some stuff go with them.
I have to say, I really do think that Google need a competitor - let battle commence eh?
Will, an excellent read. A shame that you published it on Friday afternoon as I'm afraid it won't get the eyeballs that it deserves.
There does seem to be a double standard with how Google treats spammy large brands with kid gloves and small brands that might be doing exactly the same thing with a venomous wrath.
The difference is that one little mistake for the smaller companies, which sometimes comes as a result of pure ignorance of an unscrupulous SEO provider, can lead to a more severe or longer-term penalty from which it might be almost impossible to come back. The bigger brands don't have that problem--they just throw up their hands and say "oops, our bad, we've fixed that" and they get back in the index at more or less the same spot. Or in the Amazon case, continue to push the issue and remain at more or less the same spot.
I guess I'd just rather see Google be even-handed with how they hand down justice, regardless of the size of site. If that means don't be so quick to punish smaller webmasters, or be more lenient with their violations, or more explicit as to what's creating the penalty, so be it.
Also, perhaps innovate the algorithm to ferret out cloaking and develop an additional signal of page quality that doesn't have to do with links, thereby destroying the paid link economy they've created (hat tip to Michael Gray on the second point).
"I would go so far as to say that on average, external nofollow links (i.e., not those you use to point at your privacy policy) might be higher value than un-nofollowed links."
You lost me with that comment. So nofollowing external links could have the opposite effect of what one is trying to achieve???
Vic
"Anyone see Godzilla vs. King Kong? This is Amazilla vs. King Goog (well, Amazon et al - think any large online retailer). I wanted to do that as Googzilla vs. King Amazong but then I found a picture of lizards too good to pass up."
A brilliant insight into the creative process there, Will. I think you're going to find making up bed time storys a doddle.
I don't think there will ever be a general revolt against Google unless a real competitor, like Microhoo, were to come into existance. Until then the little folks will continue to be terrified and bullied by the big bad Google dictator.
I like the War on Google scenario. Another aspect of this post is that in the SO world we tend to focus all our attention on what Google will or won't do. How the "proletariat" are slapped hard while the big companies skate. In Business, when the big monkey gets too cocky he invariably leaves the door open for competitionI try to remember that not too long ago Yahoo was king of search and Google was just an upstart. The more Google encroaches on the pure search results, inserting their own money maker into the mix, the more it frustrates not only the advertisers but also the searchers. Look for the next Search Contender to get back to the basics of Natural Search, defined paid for spots and no self serving crapola added into the mix.You would think the lions share of the search world and Billions in Pay Per Click revenue would be enough. I watch how the college students do their searching. When they find a pure search site, content related first, it will go off the charts and reduce The Big Monkeys market share without a war. As an SO I plan on being busy both now when Google is the big monkey and in the future when it gets replaced by the next Titan.One more observation from the real world. We are all Policed by a relatively small number of Law Enforcement Personnel. The reason this is possible is because in general the majority of the population understands the value of order and lawfulness. Rules and regulations are meant to give us equality and protection. But when corruption of the rules becomes too flagrant by those in power or a wink and a nod is given to the powerful while the commoner is punished... a revolution will follow. One of Custers scouts warned him that there were more Indians in the valley than his army had bullets.
I think perhaps Google products, (wasn't it called Froogle at one time?) might compete with Ebay.
It will be interesting should a showdown ever occur between big websites and the engine that guides you there.