For the next few weeks, my blog posts will primarily consist of re-authoring and re-building the Beginner's Guide to Search Engine Optimization, section by section. You can read more about this project here.
How People Interact with Search Engines
One of the most important elements to building an online marketing strategy around SEO and search rankings is feeling empathy for your audience. Once you grasp how the average searcher, and more specifically, your target market, uses search, you can more effectively reach and keep those users.
Search engine usage has evolved over the years, but the primary principles of conducting a search remain largely unchanged. Below, I've listed the steps that comprise most search processes:
- Experience the need for an answer, solution, or piece of information
- Formulate that need in a string of words and phrases (the query)
- Execute the query at a search engine
- Browse through the results for a match
- Click on a result
- Scan for a solution, or a link to that solution
- If unsatisfied, return to the search results and browse for another link OR
- Perform a new search with refinements to the query
When this process results in the satisfactory completion of a task, a positive experience is created, both with the search engine and the site providing the information or result. Since the inception of web search, the activity has grown to heights of great popularity, such that in December of 2005, the Pew Internet & American Life Project (PDF Study in Conjunction with ComScore) found that 90% of online men and 91% of online women used search engines. Of these, 42% of the men and 39% of the women reported using search engines every day and more than 85% of both groups say they "found the information they were looking for."
When looking at the broad picture of search engine usage, fascinating data is available from a multitude of sources. I've extracted those that are recent, relevant, and valuable, not only for understanding how users search, but in presenting a compelling argument about the power of search (which I suspect many readers of this guide may need to do for their managers):
- An April 2006 study by iProspect & Jupiter Research (PDF) found that:
- 62% of search engine users click on a search result within the first page of results, 90% within the first three pages. This is higher than in 2004, when 60% chose results on the first page, and much higher than 2002, when only 48% did.
- 41% of search engine users who continue their search when not finding what they seek report changing their search term and/or search engine if they do not find what they're looking for on the first page of results. 88% report doing so after three pages.
- 36% of users agreed that "seeing a company listed among the top results on a search engine makes me think that the company is a top one within its field."
- The November 2005 PEW Internet & ComScore Study (PDF) mentioned above revealed:
- On an average day, 60 million people use search engines
- Search engine usage rises with both education levels (27% of those without a high school diploma vs. 55% with a college or graduate degree) and income (29% of those earning less than $30,000 vs. 52% of those earning $75,000+)
- An August 2007 Foresee/ACSI Report for eMarketer (Link) remarked:
- 75% of search engine & portal users were satisfied with their experiences
- In a breakdown by property, 79% of Yahoo! users, 78% of Google users, and 75% of both MSN & Ask.com users reported being satisfied
- Comscore reported in August of 2007 (Link):
- The number of search queries performed on the web grew 2% from 2006 to approximately 10 billion searches per month (across all engines)
- Google owned the lion's share of searches with 55.2%, Yahoo! had 23.5%, Microsoft had 12.3%, and Ask.com had 4.7% (AOL, which shows Google results, clocked in at 4.4%)
- A Yahoo! study from 2007 (Link, PDF) showed:
- Online advertising drives in-store sales at a 6:1 ratio to online sales
- Consumers in the study spent $16 offline (in stores) to every $1 spent online
- Webvisible & Nielsen produced a 2007 report on local search (Link) that noted:
- 74% of respondents used search engines to find local business information vs. 65% who turned to print yellow pages, 50% who used Internet yellow pages, and 44% who used traditional newspapers
- 86% surveyed said they have used the Internet to find a local business, a rise from the 70% figure reported last year (2006)
- 80% reported researching a product or service online, then making that purchase offline from a local business
- A study on data leaked from AOL's search query logs (Link) reveals:
- The first ranking position in the search results receives 42.25% of all click-through traffic
- The second position receives 11.94%, the third 8.47%, the fourth 6.05%, and all others are under 5%
- The first ten results received 89.71% of all click-through traffic, the next 10 results (normally listed on the second page of results) received 4.37%, the third page - 2.42%, and the fifth - 1.07%. All other pages of results received less than 1% of total search traffic clicks.
In addition to these statistics, research firm Enquiro conducted heatmap testing with search engine users (Link) that produced fascinating results about what users see and focus on when engaged in search activity. Below is a heatmap showing a test performed on Google. The graphic indicates that users spent the most amount of time where the colors are hottest - in the red, orange, and yellow sections of the page.
This particular study perfectly illustrates how little attention is paid to results on the page vs. those higher up, and how users' eyes are drawn to bolded keywords, titles, and descriptions in the organic results vs. the paid search listings.
For those who are interested, a terrific collection of additional data from studies, surveys, and white papers can be found on SELand's Stats & Behaviors page.
All of this impressive research data leads us to some important conclusions about web search and marketing through search engines. In particular, we're able to make the following assumptions with relatively surety:
- Search is very, very popular. It reaches nearly every online American, and billions of people around the world.
- Being listed in the first few results is critical to visibility.
- Being listed at the top of the results not only provides the greatest amount of traffic, but instills trust in consumers as to the worthiness and relative importance of the company/website.
- An incredible amount of offline economic activity is driven by searches on the web.
As marketers, the Internet as a whole and search, specifically, are undoubtedly one of the best and most important ways to reach consumers and build a business, no matter the size, reach, or focus.
I'm feeling a bit spent tonight, so despite the need for some refinement, and the fact that I should really put the search process into a visual flowchart, I'm hitting the deck. Tomorrow when I do this, I'll try to report some news as well :-)
It would be interesting to know how many keywords are used in the average query. FYI in China it's 6 characters.
Nice article. I particularly liked the Enquiro graph.
One small comment... what about trying to find an updated or newer version of the 2005 study (PEW Internet & ComScore)? It would be really interesting to see how many people use search engines today.
Sgiroux - I think the ComScore data from their qsearch product (mentioned a couple bullets down) would help with that - showing that 10 billion searches happen worldwide each month.
I also wish that PEW would come out with another study of equal depth - if you know of one from another organization, please do let me know.
Great job coming up with supporting documentation for "Why Search Marketing"? Who would have thought we need to convince anyone of that in 2007. Those10 billion searches a month are huge but that's only part of the story. Those searches are “core search” numbers. When they looked at search across all web properties, it was more like 61 billion searches a month.
Thanks for breaking out and adding the additional stats and studies. Thankfully, as search marketing continues to mature, the expansion of studies and tests and the data that goes with that continues to expand as well.
One area that I think will grow will be:
Inline video within SERPs through blended search is a perfect example... you can watch the video without ever leaving the search results. And this makes complete sense, at least for the SEs-- their primary revenue source is ad generated, so what better way to increase the potential ad revenue than to increase the amount of time spent on the SERPs.
I have to imagine we'll continue to see in-SERP content... audio, video, maps, perhaps scanning a blog and comments... especially with so much content being delivered through RSS... a cross between search engine and feed reader, a "search reader" if you will.
Great stuff. The heatmap testing image was interesting and something I hadn't seen before. What if we applied that same overlay to our own websites just to see what people click? What if we could figure out why they click there, too?
This is where I wish I was a developer and thinking these things 10 years ago.
Oh well.
you do get tracking software that allows you to see similar things for your website. apparently www.crazyegg.com is v. good for this. Even google stats have a site overlay where you can see how many times things have been clicked but i believe crazyegg is more detailed. So we can and people do the same sort of thing with trial and error type process.
yup. crazy egg rocks! all sorts of fun things to explore. and it's free.
"Trust in Data, all others have faith in God." Statistics are great when you have valuable, trusted sources. I love the heatmap. Most of my mature clients rank in the top three on the first page for desired terms, and it does wonders in sales meetings. It does tighten the noose on perceived competitive effectiveness. Thanks for reworking the beginners guide to keep it up-to-date!
Alternatively, you can click on one of the query refinement suggestions that are provided for most popular searches. For example, when I search for "web hosting", Google suggests at the bottom of the SERP:
Searches related to: web hosting
web hosting reviews image hosting
microsoft web hosting church web hosting
comcast web hosting web hosting templates
pc magazine bellsouth web hosting
The heatmap is indeed very striking, and I too would like to see a version that has some sponsored listings at the top of the page. Off I go to www.crazyegg.com to find out what's going on there (I love the info in seomoz comments!)
Thanks for the reference to the 2006 iProspect Search Engine User Behavior Study in your article. For those of your readers who might be interested, we've published 5 additional search marketing studies since that time, all available to download free (no forms to fill out) at https://www.iprospect.com/about/searchenginemarketingwhitepapers.htm
Very informative post! I have been around websites where everyone just hangs SEO targetting without actually explaining or showing that they really understand what its about. I love the heat map illustration, and am surprised to learn that bold keywords / descriptions do work. I'll definitely be subscribing to your blog. And no, I did not find you through a search engine but from a link off Shoemoney...
Thanks for this great post.
You're a machine Rand. I don't know how you can write so much every day and still do all your other work.
Very cool of you to include a mention of CrazyEgg - it's been my tool of choice for tracking users on my sites for a good while now. Very good statistical data too. You might want to add a little explanation of how much traffic a site in an average search volume niche is likely to get in a day if it ranks in top 10 - this would be very illustrative.
It occurs to me, as I print out and read these, that a "print" feature would be handy. Just a thought...
A lot of great information in this one. I admit I take a slightly different view of some of it, from the usability side (and I'm not sure that heatmap isn't partially just representative of how people view all websites), but of course, this is a piece about SEO, and it backs up the key reasons for optimization very strongly.
I really like the 8-step overview of how people use search. It's easy to forget sometimes just how complex a process search can be, if you follow the entire life-cycle of the user.
Nice article and nice review of the research.
One interesting aspect of that is the power of the long tail and 2ndary terms. The above research doesn't reflect that aspect but all those searchers polled above were using any of a million different variations on terms for their respective searches, some of which might reflect the most popular terms for a topic and some which don't.
All of the above research applies equally well to all the long tail and 2ndary terms used by searchers.
Focus on high rankings for a lot of associated terms, not just the single most popular term for a topic.
Great article Rand, it's pretty much a spot on sales pitch for any SEO - it'd do the job of explaining "THIS IS WHY YOU NEED SEO!" to any prospective client perfectly!
Rand this is an extremely informative, in-depth study: the kind of quality we're accustomed to seeing from you. I'm sure many of us will refer to it again and again. I await what follows with anticipation. :)
Rand...
GREAT ARTICLE!!! I await each installment eagerly! It's always great to go back to the basics and rekindle some of the things we tend to forget.
I love the great references with links to the PDF articles.
Please keep 'em coming!
Web
What are you talking about you did well! Extremely impressive that you keep this high quality up on a daily bases.
I'm totally on board with the IR screen. I just now forwarded it to my boss just now.
I wonder if those are available if a PPC ad is at the top. I would be very interested to see that.
Thanks Rand for the detailed post!! Interestingly, the relationship between searchers and search engines have also evolved over the years. The search process also reflects the buying cycle the searcher is in. Search Marketers should pick on this one early to help them achieve their goals. Heatmaps are always great to study and (IMHO) sites can be designed based on heatmaps study. Waiting on your next instalment!!
Rand,
I kinda get shy sometimes when it comes to commenting cause I am never sure what to say but GREAT JOB!
Sorry if I don't comment or say that enough on your posts ,
I am just so taken back at the quality time and time again,
I wish there was a long tail keyword tool....
Long tail keyword tool is definitely something on our project list, but it probably won't launch until 2008. There's just so much to do!