We have a lot of changes going on at SEOmoz (feel free to get excited, we sure are!) and with all of these changes to the site comes the need to focus on tracking. Internally we have spent the last few months redirecting our attention to not only the best practices regarding analytics and data mining, but really pushing ourselves to revisit our analytical processes.
You know what we realized? There sure is a lot of data. While I have always appreciated the reporting features in GA, I find that too often people take the reports at face value and fail to go deeper. It’s unfortunate since it is in those deep dives that you usually discover the data that can change your current course of action. So this post is going to tackle an approach to analytics that is often overlooked and (thanks to Google and their silly naming convention decisions) is rarely used to its fullest capacity. Get excited folks we are going to talk about benchmarking {Woohoo! Insert audience applause here}.
All of you excel spreadsheet lovers out there know plenty of ways to extract data and pinpoint specific red flags or recent successes. In fact, most people use analytics to simply analyze the current state of their account. While this is certainly a priority, it really is one dimensional. Instead of stopping there, why not go further? Why not better understand where your data was, and how you are measuring up? In fact, why not use this data to help inform your internal decisions as a company? It’s like an analytical epiphany—“using past and current data to help guide you moving forward.” Glorious.
While many of the analytics platforms out there have given us a number of ways to compare historical data to current data, we are still limited to two distinct time ranges (for the most part). It’s great to see those two ranges stack up against each other, but that still leaves a lot to be desired. Without going further you miss the "interaction" between those two distinct time ranges.
Benchmarking your data is a great way to discover more about this, often overlooked, gray area. Benchmarking simply means you set a standard at which you compare something else to. When used for data mining, it means you plot two distinct variables (time ranges, metrics, dimensions, etc.) over a period of time and then use these “benchmarks” to infer conclusions when making decisions.
You can then see a more complete picture of your site’s momentum. In my opinion, understanding your site’s momentum is one of the most powerful metrics an analyst can calculate. If you can say with authority that you know how your site is doing and how it will likely be doing in the next week, month, few months, etc., you are in an ideal place. With data like that you can take more calculated risks.
*First, I want to throw out a disclaimer—a little over a year ago Google decided to integrate “Benchmarking” into their Visitors tab in GA. This just made things confusing in my opinion. The GA feature actually shows your site in comparison to a {very very very limited} industry pool of similarly {not really} sized sites. There is a lot wrong with the assumptions of this feature, but for our purposes here, when I say “benchmarking” I mean the act of plotting two distinct variables over time to extract insight…not the {ridiculous-I-can’t-believe-they-took-it-out-of-beta} GA feature.
The "benchmarking" feature in GA on SEOmoz
Okay now that we got that out of the way, let’s talk about how you can benchmark your data to hopefully gather some insight into your site’s performance.
Know your bottom-line (and your "high-line" –yes, I just made that word up)
This is probably the most common approach to benchmarking. It’s a pretty simple way to analyze the current state of your account. You should know your extremes for every metric. For example if you are a company that sells a seasonally successful product, you should know what your lowest conversion rate is for the year, as well as your peak conversion performance. In understanding the extremes you can make better assumptions on how your off season stats are trending. While not the most accurate approach to data mining, benchmarking the extremes of your account enables you to speak intelligently, at any given moment, on how your site is currently performing.
Know your ratios & relationships
Am I the only one that always reads “ratio” as “radio”? I digress. Knowing your metric ratios and how they relate to each other, is a great way to quickly detect when things are headed south. Often, as analysts, we don’t realize something has gone wrong until we see sales are down. While that is an effective method of pinpointing mistakes, it certainly isn’t ideal. Wouldn’t it be nice to quickly identify issues as they actually become issues? Crazy, I know. Well this is exactly what benchmarking the ratios of your site’s metrics can do. At SEOmoz, we use ratio/relationship benchmarking to keep our traffic stats in check. We don’t just plot out how many visitors each section of the site brings in out of the total visitors; we compare those percentages against each other. This gives us a ballpark value to guide us. An example; “the X part of the site brings in roughly twice as much as Y, which brings in about 1/3 of the traffic as Z.”
The great part about this method of benchmarking is you can easily turn it into a visual representation of the different pieces of the pie, and isolate out when things start to shift. Below is an actual example Rand pulled together earlier this week (yes he does that sort of thing for fun! A true data-head!). In this chart we have graphed out the top trafficked pages on our site, and then plotted them against each other to show how they are performing in relation to each other.
Also see a larger, detailed version
You can see the significant drop in the blue segment (our Tools page), which was due to a redirect mistake we made (oops...Rand talks more about that here). By visually representing these sections, we can easily identify shifts in the relationships, which can guide us on where we should focus our attentions (aka fix our silly SEO mistake ASAP!).
Know the norm
Okay I know, I know…I talked a whole lot of trash above on the GA benchmarking feature, and here I am talking about “knowing the norm,” but approaching data analysis this way can be insightful. Knowing and using industry standards in benchmarking can efficiently identify low hanging fruit.
However, the actual GA benchmarking tab is a poor example of this. Keep in mind that sites have to opt into the benchmarking, so (a.) this feature might not even have your industry represented and (b.) you have no way of knowing how many sites these “standards” are calculated on. Also keep in mind there are only three buckets for website “size” in this feature—small, medium, and large. WTF right? Yeah, since when do all websites fit into those three sizes? What am I ordering a latte over here?
With that said, it’s worth knowing the vital metric standards for your industry. If you see that similar sites to your own have a bounce rate of around 40% and you are chilling around 65%, while all the other metrics look closer in range, then you can assume this metric is where you should direct your optimization efforts. This approach isn’t as scalable or as accurate as other benchmarking methods, but it’s definitely worth a mention, if only for peace of mind.
Know the limits
While benchmarking is incredibly effective for things like trending, projecting, and exploring the data, it’s important to know the limits of the process. It is meant to be a discovery process, not a scientific formula. Just like anything else you take away from the data, it is just an insight, not a guarantee. You are making assumptions based on past performances, and performances change. So one word of caution to all of you data-heads out there—benchmarking is a great tool to add to your bag of tricks, but it is only one of many you should be using. Don’t get so caught up in forming relationships between the metrics and dimensions of your site that you lose perspective on the independent variables themselves.
In conclusion
Get in there. I mean it, seriously. I know we are all crazy busy, but that shouldn’t translate into a two minute GA log-in, a quick glance at the vital metrics and a few automated reports. Our analytics are meant to be explored. Benchmarking is one of those processes that may take an extra hour or two, but discoveries made during those few hours can be instrumental in guiding your company’s decisions.
Confession: At SEOmoz we haven’t always been the best with analytics and tracking, but in the past half a year we have refocused our energies on truly knowing what our users are doing, how our site is performing, and finding opportunities within the data. It’s time consuming, and tricky, and what you discover is not always fun to find out, but it has certainly helped us redirect resources where they are needed.
Over the next few months we are rolling out all sorts of good stuff, {the Chrome toolbar launch was just a teaser my friends }. We are using processes like benchmarking to better prepare us for these changes. Taking on new challenges as a company is an awesome thing, but doing it with a little data to steer you, makes the ride even more fun.
Something I found very useful when coming to a completely new sector, is to track/benchmark the indexing of my competitors via the site: command (i know its a crappy measure, mkay)
This helps when I see fluctuation in indexing reporting etc, to know how my competitors are doing at the same time. Its not perfect, but tracking 20 competitors indexing and seeing what site categories they have indexed is very enlightening e.g. one competitor gets all their traffic from profile pages while another focuses on tag pages etc
Combining this with MOz back link data, I calculate a ratio which allows me to identify who does the best indexing with the least incoming link equity.
This gives me a starting point as to what the most important types of data are in the industry and lets me see which areas are undertargeted. Ive also learned a lot about IA by analysiing the IA from the most "powerful"sites.
Thanks for the post, benchmarking is one of the most powerful internal reporting tools and proofs (and its saved my ass when things go wrong, to know wether its just you or its everyone in the same boat)
Gold star goes to you for using the tenets of the post and lacing in our tools ;) you win!
Am I the only one that always reads “ratio” as “radio”?
I'm going with "yes", you're the only one ;)
I find that an incredibly useful question in analytics is "Compared to what?" - so many people fly off the handle about a number being X, but then have no idea what that number is normally. Without benchmarks, "good" and "bad" are virtually impossible.
ratio.radio.ratio.radio. they.are.so.close.
It's like the old tongue-twister:
"What is the ratio of radios to radically radiant radishes, Horatio?"
Shame doesn't exist the "audio-comment" option!
Our living analytics wise man, Avanish Kaushik, would say that data within context is mandatory, delicious and orgasmic. Go read his blog (kaushik.net) and you'll see that I'm not joking.
I have to agree. Context will show us how 5% can be better than 15%. Especially if we're talking about punches to the face or ratios like 5% of 58,345 vs. 15% of 10,406.
Benchmarking is a great form of placing important points into context. We have to start somewhere and optimize as we move forward.
If someone is able to make Analytics not only sexy but overly funny... that person is you, dear Mrs. Joanna Lord.
That said, I agree with you about benchmarking. Somehow it should be one of the cores of an SEO dpt. or professional, as it can really help you planning your SEO strategy, apart from make you discover hidden gems you even don't know about your or your client site and those defects that cannot be detected because hidden by some sort of "data fog".
For sure, benchmarking can give you one more reason to ask a free access to the GA Account of a Client when it comes to talk about the contract of an SEO service. I say this because it is not that obvious that Clients will allow you to access to "their" GA Account... I've seen things you people wouldn't believe...
Edit post Rand comment
I agree with him, more Joanna Lord posts here... and why not one co-authored post with your "sitting-in-front-of-you-friend" Jennita?
You are spot on. I can't believe how many of my clients on the paid side would ask me why acces to GA was instrumental to our contract succeeding. I mean realllyyyyyy?
Once you can get in there and provide a client with a new process in which to analyze the data, they can't help but be stoked. Then they just start throwing passwords and log-ins at you. ;)
Thanks... and yes, I confirm your last phrase. The keyword: trust.
Thrilled to hear SEOmoz is putting more efforts into analaytics!
I think some SEOs, especially on the consulting side, may be scared of analytics because it holds them accountable. Yet it's also a huge opportunity to help the orgainization you're working with turely understand what's happening. They will thank you for that much more than a few keyword jumps in the SERPs (that send 5 more visitors a month!)
Agreed, analytics can be a bit intimidating, especially when you need to use them to "report back" to executives. What I try to do, instead of massaging the data to put it a positive spin on it, is display it as truthfully as I can. As long as the data is paired up with some sort of recommendation or explanation, you will make your position clearer, and give the higher-ups a better idea of what needs to be done on their end to increase performance.
What i had hoped SEOmoz was going to add in benchmarking feature using Linkscape data :(
It would be great if Google could improve their Benchmark feature to match their recent updates to AdWords where you can Analyze the competition adwords campaigns.
I do believe there will be ranking and keyword tracking through time in the next iteration of the SEOmoz tools. While this might not offer a 1:1 ( ... look a radio!) benchmarking across all areas, there will definitely be some useful upgrades coming our way.
As for your PPC needs there are paid tools that will give you the budgets and the exact ad types for your competition. In addition to showing you their spending habits over time. But knowing all of this will not help you beat the competition ... even if you steal their keywords and ads to the letter. The big secret in PPC is in your research. it's how you do the day-parting, the demographics and choose the networks. It's a beautiful and scary system.
If the moz tools will start showing us historical data, I will be one happy hombre.
And it will ensure that I stay PRO for life!
Yer like the post, however what would be really useful for the not quite so "geeky" people like myself is a blog post or three on how to mine this information from analytics and some templates for Excel with the formulas!
Here's a post or three to help you out (or just click the Analytics item under, Posts by Category on the right. Hint: Scroll up but let me know if you don't see it).
Find the ones that suit you. Pardon my full URIs but my comments form through Chrome doesn't have the wysiwyg.
So no pretty links or formatting for you!
https://www.seomoz.org/blog/overcome-the-google-analytics-learning-curve-in-20-minutes
https://www.seomoz.org/blog/how-to-measure-improve-seo-emetrics
https://www.seomoz.org/blog/google-analytics-event-tracking-to-monitor-calls-to-action
https://www.seomoz.org/blog/5-simple-google-analytics-tips-you-should-be-using
Mike thanks for pointing out those links, just whats needed fro me as well.
Great article JL thanks
now of to research a little further
Thats a really good point! Ill put it on the list of things to do :)
Also thanks Mike for shooting out some links! :)
Really nice article Joanna, thanks!
As many have said above, benchmarking is essential, but still a black box for many industries.
Would be nice if there was some sort of industry standard for it, for each sector (yeah... while I'm typing it, it makes me realize that that is impossible...)
Also, I like the stacked chart option, it indeed shows a lot better than line chart what's happening, so thanks for that tip as well! I would also prefer the box plot comparison as a favorite, since they aggregate the data beautifully over a longer period of time.
I think the concept of building benchmarks is awesome, but the implementation and goal setting is even better. We've long been the cobbler's children (missing our shoes) when it comes to our own traffic, but this process, and the segmentation of traffic to different areas of the site have been huge in terms of giving us a grip on what's driving value/revenue vs. not.
Thanks Joanna - great post. Can't wait to have you on the blog more regularly!
isn't it funny how that happens? My current employer's site has needed a redesign for years and now that design is done trying to get them to give feedback about the copy is like pulling teeth... I just love how my personal domain has more trust than theirs and they've been around for years. Billable work is all they want rather than setting some time aside to work on our own domain and letting me do link-building but they wont even try and solicit links from our customers. I wrote a query and pulled a list of all our billable clients for past 6 months with websites, analyzed them all in Linkscape and gave them list of our clients with strong domains and still no action.
Theres so much more we could do if they just let me spend some time... pheh rant over :)
Did you say, "billable" and also infer weak SEO on the home domain? Ahahahahahaha! You must be my brother from another mother.
Oh, wait! Someone might see this... Um, neo, I have NO CLUE what you're talking about. Perhaps you need to read more eBooks and stop talking crazy.
This is great stuff. I'm the biggest advocate of benchmarking. It's a shame there isn't an easier way to perform competitive benchmarking. However, with a little elbow grease, you can find a goldmine of valuable information by doing some introspective benchmarking.
Just a few quick tips I find useful.
Perform traffic source benchmarking in this same way. Break it down into direct, referral, by search engine, and break down referral into any significan referrers (if you have any). For instance, one of our e-commerce sites saw a relatively large spike in traffic around July 4th. By looking at this graph we're able to tell it was entirely due to direct traffic - a seasonal effect of return customers.
For e-commerce sites (and probably others), compare pageviews for your top level category pages, but also include pageviews to all of their content. If your category is category20.html, and everything inside it is in /category20/, compare all of these together on a chart. Being able to see that your Plastic Ear Tags page gets twice as many visits as your Metal Ear Tags page is good info. But if all the pages in the Metal Ear Tags category get 3 times as many pageviews as everything in the Plastic Ear Tags section, this is actionable information.
Great info and a fun post!
Both great tips MountainMediaMan. But you left out the biggest tip of all. Which do woman shoppers like best, plastic or metal ear tags?
Great post, Joanna. I love how, by segmenting the data, you were able to super sleuth issues w/ the site. They often don't show up when you look at data in aggregate.
And nice use of a stacked area chart. I have a gravitational pull toward line charts, but this really makes the data scream.
And the latte and data head references were priceless. Signature Joanna. :)
Ha thanks lady! I can't take credit for the stacked graph though, that was all Rand. I'm also a line-graph type of lady, but seeing the data this way really helped us wrap our head around the loss of the redirect mistake, and the gains from things like the Beginners Guide.
Thanks for your support during the #lateshift last night, glad I finally hit publish ;)
The stacked chart came into prominence through the turn-based strategy game Civilization. Until that time no one ever used it, ever at any point of time. Really ... never.
I'll keep buying Rand drinks (during the Pro Training social) until he admits that's where he got it from.
Joanna, your job will be to drive rand home on his motorcycle. I have a feeling that he'll play hardball.
LOL. I'm starting to see the big picture here Mike. You are a very twisted individual..are you sure we don't share the same lineage?
Let me check ... yes ... yes my nose is cool and wet. BROTHER cowboy!
Although, I'm more of a "beautiful mind" ( https://www.digitalmediatree.com/library/image/12/beautiful_mind_2.JPG ) rather than twisted. We'll revisit this topic over cigars and scotch (but no chocolate) at one of these e-Events in the near future.
Btw, what was the new section that drove traffic?
Nevermind, it was the beginers guide :)
Great article, seeing as I have just started messing around with GA--benchmarking is a great technique to absorb. I strongly agree with the "know the limits" portion--I have seen this happen one too many times in other fields outside of SEO.
To save some virtual trees, I won't rattle on and on about your awesomness, I'll just say " I agree completely with Gianluca (gfiorelli1)"
Analytics has been one of the more difficult things for me to get a handle on in the SEO spectrum of "to do's". And (no surprise here) you've clarified and made it easy to grasp some essentials in this post.
The one I'm going to start analyzing immediately is the bottom-line/high-line. Once I get a handle on that I'll move on to relationships on the radio.
If GA's benchmarking tool is a poor indicator of industry standards, what's the most reliable way to find out the norms in your industry?
Lovely post Joanna :)
Btw that redirect mistake is *clearly* visible there :P
Would you use the benchmarking for your own ongoing SEO stratagy for your client, as opposed to letting the client know the bench mark you have set and leaving the analytics to see what naturally happens after the initial SEO is implemented?
Both. Id definitely use it as an ongoing measure tho, it doesnt need to be a mark you set once
Stephen is right. On preliminary calls I would definitely inquire as to which benchmarks they use to measure success or failures, or just use as guides. If you feel that alternative ones can be more fruitful moving forward, its definitely your perogative to propose thought. Let's just hope they take it and run with it...not always the case! :)
Nice segments, thanks for sharing. Nice post Joanna.
Another really useful article which shows just how useful Google Analytics can be and also, how it probably isn`t being utilised as much as it should be. Being able to compare various specified results will give you a clearer insight into the performance of the website and also enable more accurate forecasting hopefully. So it`s a huge benefit.
Nice post. We don't see articles about benchmarking much because there aren't many tools to use in order to get accurate data about competitiors, but this is certainly a good addition. Also, I might have been lauging out loud in my cube while reading this (my coworkers must think I've gone crazy). Thanks for the post! :)