Well here we go, you ready to jump into analytics, part deux? Just a heads, up this is the second post of a three post series. The first post, "So You Call Yourself an Analyst, Part 1: Asking the Right Questions, walked through ways in which you could reevaluate the questions steering your analytical efforts.
The tough love truth is that most marketers are not analyzing the right data. We have so many tools to help us "analyze," that most of us are sitting in front of our dual monitor set-ups, staring at reports, excel grids, and pivot tables wondering what the hell we are supposed to be seeing. This is analysis paralysis, and I am here to help talk you back to a place of insight and action.
#1 Anomolies take precedence
I get asked a lot, "where should I start?" Simply put -- start with the data that looks strange. The majority of your time should be spent on things that surprise you, things that concern you, and things that shift the momentum of your website's performance.
For example, last week at SEOmoz, I was pulling our weekly stats and saw this:
I saw that our Rank Tracker tool traffic fell of a cliff. #awesome. You can bet this was prioritized, and we spent the next hour poking around the data before realizing the tracking code had been implemented wrong during a site update. {facepalm} So how do you research these anomalies?
Analytics Intelligence is one of the more obvious places to start if you are using GA. It is under the "Intelligence" tab and allows you to set alerts for when your data goes "off pattern." It notifies you when numbers fall below or peak above user-set parameters. These notifications are controlled by a sensitivity gauge that you control, and when an alert is triggered you are notified by email.
The "Compare to" feature is another great way to see issues quickly. In GA you can compare two date ranges and see how they measure up, which is a great way to see discrepancies in otherwise stable datasets. You can compare the vital stats of any section of your site from one date range to another. I use this all the time.
(Example of "Compare to" feature, making drops in data, week over week, obvious)
There are a number of other ways to isolate out changes in your site's data, most of them involving things like manual benchmarking or daily monitoring. I know not everyone uses GA, but the two features above are a great way to see anomalies as they are happening, not after the fact.
#2 Align your analysis with your company's current goal(s)
Next up, you should turn your attention to stats that directly match up or feed into your company's goals. It should be noted that some analysts would prioritize this data to the top of your list, but I personally think that stable data is just that...stable. For that reason, I think only after you have problem data isolated out and understood should you turn your attention to "other data."
When I say "other data" I mean-- the data that will let your company know if its hitting its goals. It is up to you to know the roadmap for your company and isolate out data insights that help keep you on track. Once or twice a month I go in and "explore" but analysis, for the most part, should not be exploratory. So what are some specific features that can help you analyze key data?
Advanced segmentation is one of my favorite GA features. It enables you to quickly cross reference different metrics, dimensions, user types, and variables. You can save segments and apply them across multiple profiles, so if you have a key metric the whole company is watching and working on, they can easily log in and check progress with a saved segment. Here is a video on advanced segmentation if you are looking to get started.
Visualization of metrics is too often overlooked in my opinion. There is a number of visualization options in GA that allow you to see the data differently. I am a firm believer in viewing the same data set in a variety of ways, because in my experience it forces your brain to revisit relationships, trends, etc.
(Visualization options in GA, I particularly love bar graphs for gauging relationships)
Lastly, I do want to mention the weighted sort feature in GA, since it is so new, and a lot of people probably still aren't using it. After months of asking for it, GA gave us the ability to take a metric in list view and "freeze" it so we can apply a second filter. If you don't have GA, Dr. Pete shows us how to create your own here. This helps us analyze only data with the greatest impact.
#3 Not all data is good data, know when to move on
This is a tough one for a lot of analysts. It can be a "data-head high" to get into the numbers and spend hours trying to prove a hunch, but it is important you know when to walk away. Yup, that's right...I am telling you to give up, throw in the towel, wave the analytical white flag. You can't change the numbers. You just can't. Sometimes the analytic Gods will win, and sometimes you will, let it be and move on.
What are you left with?
The data that matters. The hardest part about analytic packages like GA, Omniture, and others is that there literally is an unlimited supply of data. By using company goals to prioritize your analysis and using all of the features at your disposal, you begin to see that pile of data take shape.
Repeat after me friends: "I will only spend time on data that will return the love."
Next week I will finish up the series with the third post focused on applying value to this key data and using those values to help decide on action steps. I will also wrap up the series with some examples of how an analyst can better present all of this data to those that need to see it. I will try to keep it shorter than this week's post, but no pinky swears on that one.
a nice way of presenting the results and measurements, thanks :)
Great Post. Can't wait for part 3. I am personally an excel junkee and can get wayy to intense with analyzing sheets of data when I need to simply step back and look at the bigger picture. I love the advanced analytic posts we have gotten lately as I feel to many SEO's don't pay enough attention to it. Hopefully one day it's integrated in the pro dashboard ;)
I will only spend time on data that will return the love.I will only spend time on data that will return the love.I will only spend time on data that will return the love.I will only spend time on data that will return the love.
Haha Great entry once again. I am looking forward to the 3rd!
Great post. The weighted sort is nice but still needs some work IMHO.
The intelligence alerts/reports is awesome especially when combined with #2 keeping an eye on goals.
Looking forward to the series finale!
Kudos on the inital post as well as this great follow up. Defnitely looking forward to the third part.
Reports are great as they provide visibility into a process that often looks like a shot in the dark. Two things should be taken into consideration:
Thanks for the great post. Looking forward to read more.
Its very easy to fall into the analysis paralysis, defining goals is always the smart approach. On to part iii
I read your Blog. It is very use full.
Best Regular Savings Accounts
I like your Saving account. Saving accounts is very use full.
I didn't comment on your first post so this comment is for both posts. You ROCK Joanna Lord! This series so far has been easy to read, easy to digest, and most importantly (for me at least) very motivating!
errata #1 - I realized too late that that was poorly worded. By saying (for me at least) very motivating what I meant was not that it wasn't motivating for everyone, rather for me I need to be more disciplined and focused on regular analysis and your posts were motivating me to head more in that direction.
For the record Joanna, your posts are always motivating. [/shoe in mouth]
I think the magic here is in segmentation. I'm always surprised by how little people use/understand them and still claim to be web analytics experts. If you know your audience, there's probably a combination of metrics within your web analytics package that allows you to isolate them. Aggregate sucks. Segments are great.
One last thought: does anyone else struggle with what to blog about when it comes to web analytics? I'm not talking about a lack of topics. I'm talking about how to present them. I'm always surprised by how niche the audience is and keep wondering what positioning will finally wake the greater web up to the importance of measurement.
I wouldnt say that the Web Analytics niche is small, its just that they arent as vocal as SEO for instance. Check out people like Avinash Kaushik, who have a huge audience, and do a decent job of blogging about analytics. Tom from Distilled who also blogs on SEOmoz does really good work on Analytics posts, and was recently a guest poster on the google anlytics blog.
Can't comment on the blogging Quagmire you find yourself in Josh, but as far as the segmentation magic you mention? It's all about segmentation baby. [said in my best Kojak voice]
Thank you Joanna. One of the biggest challenges I see when using any tracking software for a Web Business in order to align the analysis with the company's current goal(s) properly, is setting up the tracking right. What resource would you recommend best to find information on SETTING UP GOOGLE ANALYTICS TRACKING RIGHT? Thanks in advanced...
Oh very good point! I will prioritize a post on Setting up GA and make sure to include some resources. There are a lot more than there was just a year ago on the "auditing your tracking" front. Thanks for the suggestion, give me a little bit and lets see what I can get together :)
Problem is not just analyzing the right data but what to do with that right data. There is nothing much you can do with your data if you can't compare it with historical data. For e.g. just looking at the number of visits every day won't make any sense if you can't compare it with the previous day visits or week ago visits or site average. Same is the case with bounce rate, conversions, avg. time on site or any other metric.
If you really want to understand where your site is heading to then you need to start comparing. This makes Data comparison a very important part of analytics. 'compared to site average' is the most important comparison feature i can think of at present in Google Analytics. It can instantly visualize the performance of any metric in comparison to the site average. For e.g. you can instantly find out whether your keywords are underperforming or outperforming in comparison to site average. You can use this feature by clicking on the 'comparison' button (one of the 'view' button on Google analytics reporting interface).
'sitting in front of our dual monitor set-ups, staring at reports, excel grids, and pivot tables wondering what the hell we are supposed to be seeing', ain't that the truth... Enjoying a) the info you share, and b) the no-nonsense way of writing! Keep up the good work!
Great post. Very beneficial and very timely.
I recently wrote a similar post because I struggled with the top website metrics to share with senior management. I asked the question of my LinkedIn friends.
My friends shared a broad spectrum of answers. The commonality is that we all must determine what success means for us. Then, we can define success. Thus, page views might be valuable to company A, but company B values conversion.
Who defines success? Ask your customers.
Another spot-on post. In my experience, #2 is where people often go astray. The old saying, "That which gets measured gets managed" is crap when you are measuring 500 different things. Like you say, you have to pick priorities and those priorities should be closely linked to the measures that directly track the progress of your company's core objectives. It's all common sense, but the best advice is often the simplest. I'm looking forward to the grand conclusion.
Another interesting analytics post. We are definitely not doing all that we can with GA at the moment.
I have a question maybe someone can help me with...what's the easiest way to track changes in long tail traffic? For example, if I sell sports equipment, including kids' skateboards, how would you best isolate the increase in searches containing "skateboards" within the keyword phrase?
Hey there! Trackign long tail traffic is certainly one of the more frustrating things to do in GA. I know a lot of people that export lists of long tail keywords and manipulate in Excel, but another way would be to create a "Long Tail" profile in GA, then apply filters that exclude head terms, brand terms, etc. You should only be seeing the long tail traffic when you log in. This may be tricky to keep up, as you would have to constantly revisit the set filters, but it would certainly work if you kept up with it. Hope that helps!
Hi Joanna - Thanks for the ideas!
I too love GA, but the best parts of the post, in my opinion, were this:
"The tough love truth is that most marketers are not analyzing the right data. We have so many tools to help us "analyze," that most of us are sitting in front of our dual monitor set-ups, staring at reports, excel grids, and pivot tables wondering what the hell we are supposed to be seeing. This is analysis paralysis, and I am here to help talk you back to a place of insight and action."
...and this:
"This is a tough one for a lot of analysts. It can be a "data-head high" to get into the numbers and spend hours trying to prove a hunch, but it is important you know when to walk away."
I've "suffered" from Analysis Paralysis for years, and I know plenty of engineers, consultants and business owners that should take 20 minutes or so to read those 2 paragraphs repeatedly (and maybe even rewrite them on the proverbial chalkboard like Bart Simpson). :)
Thank you for the interesting post!
I feel like starting my working day with digging into some GA accounts and comprehend some tips of you!
Looking forward to the 3rd part!
Thanks for the post, it's good to hear another viewpoint. I definitely agree with what you are saying about viewing the data in a different way to make new connections, but don't forget about the 'Visualize' button all the way up at the top of the page.
I recently wrote a post about these motion charts explaining the value they can add, especially for those who hate staring at tables of numbers!
#2 Align your analysis with your company's current goal(s) Gets my vote over and over again :) interesting data is great, but with the data rich culture we operate in at the moment means you ned to piece meal the information out in actionable chunks.
(excellent work on the series btw!)
#2 Align your analysis with your company's current goal(s)
What's really problematic is when the company has no goals other than "We want to make more money"
Great post! As per usual ;) Thanks!
Thanks lady! Glad you liked it :)