If you're anything like me, you spend several hours each month (maybe more often) preparing elaborate worksheets of ranking analyses to help uncover why a particular site/page is outranking another and what it will take to reach top rankings. Which is why the screenshot below has me pretty excited.
That's the first version of the new SERPs Analysis Tool, and, even in this early form, it's a thing of beauty. There's data on nearly every point I'd put in a worksheet comparing search results (social data and more sophisticated on-page analysis is coming soon). It's exportable to CSV so I can put the data into Excel and make cool charts and graphs, and it automatically generates based on any keyword set in a matter of 10-90 minutes (might be a bit longer this week since it just launched). Here's some more views:
Ever since Adam tossed out that awesome preview last month, I've been dying to play around with this. Now that it's finally here, I can almost feel the pain of manual SERPs analysis disappearing. Feel free to give it a spin and provide feedback. To get the full data, just run a keyword difficulty report and click the "run full report" button.
In the next few weeks, we'll have more data, some additional UI elements and a version in the web app, but for now, feel free to save enormous amounts of time + energy with this first version.
Of course, that's not all!
Linkscape's index is also updated as of Monday of this week (we accidentally had a brief rollback, but the correct data's out there now) and have some new analyses of our metrics correlations, too. This is part of how we measure whether our data quality is improving - on the whole, our correlations should improve over time if our index quality (what we crawl, how we handle duplicates, canonicalization, etc) is getting better.
The short story is that there's barely any change from the prior index from May (a couple metrics fell by >0.01), but we have improved somewhat from the figures presented in the ranking factors from late March (when, for example, Page Authority was as low as 0.28) . We've also improved the coverage of the index for URLs we found in Google's top 30 results across a large sample set of keywords from 84.27% to 85.59%. In the future, we'll continue to try reporting regularly on these numbers to stay transparent about our own data confidence and quality.
Here's the stats for the latest Linkscape update:
- 39,407,840,728 (39.4 billion) URLs
- 371,306,396 (371 million) Subdomains
- 119,104,781 (119 million) Root Domains
- 397,844,228,049 (397 billion) Links
- Followed vs. Nofollowed
- 2.28% of all links found were nofollowed
- 56.81% of nofollowed links are internal, 43.19% are external
- Rel Canonical - 7.91% of all pages now employ a rel=canonical tag
- The average page has 60.67 links on it (down from 61.00 last index)
- 51.50 internal links on average
- 9.17 external links on average
This index also features the first time we're treating the rel=canonical attribute like a 301 redirect. After several tests internally and observing the search engines' relatively liberal handling of rel=canonical, we feel this is the best behavior from a link-juice / metrics calculation perspective. You'll still see these as regular "links" in Open Site Explorer for now, but we plan to update to show rel=canonicaling pages with a special notation (like a 301) in the tool soon.
Enjoy the fresh link data, the spiffy new SERPs Analysis feature and let us know if you've got feedback or suggestions.
p.s. The new tool is PRO-only, but if you want to give it a spin, there's this spiffy free trial thingy we've got going :-)
This is awesome!
Can I suggest you can add a url to also track for example say my site is ranked 13th I,d want to show the top ten serp results and then my site at the bottom and its rank and the serp details.
Cheers
Thanks for the suggestion! This is right near the top of our list for the next update to this feature.
Great minds thinks alike and all that :)
I'm glad I skimmed through the comments as this was going to be my request as well. This would be a great addition to add an "11th" row so that whereever our page ranks we can have a side by side of the top 10 and just how far or little we have to go to get there. So add me to the list of people wanting this feature.
Thanks
Glad to hear it.
I love it! You just made our job's so much more productive!
We use to do a lot of this on spreadsheets! Now... can you get Google to provide a paid customer service number?
Long time user, first time poster! After using SEOmoz tools for so long, i HAD to post for this. Rand, this is a beautiful tool. You guys continue to amaze me with your passion for displaying SEO data! Thank you and all of the SEOmoz team for your hard work. When it comes to SEO there aren't enough good guys, but you sure are one of them! It makes me proud to be a PRO user :)
I'm confused as to where the full report shows up. Do I need to leave the page open until it's done (been about 20 hours)? Do I need to refresh the page?
New tool looks great Rand, after having some serious issues with the likes of Market Samurai recently this tool will be a perfect replacement.
Great work SEO moz team =)
Agreed...market samurai is getting worse and worse
Will it have a feature where we're able to manually add a URL that we want to compare with the SERP data is pulls down similar to market samuari?
LOL, I'm sure the early release had nothing to do with serpIQ hitting the market last week.
I've never even heard of this. After some basic research it looks like "SerpIQ" is based off linkscape data anyway.
Naw, we just threw that on there because seomoz was good enough to make it readily available thru the API (I personally don't put much stock at all in those parameters but the developer feels otherwise, he's got the codebase, he makes the call). The heart of the system scrapes more than a dozen other sources, some proprietary, some public, all the relevant (causation or correlation?) social factors, big 3 search engines, DNS, domain age, Alexa, allows you to compare a select URL against the top 10...fires off a report in 20 to 60 seconds...50 searches per day...etc.
I didn't want to come back and shit on this thread until I saw the linkscape reference, just had to set the record straight, you guys will sell 1000x more subscriptions with your brand authority anyway...at least your tool will be better than Shoemoney's...eventually. :)
I was thinking the same thing Grind!
Awesome Possum! I just got in an aurument with my girlfriend, but after reading about this, I feel 100% better! I am currently running a full report. This Webapp is almost too good to be true.
She is a thing of beauty.
That she is.
I dig the free version at the bottom of the report. Great update! Can't wait to try this out for real in the near future.
Looks like and awesome tool. i have messed around with multiple SERP analysis tools and haven't seen one as streamlined at this. I also love the fact that you can copy all of the information into a spreadsheet. Other tools I have used, only copy the keywords which is no help to me. Definitely going to check this tool out, and hopefully it will prevent me from wanting to throw my computer every time I do analytic reports.
Awesome stuff. And thanks for the explanation... I saw that the linkscape date was updated a couple days ago but none of my values seemed to have changed. Figured if I waited a couple days you guys would sort it out :)
This tool looks totally awesome. Thanks guys.
It takes me much longer these days to get round to commenting on the moz. I really need to fix that!
Sometimes, alternative visialisations can help a great deal - a table is fab but a chart of those metrics would be sweet, too
I did some very early charting of mozData back in the day for this post - here's an example
https://seogadget.co.uk/wp-content/uploads/2009/07/external-mozrank-top30.png
Stellar work guys, stellar.
Thanks so much :) It's pretty exciting, I can't wait to view the report.
Sweet! Lovin' the new report! Thanks Moz team!! =)
There is one SUPER significant flaw in your Keyword Difficulty Tool. It runs the algo on top 100 results and what happens with such ranking is that for a lot of verticals we track it is showing 5 pages of same domain ranking #1,#2,#3,#4,#5 whereas in usual top 10 position that domain has only one listing.
Can you make it so it only lists the top 10 spots and does not run the filter based on top 100. Won't be using the feature unless you guys give us option to check top 100 or top 10. Because top 100 is so freaking flawed in Google it is not even funny.
Rand it would be great if you take a minute and look into it and show the results for top 10 and allow us to change between top 10 and top 100. As of right now the features are great but not something that can be used because results are from top 100.
thanks
These additions are really going to help speed up Competitor Analysis - thank you for your hard work, it is really appreciated.
It's all fine and dandy, but how much time is required for a deep report ?
Took a few hours for me - ran 3 simoltaneously.
Sweet, sweet automation... It brings a tear to my eye.
Watch. 10 years from now, SEOmoz is going to convert all its linkscape research into a search engine of its own. :-)
Great tool! Just released, but already one of my favorites...
Hey Rand!
This looks great, but sure resembles the excel tool I built for the LinkScape API...
https://seomoz.zendesk.com/entries/20053482-excel-interface-to-the-seomoz-free-api-from-businesshut-com
Obviously, yours is much more sophisticated and visually appealing, but as soon as I saw that first screenshot, I thought, "Hey! That's mine!"
Just kidding. This looks like a great tool, and I can't wait to start using it! :-)
- Jason
Certainly a real time saver. And it's only going to get better as you develop it.
Most of my complaints have already been raised above!
Looks like a great addition to the list of research tools.
I really LOVE that you used w00t! I actually had to send a link to the urbandictionary.com explanation of that the other day. It is a word that should be in everyone's vocabulary!
And I am extra loving the new MozBar. Kudos on everything that you guys do for us.
--Belle from InfiniteNine
By this article, i have come to know new tools for the seo ranking check and other seo resources. thanks
I would have to agree with Connections8: Market Samurai supplies SERP analysis data and visualizes SERP competition in an easy to understand way (Similar to SEOMoz Keyword Difficulty Tool). The MS tool produces results really quickly (within 45s) and utilizes Majestic SEO's Page & Domain backlink data. Unfortunately SEOMoz Page and Domain Authority data in not incorporated :(
I love the thorough SERP analysis the SEOMoz Keyword Difficulty Tool produces, but I still have to moan about the speed and scalability, but I’m sure that can be fixed with an API and would be worth the money ;)
My last point is a slightly more interesting: IP Location based SERP results.
Remember that Google SERP’s are automatically tailored to your IP address location. Search queries made from Sydney location can produce different SERP results than queries from Melbourne or Brisbane locations, especially for location or services related searches.
Both, Market Samurai and SEOMoz Keyword Difficulty Tool show the Pages from “Country” (In my case Australia) instead of my IP address location one (which in my case is Sydney, NSW). Thus we are getting the wrong SERP analyzed = BAD. I can already “see” someone writing a blog post about this topic :)
In the end of the day…I’m glad that the tools are coming out, but the key is in the little detail. Great initial work SEOMoz team.
If Market Samurai uses your computer to query Google, it is also probably getting affected by personalization. SEOMoz's scraper is user agnostic and, thus, is more likely to provide generalized results that are similar to what REAL surfers might see, as opposed to what you see on your local machine.
You have some element of truth/validity and therefore I always recommend using an internet provider with a dynamic IP address for your SEO work.
As for your comment on the latter topic:
“SEOMoz's scraper is user agnostic and, thus, is more likely to provide generalized results that are similar to what REAL surfers might see...”
I would have to disagree with your opinion because the “Default” Google SERP is tailored to the city location based on our online service providers IP address.
Default setting: The web (which is the “Default” setting - auto-detected and depends on my service provider’s city location = The SERP Joe Bloke sees AKA REAL surfers)
“My” Google SERP is: Sydney NSW (Auto-detected), which I can change the location if I choose to.
Or
Optional choice: Pages from Australia (which is the SERP Market Samurai and SEOMoz report on)
On the topic of personalisation, its going to be interesting times ahead. Especially if the same login behaviour which is happening with Facebook is adopted to Google services. And therefore personalised (Google account logged in) search results will be displayed on Google’s Search Engine or any other vertical search services they offer. But I think that is a whole differing discussion and whole different problem to solve ;)
Very good point made by PSV.
IF we see a serp from NSW (Google) it is going to be different to a report from (VIC)
The keyword tool does not allow you to change state by state, so if a client wants me to pull a report for Google NSW, then I will say I can not do it, as I can only do reports for AUS.
OMG! This is awesome. I was thinking, now how do I build such a tool myself - collating all sorts of data from your API and using Google docs or an open source interface? Well now I don't have to :) Awesome!!! Many thanks!
I saw this on my reports before reading the blog post. Very nice looking and very useful! Keep up the good work.
Awesome! this should save me and many SEOmozers a lot of time and effort.
I know it's fairly new but I have a couple of small suggestions:
- Make it clear that "Full Report" costs only 1 Credit since maybe some people "including me" might think it costs more.
- Make a link back to the Tool main page on "Recent Reports" & "FAQ" sub pages which should make things a little easier.
Again, thank you so much!
Good suggestions! Thanks much.
This.... Rand was the missing link!I am very excited about this and hope the results correlate well.
Great tool, just what I wanted. Recently I started a spreadsheet with the API to get the same info but now problem solved, don't need to write the script.
Excellent. I'm really looking forward to taking this for a spin. Be great to see a video to take us through all the new features and applications we haven't thought of yet!
Sexy addition to the keyword tool! What are the different credit allotments for each tier of pro membership?
Good question - I'll see if Adam can dive in to answer that. I know it's 50/month for PRO, but that might just be an intro limit while we load-test.
For the moment the limit is 50 reports per month across the board while we learn more about how people use the tool. We will be looking at increasing this limit over time.
Noticed that the full report (csv) has more columns, but less rows of data than the regular report. Will that be expanded at a later time? Find it useful when you can look at more than just the top 10, maybe the top 25 consistently across the board would be nice.
I bumped into it by accident and thought "Ooooh! Pretty"
Looks great. I'll be drilling down on one of my sites for a Action Plan tonight. So great timing.
Whoohoo! It's getting easier to build a niche ranking model! Rand, will these future web app reports include all the same data as the linkscape API?
Whoa! Great tool, thanks all!
time for some testing :) looks great so far
Yes I agree with you Practicalseo.... Time will tell how much effective it............ But it is quite true looks awesome...
Thank you for sharing this with the SEO community. It sounds like a very exciting tool Rand!
Is the tool actually fully operational? I ran 2 reports yesterday and have not received any reports yet.
Thanks!
Operational, just slow. If you don't receive anything within 24 hours, let us know via [email protected] and we'll take a peek.
Seems good many Congragulate to all PRO members..
Great tool Rand but I've a question...
For Google.be, which language do you use? Because there are 3 differents languages in this country : french, dutch and german
Thank you for your answer
Jon
Hi Jon - it looks like we use Dutch, because it's Google's default: https://www.google.be/search?q=seo We definitely need to provide some multi-language options to query Google in different languages inside a TLD. If you can send an email to [email protected] with what you'd want, we'll try to get on top of that!
We've got plans for this in the web app in the coming month, but I'll make sure we look at this for the keyword difficulty tool too!
Sounds good but two questions -
1. How long will it take for a full report to happen, I have one going now been waiting 30+ minutes.
2. What is currently happening with the OSE, It seems to be very laggy and some times not even work for several hours is it a case of too many users using OSE??
Thanks.
Hmm... It might be a bunch of API requests to Linkscape, or it could be a connection issue. If you're seeing unusually slow load times in OSE, please email [email protected] so we can record your location+time and try to figure out why it happened and get that fixed!
Actually digging into this, when I click on full report, I'm not getting those tabs; URL metric, On-Page Optimization etc. It says: Full report in progress, request made... and a credit has been used.
Do we have to wait for report to process before tabs become available?If so, what is the usual turn around time?
Note: running queries on google.co.nz
Many thanks.
Yes - the "full report" can take up to 24 hours to complete right now (usually much shorter). That one contains all the many tabs, the exportable CSV, etc.
Just ran into this myself. I knew someone would have asked already :)
Looking forward to seeing the full report!
Thank you for doing some of the heavy lifting for us! This is a BIG time saver.
This is really an exiting tool!
I started running the full version yesterday - and I didn't get any results yet .... is this durability still "normal" ?
Talked to some folks here - sounds like it could take up to 24 hours in this test period (but usually is faster - I was able to finish a few reports in 1-1.5 hours).
Well done again SEOMoz team. Well Done.