As we all read last week, SEOmoz has released the second Linkscape index update of November, and with that came updated Domain Authority and Page Authority. Many of you probably noticed a change, either as a result of the broader crawl, or as a result of active linkbuilding you have been doing on your site or client sites.
The purpose of this post is to help us orientate ourselves around what our scores mean and how those might compare to other sites that we are aware of. Remember, Domain Authority and Page Authority are strictly link based, so the metrics can be influenced by either more links from more sites, or a few links from higher quality sites. One should remember, however, that Domain Authority and Page Authority are hard to directly influence, as they are a combination of 30+ data points and work on a logarithmic scale. As Matt Peters noted in his blog post called "Introducing SEOmoz's Updated Page Authority and Domain Authority":
Page and Domain Authority are machine learning ranking models that predict the likelihood of a single page or domain to rank in search results, regardless of page content. Their input is the 41 link metrics available in our Linkscape URL Metrics API call and their output is a score on a scale from 1 to 100. They are keyword agnostic because they do not use any information about the page content.
What I want to do here is provide you a framework through which to benchmark your site against others in your niche. I'm going to take a mashup of tools that are already available so that you can go forth and figure out if you have any new competitors in your SERPs (Search Engine Results Pages). Then you can go forward and dig deeper into those sites in your own way to decide how to beat them. Let's go!
Where Do I Start?
The first step to take is deciding which keywords you want to rank for. For the sake of a more complete view of your market's landscape and SERP competitors, I recommend finding at least 20 keywords that would be very valuable for you. I've taken fewer for the sake of brevity, so here are the keywords I am going to be using for this example:
First Tool - Tom Anthony's Competitive Analysis Tool
Some months ago Tom Anthony, one of our London SEO consultants (who grows a wicked mustache, by the way), dropped a tool that he says can help you do competitive analysis in under 60 seconds with the SEOmoz API. Take your keywords and plug them into the tool. You will receive rows of data on your competitors and will be able to see how your site lines up. For the keywords above, this is the data that we see in the sheet:
Full disclosure: I have no affiliation with any of the sites listed above, other than I buy from some of them periodically.
Note - you will need to make a copy of it and get your own SEOmoz API key in order for this to work for you. Full directions on how to set up the sheet are available on the original post as well. What is important to get out of this list is the list of competitors. From the data provided as well, you can see relatively where your site stands for the search results (or by simply including your site at the bottom of the list and enlarging the sheet to include your metrics as well).
Using the above metrics, if I was doing SEO for skichalet.com, I can see that my competitors to beat directly above me are the-house and Cabelas, but really I am gunning for Backcountry.com and REI.com, and I want to know how they are winning. Let's take this a step further and see why our competitors have a higher Page Authority or Domain Authority.
PA Correlation (thanks to Dr Pete)
Now that you have your competitor's DA and PA, and know roughly where you stand compared to them, you can begin to dissect why their PA or DA is so high. Remember, your metrics can be improved by either a) more links from more sites, or b) a few links from more authoritative sites. If you want to know why your competitor is beating you, I recommend using the spreadsheet in this awesome post about Link Profiling with OpenSiteExplorer. This sheet is useful because, according to Matt Peters, Page Authority is the highest correlated metric against a page's ability to rank well (from a link perspective). This sheet will give you a graph of the average Page Authorities of the sites linking to your competitors. After you have taken the data dump from OSE and plugged it into the sheet, you will get a graph that looks like this:
If you want to see your competitors distribution compared with yours, use this sheet, which will show you the two side-by-side like so:
Using this, you can see that while your spread may be similar, the competitor on the left has many more linking root domains (the scale is much broader). That's where you need to start.
DA Correlation
You may also find it helpful to see the overall strength of the sites from which your competitors are getting links and the spread of those Domain Authorities across their backlink profile. For this purpose, I built a spreadsheet based off the PA Tool from Dr Pete above. The steps are exactly the same, but instead of the Page Authority graph you receive the Domain Authority graph:
Right here you may come up against a shortcoming of OSE, in that with sites that have a lot of linking root domains you may not be able to get the lower DA links. So watch out for this.
You can grab the Domain Authority Sheet right here.
Final Secret Sauce - SERP Analysis Report + Excel
Finally, now that you have gotten a quick overall look at your competitors and know where you stand and what certain domain and page authorities mean for ranking in your niche, you'll want to make this actionable. The above graphs do not go specific enough to be very actionable, so now let's use the SERP Analysis Report (available in the Keyword Difficulty Tool) to put the data for your specific keywords individually (that you used at the beginning to begin finding your SERP competitors)
A while back I presented a spreadsheet that allows you to take the SEOmoz SERP Analysis Report and dump it into an Excel sheet, which then gives you a bunch of graphs showing you where your site is weak. I'd be remiss to not say that I took this idea from Jason over at BusinessHut who gave away the original spreadsheet before the SERP Analysis Tool existed. You can read the full explanation of this sheet over at my site in the post called Making SEOmoz's SERP Analysis Tool More Awesome, but essentially what you can do with this sheet is:
- Get your SERP Analysis Report for your keyword;
- Export the data to Excel;
- Copy and paste the data into the spreadsheet provided;
- Sit back and compare your site to the competitors to find where you need to improve.
Maybe you'll find that your overall number of linking root domains is way low compared to the others in your SERP:
Or maybe you'll see that your on-page targeting is off (which is great since DA and PA are only links based. Now you get a better site picture):
Get the spreadsheet here.
I hope this post has been helpful for you in finding where you compare against your competitors. Knowing approximately what the benchmarks are for your niche can really help with speedy link prospecting and qualifying your site against others.
For those of you who are interested, here are some popular sites and their Domain Authorities, just for a quick snapshot of the web at large:
Arts & Entertainment |
---|
Website | DmR | DA | PA | Links |
AllMusic | 6.55 | 92.77 | 93.86 | 168826 |
Art.com | 6.24 | 82.73 | 85.57 | 16493 |
Art Cyclopedia | 6.09 | 87.48 | 89.36 | 29686 |
AMC Theatres | 6.22 | 80.94 | 84.08 | 23760 |
Art.net | 5.34 | 70.06 | 74.96 | 3511 |
Shihad.com | 4.23 | 34.57 | 45.24 | 338 |
The Official Whitlams Website | 4.43 | 42.16 | 51.79 | 147 |
EntertainmentTonight.org | 2.92 | 14.82 | 29.02 | 9 |
Business |
---|
Website | DmR | DA | PA | Links |
Business.gov | 6.47 | 92.71 | 92.07 | 23179 |
Business.com | 6.17 | 88.11 | 90.05 | 48786 |
Prudential | 6.31 | 88.32 | 90.1 | 71326 |
Kansas Insurance Commissioner | 5.58 | 77.07 | 80.87 | 2155 |
WorldBiz.com | 5.21 | 52.25 | 52.36 | 1108 |
HRM Business Practices and Notes | 3.62 | 34.97 | 45.79 | 546 |
Chevron Corporate Solutions | 3.12 | 15.59 | 28.39 | 14 |
Economy & Politics |
---|
Website | DmR | DA | PA | Links |
The White House | 7.86 | 100 | 98.47 | 721707 |
Barak Obama | 6.59 | 93.45 | 93.3 | 150410 |
The Democratic Party | 6.13 | 88.2 | 89.79 | 88356 |
Republican National Committee | 5.78 | 83.22 | 86.01 | 36615 |
Democrats.com | The Aggressive Progressives | 5.39 | 72.58 | 77.05 | 57713 |
Iowa Democratic Party | 4.79 | 58.1 | 64.92 | 6883 |
Republican Party of America | 3.95 | 45.35 | 54.4 | 260 |
Vote Brian Sayrs | 2.88 | 14.81 | 29.01 | 9 |
Education |
---|
Website | DmR | DA | PA | Links |
Great Schools | 6.84 | 93.78 | 94 | 4176177 |
Guide to Online Schools | 5.56 | 77.64 | 80.02 | 76050 |
Khan Academy | 6.22 | 90.35 | 91.92 | 938626 |
OEDB | 5.42 | 68.01 | 71.26 | 540526 |
Online Education.net | 4.92 | 57.06 | 64.14 | 154700 |
Health |
---|
Website | DmR | DA | PA | Links |
WebMD | 7.2 | 97.79 | 96.63 | 283163 |
HealthWorld Online | 5.84 | 82 | 84.96 | 16882 |
Health.com | 6.29 | 88.08 | 88.42 | 54716 |
Men's Health Network | 5.58 | 74.3 | 78.58 | 4443 |
Healthy Child | 5.06 | 56.88 | 64.04 | 2222 |
Healthy Living Natural Foods | 4.56 | 50.91 | 57.89 | 1324 |
All American Healthcare | 2.87 | 13.35 | 27.79 | 8 |
Home & Housing |
---|
Website | DmR | DA | PA | Links |
U.S. Department of Housing and Urban Development | 7.37 | 99.6 | 97.2 | 353813 |
HGTV | 6.66 | 91.64 | 92.4 | 207110 |
RealEstate.com | 6.01 | 85.16 | 87.45 | 511320 |
HousingMaps | 6.43 | 71.22 | 76.02 | 9403 |
Get Decorating | 4.57 | 51.78 | 59.75 | 3858 |
Eastern Corner | 4.17 | 46.85 | 55.59 | 680 |
RentSpeed.com | 4.27 | 44.2 | 53.46 | 2779 |
WeBuyHouses.info | 2.87 | 13.35 | 27.79 | 8 |
News & Media |
---|
Website | DmR | DA | PA | Links |
CNN | 7.34 | 98.92 | 97.31 | 733484 |
Anchorage Daily News | 6.34 | 89.28 | 90.78 | 46456 |
News-Record | 5.97 | 79.89 | 83.18 | 15544 |
Happy News | 5.36 | 67.83 | 73.18 | 5590 |
News Directory | 5.06 | 67.05 | 72.47 | 2829 |
Napier Mail | 4.34 | 33.21 | 44.27 | 97 |
Kingsburg Recorder | 4.03 | 39.24 | 49.34 | 269 |
People & Society |
---|
Website | DmR | DA | PA | Links |
U.S. Department of Education | 7.43 | 100 | 97.23 | 222465 |
ConsumerReports | 6.8 | 96.4 | 94.73 | 92732 |
Consumer Web Watch | 5.77 | 71.68 | 75.91 | 1756 |
Consumerist | 5.48 | 90.83 | 80.67 | 40998 |
South Carolina Department of Education | 5.05 | 59.15 | 65.94 | 597 |
No Nonsense Self Defense | 4.64 | 49.68 | 57.99 | 1053 |
Inner Strength | 3.3 | 18.65 | 31.98 | 13 |
Acqua Beauty Bar | 3.93 | 32.38 | 41.81 | 34 |
Science |
---|
Website | DmR | DA | PA | Links |
National Oceanic and Atmospheric Administration | 7.28 | 100 | 96.95 | 377258 |
U.S. Science Portal | 6.1 | 91.3 | 92.7 | 37411 |
Sigma Xi, The Scientific Research Society | 5.86 | 78.05 | 81.66 | 14296 |
Association of Clinical Research Professionals | 5.44 | 69.87 | 74.85 | 9982 |
SciNet Science & Technology Search Engine | 4.29 | 48.62 | 57.17 | 2296 |
Cafe Science Dundee | 4 | 28.84 | 40.58 | 379 |
Society of Natural Science | 2.87 | 13.35 | 27.79 | 8 |
Sports & Recreation |
---|
Website | DmR | DA | PA | Links |
Fox Sports | 7.01 | 96 | 94.94 | 233064 |
Official Site of Major League Baseball | 6.18 | 94.87 | 80.73 | 25961 |
FIBA - Home of International Basketball | 6.08 | 84.9 | 87.4 | 88890 |
NCAA Football | 5.1 | 64.98 | 70.8 | 15148 |
Sports Illustrated for Kids | 4.8 | 81.06 | 61.55 | 338 |
North American Gay Amateur Athletic Alliance | 6.87 | 95.22 | 43.85 | 499 |
Swimwatch | 3.68 | 22.31 | 33.96 | 360 |
Technology |
---|
Website | DmR | DA | PA | Links |
Apple | 8.55 | 100 | 98.68 | 819356 |
Google Mail | 7.2 | 96.03 | 95.98 | 316922 |
Blackberry | 7.14 | 94.25 | 94.24 | 256136 |
Government of India, Department of Information Technology | 5.77 | 76.82 | 80.41 | 10390 |
Internet History | 5.46 | 73.74 | 78.03 | 2794 |
The Society for the History of Technology | 5.05 | 55.66 | 62.72 | 786 |
The Loop | 5.77 | 74.4 | 77.69 | 15103 |
Websites taken from Rob Ousbey's post and the Getstat Codex.
Being a great fan of Tom Anthony's Competitive Analysis Tool, this is an even more valuable post for competitive analysis!
Huge thumbs up!
Great post, John!
I'm thrilled to see you were able to use the STAT Codex to get the information you needed.
Thanks for the link love, and keep up this great writing! :)
-Rob and the STAT Team.
You got it, Rob! Thanks for sending me the list of sites you use so that I could flesh it out a bit more.
You guys keep up the great work over there.
Very nice post, John, and useful.
I personally would not limit the use of these tools just to Competitive SERPs analysis, but use it also when planning a link building campaign. Especially, using the Linkscape API, checking those related but not directly competitors sites that are below position 20. If the metrics are promising, they can be a potential link partner. Being below position 20 they are easier to outreach.
Gianluca - Great insights. I agree, when I am doing something like planning a linkbuilding campaign, I also look to the people on the 2nd/3rd/4th pages, because sometimes these people started doing linkbuilding but didn't keep at it. You're also right that they are easier to do outreach to.
Thanks for the comment as always!
Ooh c'mon, I don't make you punch some numbers into a spreadsheet! All you have to do is copy/paste those numbers :-)
But seriously, this is just the beginning. Now you get to do the hard work of helping your clients beat their competitors!
Would be great to see some features from these various tools being integrated into the seomoz campaign tools!Â
Heads up john - the links under the Education are missing https:// and are broken.
C'mon, John -- whaddaya mean, "I am gunning for... REI.com"?! I like REI's positioning and domain/page authority just fine. Though I may be a bit biased, of course. Anyhow, thanks for the mention and for supporting your co-op! :)
OK, seriously, great column. Thanks for walking us through how we can quickly and easily use the new and improved authority metrics to benchmark our sites. Really good competitive intel and data that I intend to put to use... this week!
Well I'm glad that I could make your job a bit easier and do the work for you!
On a serious note, I'm glad you enjoyed the post. I really hope it's useful!
There are lots of graphs but no real info. Could you please explain the practical experience of that this article is about? Also can not identity the purpose of exposing this info. Sorry for my ignorance.
I am still digesting this but I am confused about these two sentences near the top;
"Remember, Domain Authority and Page Authority are strictly link based, so the metrics can be influenced by either more links from more sites, or a few links from higher quality sites.
One should remember, however, that Domain Authority and Page Authority are hard to directly influence, as they are a combination of 30+ data points and work on a logarithmic scale."
Don't these sentence contradict. I know they must not but I am missing why not.
Dave
Is there a link for the side by side PA comparsion sheet? Doesn't seem to be linked in the article.
Really cool. Â I didnt get one thing. Are they linking domains to the homepage only?
Regards,
Hi,
Wondering if someone can help me.
On the final Secret Sauce - SERP Analysis Report + Excel section,...
It is not clear to me where I should put the data from Moz's Keyword Difficulty tool data inot the spreadsheet. It mentions the 'keyword beginner seo' tab, but it is not obvious where the data goes as they do not marry witht he table.
Can someone please help?
regards
Vlad
Awesome work John! We're getting scary-close to pushbutton competitive analysis. Wrap some additional logic around this data and we won't even need to look at it anymore. Â :-) Â
- Jason
Thanks! I agree that we are getting very close to push-button high level competitor analysis. You still have to put in the work to overcome your competitors, but this definitely helps in the analysis/benchmarking phase!
Great tips, really appreciated! All very tricky, so just making baby steps still..
Regards,
www.itpartcreations.com.au
Moustache pathétique
LOL I think it's a great Movember attempt!
Ohh c'mon John! You make doing SEO look so easy! Now I have to explain to my clients why I bill them so much when all I have to do is punch in some numbers in a spreadsheet... :)
Nice analysis mate, I remember we were doing some in depth analysis on a clients competitors a long time ago and they had a link on the whitehouse site, crazy too see hehe =)
Good stuff John! Â You just sent me down another rabbit hole for the rest of the day getting this setup and playing with my clients terms. Â Thanks!!Â
Very cool. Â The linking domains though... are they linking domains just to the homepage? Â Or the root domain? Â
On the first screenshot, it is actually the # of links to the ranking page, which in the SERP Saturation report is going to be the homepage. I need to update the screenshot. Thanks!
John,
I absolutely love this post. People need to start thinking of PA and DA as analytics that are as legitimate as Page Rank (in some cases even more legitimate!).
I know I'll be shunned from the SEO community for this, but I'm still not an expert when it comes to using APIs. Are there any good beginner API articles/resources you could recommend?
Also, because I'm a link builder at heart, I went through each of the links on this page seeing if any are broken. Turns out a few of them are (double check each):
Again, double check each because some of them were DNS errors and might show up for me but not you.
P.S. Do you think I could get a little link love at the bottom of the post in return? Never hurts to ask :D
@jrcooper check out this post on seogadget - https://seogadget.co.uk/links-data-excel-seomoz-api/ Very easy to follow beginners guide on how to use an API (follow the links to read the other posts too - all good stuff). With zero experience I built a URL metric scraper in Excel in a couple of hours so it's very straightforward.
I think these types of posts are brilliant that encourage you to experiment with tools, develop your own or build on other people's work, to better analyse the data that is specific to your needs. Thanks for sharing John, I'll be experimenting with your methods over the next few days.
I was wondering, do you know of any posts/research that examines how PA develops over time? For instance a blog post obviously starts out with PA of 1, but as link juice from the domain slowly seeps in and PA gradually improves there must be some sort of improvement in the amount of juice passed to any links fron that page. Presumably there must be some 'sweet spot' where a link is both mature and still considered fresh?
Thanks KathawayP! That's a great place to start for learning APIs for SEO :)
Because PA is solely an OSE metric, and because OSE isn't as big as YSE was or Google webmaster tools, you won't find any real studies on PA.
You're right in that PA does increase over time as more links point to the post. I see what you're saying for a 'sweet spot', but links don't have to be fresh to be great. Actually, 10 year old links are better than 1 month old links. Think of the SERPs in terms of freshness, not links. With that said, you want mature links, but they have to be from sources that Google trusts. For example, don't get a link from a piece of syndicated content on a spammy article directory site. Rather, aim for links from trusted publication sites (but getting those is a whole different subject :D).
Nice post, dohertyjf, I like the template you have provided in post. It is so huge that I need some time to undersatnd it. It would be great if you provide some more detail on that. :)