But before I dive into the new tool, as is traditional, some numbers:
- URLs: 39 billion
- Root Domains: 55 million
- Subdomains: 208 million
- Links: 443 billion
More interesting is an Index Quality Study we finished just before this update. From that study two things are immediately interesting to me.
First, we estimate that between 60 and 70% of what Y!SE might give you (including no follows, duplicate links) are in our index today (the small one, remember?). Moreover, we estimate that nearly 50% of what Y!SE will give you, we could too, but we filter out as duplicates, nofollows, or otherwise less important than other data we've got in our top 3000 links.
Next we've gotten a lot of feedback about how mozRank matches intuitive understanding. Sure it's a 10 point scale, similar to Google Toolbar PageRank, but often people are finding it's off from what they're expecting. This is because of the data we've been optimizing our index for:
In the past we've been concentrating on a more or less random sample of pages users might care about (the red bars). As it turns out, you guys care a lot more about important pages and want mozRank to be focused at describing the authority of these pages (the blue bars). So we've dramatically shifted the focus of mozRank toward these pages. Hopefully you should get a better experience out of mozRank and mozTrust for these high authority pages and sites.
We have more data for partners and power users. PM me if you're interested.
Finally, here's the new competitive link tool. (I know you guys already took a peek at it!) The idea is to identify authoritative sites and communities you could get links from, but don't already.
What we do is take your site, and up to five related sites (maybe competitors). From those we find all the links the related sites have, and find the common ones. From that we create a check-list. These are the big important sites your industry is engaging with, but you aren't.
Of course, there's no reason you shouldn't be able to get some of these endorsements too. I mean, you've got great content, products, tools, and services. Users want that stuff. Google, et al. want to deliver those search results.
So go check out your latest updated data, our new tool, and stay tuned for a Linkscape FAQ adapted from my PRO training slides. That's a little something for those of you who couldn't make it to the seminar :)
Thanks for releasing great tools. Lot easier to find great links with better Moz rank & competitors links.
@Nick Gerner : A small sugessition:would it be possible to have export option (to Excel) competitive link finder.
It's lot easier to send out a client report on the links we found & submitted, easy to pass around internally!!
As some one mentioned I almost misssed the Next link! I know it's still in Beta!!
Yeah, this is like a proof of concept based on the beta version of Linkscape :P
Export to CSV is a really good idea. Let me see if I can expose that in a couple of weeks :)
Thank You Nick, Appreciate your reply :)
I've heard some comments and questions about showing zero links. The way the tool works is to only show you sites that link to at least competitors. So if you only enter yourself plus one competitor, you'll get zero links.
Try entering 3-5 SERP results as your competitors and you should get great results!
Linkscape and the tools that are being derived from it is absolutely incredible. I truly am grateful for the pro membership - well worth the money. I just wish I could stop competitors from getting in!
Nick- Great presentation at the seminar. I love the fact that the new top pages tool features header status codes- this will prove to be invaluable to Pro members. Keep up the good work!
Finally got around to checking it out. It's already been said many times above, but awesome tool. Even seasoned link builders keep looking for fast ways to ascertain link opps and this sure helps.
Nice Nick, Nice!
I really like the way the # Links link expands to show which pages on the domain are linking.
Could you make the # competitors value a link too so we can see which of the 5 competitors have those links? :-)
Nice idea. I might do a refresh of this in a week or two (I think Rand wants to do a blog post about it). I'll see if I can get that in for that.
This is a great tool! I always check SEOmoz when I come into work in the morning to see what's new and this was a nice surprise.
I'll be chasing people who 'owe' us links for days to come.
I think link-intersect might be one of the most valuable seomoz tools yet. It provides immediate insight into the most important link opportunities that you are currently not capitalizing on. Doing this manually before this tool was a pain. Now, it's easy peasy. Awesome.
One more incentive to go pro if you're not already.
Thanks but I don't think we can rely on these kinda tools
Nick,
Thank you ever so much for the acknowledgment. I was blown away to see my face on the screen during the SEOmoz conference.
Now, for everyone who read my original post and complained that they use a Mac or do not know Microsoft Access, I think that Nick deserves a big round of thanks. Brilliant work Nick!
Tom Schmitz
Thanks for the support and creative thinking Tom! We certainly appreciate people sharing neat ideas.
And it helps when it involves our tools ;)
But seriously, thanks!
Awesome tool Nick! I'm going to try in the next days... good job SEOmoz!
This thing is sweet.
And not a big deal but on the form page the changelog gets overlapped by the black footer and the content 1.5em border-bottom.
Thanks for the sharp eye. I'll see if we can get that wrapped up in the refresh.
...if I can get some bandwidth for a labs refresh ;)
One of the most effective tool from seomoz. I use it often and find it really useful. Thanks for sharing this tool with the PRO members especially.
GREAT TOOL. Thanks for making PRO membership even more valuable.
I guess I need to become a Pro Member to play with the cool tools. I think this should help boost membership to SEO Moz as free tools for competitive link analysis become less dependable and filled with duplicate results. Good work as mentioned the interface could use a few tweaks and knowing which competitor sites your cross referencing would be helpful as noted or if you could pick your own sites even better.
Wow, this tool will make life much easier, plus it can help me not miss any high authority links.
Great work SEOmoz, thanks a lot!
I took few websites as examples,
seomoz, searchengineland etc, no problem
but when I tried expedia and lastminute, it doesn't show anything.
Would anyone tell me the reason?
Rui - I'd suggest plugging in at least two competitors to see results. Since it has to look at the delta/overlap between them, you'll need more than one.
I've already added a note to fix it so it won't run without 2, but that'll probably end up in the refresh in a week or so.
...if all goes well, but it's just a Labs prototype ;)
This tool is pure awesome. Great work guys. The first run found a great opportunity for a prospect we might be working with soon. Guess that kind of information makes it a little more likely!
this tool is the perfect toy to give to an SEO that's back to work with the holiday blues. I did a preliminary test on a clients site and their competitors and got some excellent intellegence to keep in the records for further work.
I second Richard's wish for links on competitors numbers as a 'nice-to-have'feature, but the tool is just great as it is
At first I was a little disappointed with the competitive link finder:-( I ran a report for a site with 3 competitor URLs and it only gave me about a dozen or so sites to check out that I mostly already knew about and could not take action on.
Then I ran one for a client and used 5 competitor URLs and WOW! I had to stop after the 3rd page of results and will pick it up again later. Very Impressive:-)
Cheers!
FYI - I almost missed the "next" link that leads to more results. Consider highlighting this a little better for those of us that don't always take the time to look around the page as well as we should:-P Maybe a 2nd set of prev/next links below the results?
An extra set of prev/next links is a good idea for sure. I'll wrap this into the refresh I'll do if I can get some extra bandwidth ;)
Ah...this tool is great! I've just spent the last hour checking it out. Awesome! Yet another reason to keep coming back, and stay a PRO Member.
Thanks guys!
Great work, its great to test clients sites to see how the work has made an impact since the last update.
It does appear to show that my initial observations of some clients websites PR being updated as they have significantly improved their Mozrank and DomainRanks.
I suspect its only a matter of time before the upcoming Google SERPs/PR suprise maybe they have caffine ready earlier than planned?
We expect a shift in mozRank in this index because of our focus on higher authority sites. In the past we feel like we've been underestimating the authority of important sites and overestimating the authority of unimportant sites.
So be careful judging changes index-to-index. Make sure to compare your standings against your industry to see if just you shifted up, or if everyone shifted up.
Linkscape is a data repository and toolset built by SEOmoz that contains a frequently updated, 54+ billion URLs index of the World Wide Web, similar to the indices used by the major search engines.Its really a great tool.Nice Post.
Cool looking tool, very small data set though.
Also would be nice to see more data about the linking page, like MR, PR, # of External Links
For the competitive link research tool, we go "top" 5000 links deep for each competitor today (to get it to run fast), so yeah it's a somewhat small dataset. As the feature matures we're gonna go way deeper to get the even better stuff.
Is that what you mean?
If you mean index coverage I've got two points:
1) Fair enough. We want to be bigger too :)
2) Holy crap man, we've think we've got 60-70% of what Y!SE exposes, but we're showing a better slice and more of them :P
Just by the way: I hope you all will continue to hold us to high, high standards :)
i really need to get my boss to may for pro membership
also i think its funny that like all the comments are from pros or people wanting to buy pro membership
Looks pretty cool -- almost cool enough to make me want to become a paid member.
What differentiates this from other tools that do the same thing?
Good question :)
We're running off of our own crawl of and index of the web. This means a few things:
We're going deeper on each of the sites than you could do with a similar tool based on, for example, Yahoo! Site Explorer.
We're dropping nofollows, and prioritizing the links so instead of a sample of 1000 links, we're looking at the very most important links for building a strong link profile.
Thanks for the explanation. I'm almost ready to pay. :)
Is there any way to see who thumbs you down? Somebody keeps doing that to me, and it's starting to annoy me.
Sorry, they're anonymous.
That said, I do want to say that's much better form to both thumb down and provide some feedback in comment form. The thumb stays anonymous, but the feedback to everyone (me, Jen, Rand, our members) is invaluable.
It would be nice to know what I said that was objectionable.