Admitedly, this is an ambitious list, but it's also a worthwhile one. Below, I've attempted to lay the foundation for every piece of website data available to marketers, researchers and the curious. Competitive analysis experts, welcome to data paradise:
Technical Data
- IP Address - via DomainTools Search
(e.g. SEOmoz - 204.15.225.178) - Other Sites on an IP Address - via IP Query at Live.com
(e.g. SEOmoz's - 204.15.225.178) - Server Type - via DomainTools Search
(e.g. SEOmoz - Apache) - Response Time - via DomainTools Search
(e.g. SEOmoz - 5.78ms) - Name Server - via DomainTools Search
(e.g. SEOmoz - dns1.dedicatedns.com) - W3C Validation - via W3C Markup Validator
(e.g. SEOmoz - we passed!) - CSS Validation - via W3C CSS Validator
(e.g. SEOmoz - validates) - Speed Report - via WebsiteOptimization.com
(e.g. SEOmoz, 23.44 seconds @ 56K - sadly, you can't link directly to these) - Use of Text - via Ranks.nl KW Density Checker
(e.g. SEOmoz's homepage has 662 total words, 336 uniques and "seo" is the most common, again you can't link directly to these pages; note - I'm not endorsing KW Density; I just appreciate their tool) - HTTP Headers Response - via Web Sniffer
(e.g. SEOmoz - 200 OK)
Ownership/Hosting Data
- Whois Data (registrant, registration date, contacts, etc.) - via DomainTools Search
(e.g. SEOmoz) - Additional Sites Owned/Registered - via DomainTools Search and Alexa
(e.g. SEOmoz @ DomainTools & SEOmoz @ Alexa) - SSL Certificates Issued - via DomainTools Search
- IP History - via DomainTools Search
- Hosting History - via Netcraft
- Whois History - via DomainTools Search
(e.g. SEOmoz)
Statistics/Popularity Data
- Alexa Rank - via Alexa
(e.g. SEOmoz @ Alexa - 864th most popular site) - Alexa Reach - via Alexa
(e.g. SEOmoz @ Alexa - 1395 per million users) - Alexa Page Views Estimate - via Alexa
(e.g. SEOmoz @ Alexa - 2.7 per user) - Google Trends Data - via Google Trends
(e.g. SEOmoz - no data; only available for highly searched-for domains) - Compete Snapshot - via Compete.com
(e.g. SEOmoz - 5854 visitors in August, ranked #204,215th most popular site; no direct linking in) - Ranking.com Rank - via Ranking.com
(e.g. SEOmoz - 26,741st most popular site) - Netcraft Ranking - via Netcraft
(e.g. SEOmoz - 20,319th most popular site) - Bloglines Subscribers - via Bloglines Feed Search
(e.g. SEOmoz - 448 subscribers)
Search Engine Indexing Data
- Google's Indexed Pages - via Google site: command
(e.g. SEOmoz - 18,400 pages) - Yahoo! Pages Indexed - via Yahoo! Site Explorer
(e.g. SEOmoz - 5,432 pages) - MSN Pages Indexed - via Live.com site: command
(e.g. SEOmoz - 11,416 pages) - Ask.com Pages Indexed - via Ask
(e.g. SEOmoz - 362; note that this requires an additional term in the query to return results) - Gigablast Pages Indexed - via Gigablast Advanced Search
(e.g. SEOmoz - 1 page) - Exalead Pages Indexed - via Exalead
(e.g. SEOmoz - 5,481 pages) - Clusty Pages Indexed - via Clusty Advanced Search
(e.g. SEOmoz - 5,867 pages) - How this Site Looked in the Past - via Wayback Machine
(e.g. SEOmoz - all the way back from February of 2005)
Link Data
- Yahoo! Link Data - via Yahoo! Site Explorer
(e.g. SEOmoz - 187,234 external links) - Technorati Link Data - via Technorati
(e.g. SEOmoz - 8,961 links from 2,541 blogs) - MSN Link Data - via Live.com
(e.g. SEOmoz - 107,512 external links) - Google Link Data - via Google (note that this information is purposefully inaccurate)
(e.g. SEOmoz - a uselessly erroneous 2,370 links) - Google PageRank - via RankAlert (shows for all 72 datacenters)
(e.g. SEOmoz - PR 5/10 or 6/10 depending on DC) - Exalead Links - via Exalead
(e.g. SEOmoz - 4,308 external links)
Social Tagging Data
- Bookmarks at Del.icio.us - via Del.icio.us
(e.g. SEOmoz - 31 pages, thousands of bookmarks) - Pages in StumbleUpon - via StumbleUpon Reviews
(e.g. SEOmoz) - Mentions at Digg - via Digg Search
(e.g. SEOmoz - 50+) - Mentions at Reddit - via Reddit Search
(e.g. SEOmoz - 21) - Mentions at Tailrank - via Tailrank Search
(e.g. SEOmoz - 8) - Mentions at Newsvine - via Newsvine
(e.g. SEOmoz - 1)
Third-Party Trust Metrics
- TrustGauge Rank - via TrustGauge
- Better Business Bureau Listings - via BBBOnline.org
- Truste Sealholders - via Truste Member List (sadly, no search function)
Important Directory & Site Listings
- Listings in the Open Directory Project - via DMOZ
(e.g. SEOmoz - 3) - Listings in Wikipedia - via Wikipedia Search
(e.g. SEOmoz - 12) - Listings in the Yahoo! Directory - via dir.yahoo.com
(e.g. SEOmoz - 1) - Listings in MSN's bCentral - via bCentral
- Listings in Business.com - via Google Search (as Business.com has none of their own)
- Links in Google Groups - via Groups.Google.com
(e.g. SEOmoz - 134)
Press & Media Mentions
- Listings in Google News - via news.google.com
(e.g. SEOmoz - 8) - Listings in Google News Archive - via archive search
(e.g. SEOmoz - 58) - Listings in Yahoo! News - via news.yahoo.com
(e.g. SEOmoz - 13)
Wow... That took a bit longer than I expected and now it's 2am... You'd think I'd learn not to start ambitious blog posts at midnight. So, dear readers, any others to share?
p.s. I almost forgot that today is the SEOmoz blog's official 2-year anniversary. Happy B-day blog :)
Nice list Rand! I still haven't read through the comments but have another one you may want add to Third Party services:
https://siteadvisor.com
Lists a trust value for the site, but also publicly displays known relations to other sites (either most known, or most notorious if you are a spammer). Check out all your properties and clients on it, you may be surprised at what is listed as a RED site or how they link to each other.
Great addition Roadies - thanks. Apparently, they like us :)
I'll probably never use all of these, but the one I did use helped me bunches!
Thanks!
Oh, Rand - too clever. In plain sight and all that. And a nice resource to boot. :)
Great to hear that you've done 2 years with SEOmoz - quite a remarkable achievement. You're doing great. :)
First, happy b-day/anniversary. :)
Now, on that Bloglines number, Rand -- when I look at your feed in Bloglines, it says you have 1,022 subscribers at the moment.
I see that the search link you included says 448, but even when I unsubscribe and then re-subscribe in Bloglines, it still shows you have 1,022 subscribers.
No clue why, but one of them has to be wrong. :-)
I'll send you a couple screenshots via e-mail of what I see.
Matt - I see the same thing when logged in trying to subscribe. I'm not sure why, either - it's very odd...
Probably worth mentioning for the newbies that the majority of the statistics are available from many places, basically all except the 'name brand' results - Alexa, Google, Netcraft, etc.
Oh, and happy birthday SEOmoz. May you have many happy returns :)
Congrats, Rand - and keep it up! Yours is one of the select SEO related blogs I'll recommend to others anytime.
And thanks for a great resources overview.
Ralph - I'm still checking your blog at least weekly, hoping for the day another entry appears :) Thanks for the kind words.
Happy birthday SEOmoz blog :)
great post Rand.
Great list. Do you know of a tool that provides aggregated information across the web at the page/topic level? For example, a ranking of what web pages were most visited in the last day (not the domain, but actual page)? Another form in which this may exist is in the form of trends - what is the most read topic aggregated across news sites, blogs, etc. Any help would be appreciated.
my chrome seo extension SEO Site Tools [install] pulls almost all of these data feeds and displays them in one easy to read place... i just created a google reader subscriber api and got the bloglines subscribers to dump as api too... ill publish code soon.
Thank very much i'm bookmarked Seo checker your website to high ranks
This is a great list, but being a newB,Can anyone tell me how to make use of this information? Is it just a way to check the heartbeat of your website? How does this information change the way you do things?
love this list
Happy Bday SEOmoz blog.
Thanks for publishing this list. There are a few on here that I had never heard of. BTW: In case you all don't know, Rand is the nicest guy in SEO. That's the title I've given you since SES.
Now a slightly off topic but related question: This morning as I was coming to work, I was mentally putting together my game plan for an online analysis of a site that I have to do. While I have a list of tools that I work from to get a general snapshot, I find the best place for info is always in the SERPS. How do you balance time allotted to specific project tasks (especially for your staffers who have to complete these tasks) with time devoted to understanding a client's online industry within the SERPs (As SEOs we can end up spending hours in the SERPs and looking at competitor code)?
Excellent list. Bookmarked. One thing: you forgot incoming keywords from AOL. eg https://www.seosleuth.com/site/www.bbc.co.uk
Thanks Rand, great list, will be added to my favorites, congratulations on your anniversary.
Congrats on two years of providing us with excellent information. You do more than blog, you go above and beyond the call of duty and for that I salute you. Honestly Rand, I don't think anyone else comes close to providing the depth of information you and your colleagues have on this blog. Thanks and wishing you many more years of late nights and long posts.
Rand, thanks so much for that great list. Definitely going into the bookmarks.
Rand,
That's a brilliant list, and although I haven't yet had time to go through and try out any of the links, I'm sure it will be really useful.
Pure linkbait gold!
Rob.
Wow, that's a rather impressive list! I guess the next question is how to best use all of these resources (perhaps material for future late nights). Nice post and happy b-day to the blog!
All the best,
Moshe
Hi Rand,
First of all: congrats on a great blog :)
I recently made a Greasemonkey script to detect open statistics programs, it's now part of my every day practice to check if people use free statistics tools :)
Damn -- have I mentioned how much I lvoe you guys! Seriously. Great list and and thanks for sharing the wealth.
Alexa? Alexa???? Are you kidding me?
The rest of this is absolutely fantastic, btw. Thanks Rand.
Congratulations, and happy anniversary.
Congrats SEOmoz. Keep it up. Your website/blog is one of the best I've seen/read in the SEO web community.
Great stuff Rand!
here's a traffic guage I use:
https://www.trafficestimate.com/ example SEOmoz: Estimate 3,069,900 visits in the previous 30 days.
looks to be queued on alexa data, but it's nice to have a visits integer.
Nice addition.
Tested 2 of my sites: Site A: Real value: 947,000, Trafficestimate: 200,000 visits Site B: Real value: 27,000 visits, TE: 21,000
Anyone else got data on this?
Yeah, probably using Alexa. I entered some of my smaller sites and the estimated traffic was jacked up pretty high. I'd weigh in who the primary traffic is for a site (say... Internet Marketers that return data to Alexa) before spending any time checking that tool.
You only got one page indexed at Gigablast? You suck:.)
Seriously, a great list and a great resource.
Might want to add under "Technical Data" one that is updated more frequently than DomainTools. This is especially useful when you move to another server as the information is updated within minutes of nameserver updates.
Without further ado, I present www.dnsstuff.com.
Here are SEOmoz's stats. https://www.dnsstuff.com/tools/lookup.ch?name=...
(There are plenty of other features included on dnsstuff.com -- check the main page for a tremendous number of information.)
You can find more detailed statistics depending on the domain name.
If you ever mess up a DNS update, this will tell you -- the query will get stuck in a loop. :)
As a web host administrator, I consider this an invaluable tool and the first thing I check after making any changes to DNS.
Happy birthday SEOmoz blog!
Hi Randy,
2 full years of hard work and fun! Congratulations on the 2nd year anniversary.
Despite being middle of the night, your mind seems to be working 100%, pushing out the numbers above, and it seems that after the end of the posting, you're probably more excited and awake than before you started.
I like to work out my blog at night too, and normally end up sleeping at 5am in the morning (which happened just 1 night ago).
Cheers, Fione www.eOneNet.com - Internet Marketing Asia