Number of pages crawled by the Search Engines on https://www.urlremoved.com 03/22/06 are listed below.
Slurp: 41604
Googlebot: 2577
MSN: 20974
Teoma: 200557
It's a useful report to figure out how many pages the bots have grabbed the previous day. What I find interesting about this report is the breakdown in traffic from the various engines...
Slurp: 31%
MSN: 17%
Google: 8%
Teoma: 0%
That's right...the search engine with the most crawls also produces the least amount of traffic.
It also begs the question - Does Ask have better spam filters than Google?
G-Man
Who is this G-man fellah? He sure is a lively one! ;-0
Rand, it appears that someone has crushed your head.
Ya, i think they do. I keep getting weird mails all the time in my spam folder. To read more about SEO visit (edit from Rand: I tried to spam SEOmoz with the URL: ensure.co.in/articles/search-engine-optimization/index.htm)
Remember that most spam pages are getting links from places that aren't in their topical neighborhood and don't get a lot of trust from the engines. Since Ask only recognizes "on-topic" and "neighborhood" links to rank a site, their filtering is going to be much stronger by nature. It's also hurting their reach, scope and overall relevance, IMO, particularly for long tail type queries, but then again, they're the only engine that ignores "nofollow" and yet they still don't have problems with spam like the other 3.
Barry (Schwartz) and I always talk about how Ask has this great algo, if they could just spider more content more quickly.
Yah, lemme talk to Rand about having some more linkbait on his tools page :P
G-Man
We love tools - just say the word!
Perhaps Ask has you pegged and has done a manual hand-job on you. "Hey, there's that G-Man again. Let's wipe that one out". Maybe you need to hide those footprints a little better. ;)
What script do you use for that? Something you would be interested in sharing?
I have always chalked it up to the unique way they rank sites coupled with the low amount of traffic they actually have. Honestly I get the same results with my whitest of white sites , so I don't think it has much to do with spam.
just my opinion of course..