April 18, 2013: Check out the new search features in Fresh Web Explorer! You can now search for links to a root domain, and choose to include or exclude results from a specific site. Click on Show Search Operators to see more!
Have you ever wished you had an easy way to track all of your links, social mentions, and web citations in one place? If so, you're going to like the latest addition to your SEOmoz PRO account. Today, we are releasing a new beta product to our PRO subscribers: Fresh Web Explorer.
Try Fresh Web Explorer
Why did we build Fresh Web Explorer?
One of the most challenging tasks as an online marketer is keeping track of all the latest blogs, forums, and news sites on the web that mention your brand or site. Many of the tools out there can be frustrating to use and don't have the metrics, scalability, or features that I need to effectively keep track of important links and mentions. Google Alerts can be hit or miss. Topsy is terrific, but it only covers social mentions. Trackur, Ubervu, Buzzstream, and SocialMention all offer a unique set of features, but I frequently rely on a number of different tools to provide me with an instant look into mentions of the sites and brands I track.
We built Fresh Web Explorer to provide an easier way to give you a fast, comprehensive look at the latest mentions of and links to your content across the web.
What's different about Fresh Web Explorer?
Fresh Web Explorer (FWE) functions a lot like Open Site Explorer, so the interface will be familiar to OSE users. However, the data is extremely recent, and rather than just show you links, we grab full text content of articles, blog posts, forum threads, user comments, and other web content. FWE doesn't just show you links, but all term, brand, or phrase mentions as well.
FWE is powered by our Freshscape Index, which is a 30 day index of 4.3 million feeds (and counting). There's a new Freshscape index every eight hours, sortable by one week, two weeks, or 30 days of mentions. You can also sort your data by Feed Authority, our new metric created specifically for Fresh Web Explorer:
Feed Authority directly measures the importance of any feed on a scale of 1-100. It is a machine learning model that predicts the number of subscribers for a given feed and distinguishes among the many different feeds on any site. For example, it wil assign a lower score to a comment feed associated with a six-month-old blog post than the main feed associated with the blog. In this way, it is analogous to Page Authority, but applied to feeds. We currently use features extracted from crawling the feed (number of posts, post frequency, etc.) as well as Mozscape metrics to compute the score. Our data scientists are working to improve this metric, so expect to see some of the scores change as they refine the algorithm and introduce additional features.
Warning: We're going to get even more nerdy about Feed Authority for a quick second. The chart below shows the distribution of Feed Authority across the Freshscape index:
Approximately 25% of the index has a Feed Authority less than 2.0, with the other 75% having higher values. The feeds with low scores are mostly stale (no longer updated), have very few or no links, or have malformed XML. A similar graph for all feeds on the internet would have the opposite shape, with 75%+ of feeds having Feed Authority less than 2.0 (we confirmed this with a random sample of feeds from our Mozscape index). We minimized the number of low-quality feeds in our index by carefully building it from a set of high-quality blog directories and a curated list of feeds.
Smooth Operator
Bringing it back to using FWE, there are a number of operators you can use to customize your search:
In particular, you may find yourself making extensive use of the 'Match phrase exactly' operator, by using double quotes around your search term or phrase. This cues Fresh Web Explorer to only return results where your phrase of terms appears on a page exactly as you searched for them in FWE, rather than returning results where the terms may appear anywhere on the page and in any order. When searching on non-branded or very popular terms, using this operator may surface a more precise set of results from FWE.
Export FWE data to customize your reports
If you're inclined to mix and match this data with other sources, FWE provides you with the ability to export up to 10,000 mentions in the Freshscape index, in .csv format:
This export allows you to sort a large number of mentions by date found, Feed Authority, domain, HTML title, and URL. One of the additional fields available in the export that's not in the FWE web interface: the feed source where FWE found the page containing the mention. This can provide useful insight into why a Feed Authority score might be low, even though the page mentioning your search is located on a strong domain.
Getting agile with FWE
Fresh link and mention data have become critically important to online marketers. If you're engaged in link building and outreach, having the ability to quickly sort recent mentions by source and date can make a world of difference in quick outreach to build audience for your content or brand. If you're in the SEO trenches, you're probably all too familiar with how freshness plays a role in Google and Bing search results. If you've watched the meteoric rise of sites like
Buzzfeed,
Business Insider, or
Huffington Post, the formula to their success is pretty clear: Match content to the most recent user intent you can surface, then build links and social mentions to that content like crazy.
To get started, you can use FWE to engage in several high-ROI activities:
-
Find recent mentions in FWE where you aren't being linked to - On news publications and high-volume blogs, the quicker you ask the writer for a link, the better chance you have of actually getting it. It's much harder to convince them it's worth the effort a month later. An effective technique that increases your chances even more is to add something new to the content that increases its value or changes the narrative of the story.
-
Competitor analysis - Where are your competitors being mentioned? Are there feeds that highlight their content frequently? FWE is a good tool to build up your outreach list.
-
Content Strategy - FWE allows you to check on or keep track of a set of terms over time, and helps you get a sense for what type of content gets a lot of mentions, shares, and links. For instance, a term like "World Cup 2014" is already drawing significant interest as we get closer to the 2014 event in Brazil. Sites like Bleacher Report and Goal are already starting to stake out their claim in the SERPs.
FWE can help you make strategic decisions on how to create and focus both new and legacy content on this type of quickly evolving user search intent. Our engineers have put in a lot of work to make the Freshscape index, and we will be using it to power additional features in the near future.
Ready to give it a spin?
Try Fresh Web Explorer
Just like you, we're just getting started with Fresh Web Explorer as a new tool in our marketing workflow. It's a beta release, so we're making improvements and squashing bugs quickly. You can flag suspicious results within the application, and we will use that feedback to make adjustments to the index.
Please send us over any questions or comments you have, and be sure to check out the
Help video and FAQ.
We can't wait to hear how you're using it.
Oh, wow - it's fast! I use topsy alerts quite heavily - it's been the most usable /reliable alerts tool until now.
This query is instantly actionable: seogadget -url:seogadget.com
Show me mentions of my brand that don't link to seogadget.com - very cool!
Thanks! That's really good to hear. It's something we were really trying to get run fast and it was the focus of a lot of effort.
You're all going to want to add these three bookmarklets to your toolset:
Fresh Web Explorer Bookmarklets
These will allow you to check the current browser URL, Subdomain, or Both, in FWE.
Please contact me if you have any trouble while playing with them. I have tested all three in Chrome and Firefox without any trouble.
Whoa, that's awesome! Thanks Kane. :)
Thanks, Kane. I'm anxious to check them out. Sure appreciate it.
Boom!!
My mind just exploded thinking about the awesome analysis I can do with this new tool :)
Doesn't appear to be working. My first few searches only delivered forums that have sitewide links to a brand. That would be the first line of logic that I'd put in to make sure that the results are relevant.... if a link appears on more than 25% of the site it's clearly not happening in a new conversation.
if !($brandMentionCount > ($domainIndexedPages / 4)) {}
Hey Corey!
Thanks for the feedback - that's exactly what we want to hear! Since this is just beta for now, we're collecting all of this feedback to keep improving the tool.
I've added this to our list to review!
Thanks!
Carin
Sweet! Will look forward to seeing how this evolves.
Yes, big thanks for the feedback Corey. That's exactly the kind of thing we're looking to use to refine the modeling and provide better results.
Look at you Matt! Assimilation is complete. :) The tool is much needed and looks pretty great. I was just bitching about Google Alerts all over again last week - so couldn't be more timely. Great job!
Seriously impressed with its speed!
Is there any way to get country specific mentions? e.g. Its hard to monitor brand mentions if you are working on a UK site for a global brand.
Hey there!
Not currently, but that is a great suggestion. I'll add it to our list features to prioritize - thanks for the feedback!!
On behalf of the team, thanks for all the comments! We'll be taking your feedback and making FWE even better.
W00t! :D
This look fantastic! We're using Google Alerts but it's been terrible lately - looking forward to using this instead!
Woohoo! Glad to hear that. :) Be sure to leave feedback and let us know how it's working. (There's a feedback button on the page).
He Jennita, is there a way to set up alerts to email you when your brand is mentioned (similar to Google alert emails)?
Not yet! "yet" being the keyword. :D This is just the beginning of this tool, watch for updates coming!
I agree, emails based on triggers would be great to see. So does this tool use the same db as OSE? I didn't see that answer mentioned above.
Hey Aaron,
Nope, this is a completely new database and is not connected to the OSE index. We know it would be great to filter this fresh data into the OSE index - it's something we're working on! Stay tuned for more updates this year :)
Super excited to try this out! Right now I am using Google Alerts for brand mentions so I want to see how I can use Fresh Web Explorer to supplement or replace the alerts. The Feed Authority is what might sell it to me completely. It will be interesting to see how FWE's high Feed Authority results stack up against "only the best" results from Google Alerts.
Have you done any tests to see how different they (FWE vs. Google Alerts) are internally?
The thing that caught my attention straight away was how quick it returned results. Looking forward to seeing this grow and evolve.
This looks pretty rad so far.
Is there any easy way to exclude results from your own domain? I tried a few different things and wasn't able to do this - most of the results I'm seeing are from my own site.
There currently isn't a way, but we do have that feature prioritized to start developing in the next several weeks!
Thanks for the feedback!
Tested this in the Australian market today via my business account, would be good to have some more data for this market if possible.
but overall some very nice information, I am doing an SEO deck for a presentation tonight, I will include a slide about this tool =)
Great googly moogly!
Looks like I'll be having some fun later on today playing around with FWE!
Are there any plans of giving the ability to go back further than 4 weeks? Like let's say 52 weeks? ;)
Hi Will! Yes, there are a variety of operators you can use. To the right of the search bar there is a Show Search Operators link that you can click on. It will open up a drawer below the search bar with a list of operators you can use.
Use double quotes if you want to find a specific brand phrase.
Cheers!
52 weeks, now that wouldn't be so "fresh" ;) they can probably keep the query time down with a smaller DB.. but definitely some use for going back in time..
Eh...maybe this is useful. I still wish someone would make a tool so I can track tweets, likes and +1's over time by URL.
This is great! Very cool tool. I appreciate all your hard work on this and other tools!
After the long and arduous development process, it means so much to hear -- thanks!
Woah!
Awsome team, awsome!!!
Thanks!!!
Congrats to Matt The Math Man and the rest of the Mozzers. Been dying to see this in action, since our sneak peak in Cape Town.
Fresh FTW!
- Andre
We're happy it's finally here! :D
I tried using this. It is showing many results but none of the pages have my search term. I also checked in the source page of the site. No results. :(..
Hey there,
It would be great if you could submit this feedback on the Fresh Web Explorer page! There is a feedback button on the right side of the page - we'd love to hear what query you were searching that didn't return mentions on the page.
This is exactly the feedback we need to keep improving the tool!! Hope to hear from you soon!
Thanks,
Carin
This is awesome! I, like many others, have been using Google Alerts for a while. It will be nice to have another option.
Excited to try it, we are looking forward to trying a different tool.
Wow this looks like a great tool cant wait to give it a spin...a consolidated place to record all your mentions seems like this should have been out for years...at least we have it now THANKS!
A Little suggestion after using it, there should be a filtering system in it too like it will be really good if data can be filter in terms of News Results, Community/Forum Results and Blog Results for example i searched for a term "Construction Machinery" so it would be awesome if this tool can provide me a filter searched for News, Blog or Communities who are discussing about "Construction Machinery"
Thanks guys/girls that's so very cool, what an awesome way to track mentions that you can followup to remind them to link back to you before they even forget about the article.
Hopefully some filters might roll out at some point in the future such as Geographic or type of URL (News/Blog/Other)
Absolutely David! Filters can always be a great addition to find the required data easily and faster. Web Mentions is another great addition to seomoz’s already huge armory. With David Mihm & his getlisted.org joining seomoz, we can expect some more great tools related to local search from mozzers in the near future.
I typed in my company's brand name, and it came back with 150k mentions. I checked the first five, and none of the pages had any mention of our brand name anywhere on the page... what gives?
Hey OCN,
This would be great feedback to submit on the Fresh Web Explorer site. There is a feedback button on the right side of the page.
I'd love to know what query you were searching for - that way we can investigate what gives. This is exactly the feedback we love to hear so that we can keep making this tool better and better!!
We're reviewing all feedback that comes through - would love to hear more details from you!
Thanks,Carin
Hey Matt - it's easy & intuitive to use, nice work there; love the export for pivoting. @KaneJamison what took so long to get the bookmarlets out?? ;)
Well, thats a weeks worth of blog content on things being talked about in our industry at the moment found in a quick 10 second test.
I'm liking it already.
Many thanks and congratulations!
Even though I'm currently not an pro member, I appreciate every single effort you made to make your customers happy.
Happy to hear its announcement, but really desp to being as a non pro member
This looks like a great tool
Yet another great perk. Thanks guys. Can't wait to see how this tool will evolve over time!
Way to innovate guys :) Great to see new tools coming from SEOmoz.
I see the tool has a flag to flag spammy or non-relevant results. Just to clarify, do you want us to flag pure spam web pages and/or web pages that have been subjected to spam though the website itself isn't spammy?
Please flag both as you see fit, and we can use them to figure out how frequently each occurs and adjust our scoring. Feeds are a bit of a different world, so I think you might see more of the low quality page issue on an otherwise strong domain
I did a search for my company name and noticed that it pulled back all sorts of articles with those two words mentioned anywhere in the article text. Is there any way to pull mentions that have the two words together. Ex. Customer Magnetism - Its pulling articles that have the word customer and magnetism anywhere in the text. The articles obviously have nothing to do with our company.
Yep - you can use double quotes to get an exact match. Without quotes, the search will be for Customer AND Magnetism, but using "Customer Magnetism" you'll get an exact match.
There are some examples for other search operators if you click on the blue + sign under the search field: "Show search operators".
Hope that helps!
I believe you want to use a phrase search with "double quotes" around the phrase like this:
https://freshwebexplorer.seomoz.org/#results?q=[%22\%22customer%20magnetism\%22%22]&time=last-week&sort=published&order=desc
Really love and enjoy this new tool especially search operators feature
Woohoo! A New toy. I like it. Thanks guys!
SEOMOZ seems to deliver just the right tools when we need them. I like the social functionality of it where we can give feedback or 'flag' things that look sketchy. This is a going to be a great reporting tool for our clients as we move into content marketing. I like being able to report to a client the effects of one great article that got shared through out the web,
Neato!
Very cool guys! Thanks for putting the work into creating such a valuable tool
Great one especially for the obsessive compulsives' out there. who wouldnt wish that there work wouldnt be organized? no one! So this tool is a must. Keeping all the data, links, blogs etc. in one easy step saves time and lets us finish our work in a timely manner.
Been using this for a bit now, it's an awesome tool and I'm hoping to spend some more time on it..
An amazing addition to the SEOmoz tools, I've been intrigued by it as soon as this was launched, I'm going to be "explorer-ing" it more this week, otherwise fantastic tool so far!
Wow. I've been using OSE for my other seo tasks for 417marketing.com. I will definitely try this new FWE.
A much needed tool for tracking mention. All in one. Good work Seomoz. :)
This product is looking good... And I will surly try with this product.
Hi guys try adding NewsAssist to your list of tools? NewsAssist is an open source Firefox add-on that provides an editor (blogger, journalist) all necessities for News Searching, Editing, Publishing, Content distribution to social media. It is a powerful tool and a great working environment that is fully integrated with Firefox. It is aimed to increase the productivity of blog and website editors without having to leave the web browser.
This might actually tip the scales into me trying out SEOMoz finally. Very cool.
Super great idea! So far it's not returning the results I'm hoping for (no social mentions, and most of the pages are very low value and/or in other languages). The idea of being able to find press opportunities is not really there yet. But I am sure it will get better and I can't wait to try it again in a week or two.
Very cool tool! Still trying to come up with a strategy to use it effectively but I'll get there!
not sure about the exact match with quotes tool.
we just tried "brandname uk" and, because the brand name is also an adjective, we got fed pages which had the adjective in and the 'uk' in - but not together - i.e. the adjective may be mentioned in one part of an article and then later in the article the word UK.
???
Hey there,
Hmm, we haven't seen issues with the exact search queries, but I'm going to send this along with some of our other feedback to investigate. It's beta, so we're still working out a few kinks! We'll take a look and see what's going on with this query.
Really appreciate the feedback!
Is there a way to export results? I am able to copy and paste into excel but a nice clean export option would be cool. +1 for this though. Very handy for finding fresh content and possible backlinks.
Hey! Yep - Fresh Web Explorer does have export to CSV functionality. The button is in the top right corner, above the search mentions bar. It will export all the data in the table below.
Hope that help!
Thanks,
Carin
So far so good! I'm sometimes a little bit amazed at how fast it finds mentions (literally within minutes in some cases).
I am so psyched! I am doing some testing right now, but with the amazing support of the community, I have no doubts that this will be a killer tool in no time! :)
This is soo cool it's way better then topsy, and using it with freshly discovered links in ose gives you good insight in the most fresh links and mentions for yourself and your competitors.
I am so excited to try this tool but its only for PRO members :(
You must give it for free for few days just an opinion ...
Regards,Raviraj
Hi Raviraj,
We actually do let anyone take a free 30 day trial of PRO. Hope this helps!
Hi Matthew! Yes indeed. One of the most challenging tasks as an online marketer is keeping track of all the blogs that are latest, forums, and news sites on the web that mention our brand. I guess I need this new beta product, the Fresh Web Explorer. I will be sharing this to my friends who are online marketer.
Check out the new search features in Fresh Web Explorer! You can now search for links to a root domain, and choose to include or exclude results from a specific site. Click on Show Search Operators to see more!
Awsome tool....
Just after viewing the latest WBF with Rand, I had to check this tool out.
This tool can be used by knowing what trends your competitor is working on and then probably doing it better. I really like the tool as it has the fresh advantage. No wonder why its called Fresh web explorer.
Impresionante nueva herramienta, ya podemos saber lo que sucede en todos sitios sin esperar los resultados, ademas de saber los caminos por los que va la competencia, maravilloso.
I'm positively surprised! :) I believe Fresh Web Explorer would be quite more useful according to Google Alerts. I'll send you my feedback after testing.
Great Job, keep it up
This new browser looks way convenient and helpful for those collaborators who are constantly preparing reports and working along them, customizing it.
Great Improvement!
It looks very useful and I am impressed by the quick return of results. Any way to integrate these searches into a weekly automated report?
What a useful tool! Thanks for adding more value to my Pro account.
I gave it a spin and couldn't believe how fast it was. Very impressive.
I noticed you can only select last week, 2 weeks or 4 weeks. I have a feeling I may start using this tool a lot and only be interested in seeing the very latest results.
Would you consider adding a "last day" or "last 2 days" option?
Interesting tool, I would like to use this tool and looks very interesting and useful. I hope these new features are helpful to all users. Thanks a lot.
Extremely Excited to Use it xD!
Yes this one is exceptionally unique from the market offer. We can have now huge ideas and opportunities to get the job done through this tools. excellent Matthew and SEOmoz teams!
i love try out new toys
Gonna Be Honest...........I couldn't wait to finish reading this post before I gave it a try!
Wow! Having lots of fun! Already sent a bunch of urgent emails to colleagues/clients!
Any plans to integrate this with campaigns, such as reporting on keyword or domain mention for your domain and your competors domains as set in the campaigns? Any plans for alerts or weekly notifications?
Work on the responsiveness was very appreciated.
How did you select the high quality feeds for the explorer? My question is mainly concerning the feeds outside the US.
Great question Petra! Let me see if I can grab someone from product or engineering who can answer that.
We began with the thinking that we wanted to cast as wide a net as possible when finding feeds and then finding a reliable way to select the best ones from a large candidate pool. To this end, we tried collecting feeds we discovered while conducting the mozscape crawls, or feeds discovered through tweeted urls and so on and so forth.
What that process yielded was hundreds of millions of feeds, the vast majority of which were spammy -- even when it comes to feeds, the vast majority of the internet is low-quality. Separating out the parts that were worth putting time and energy into following turned out to be extremely difficult and noisy.
In the end, it actually came down to using a combination of several existing high-quality and hand-picked sets of blogs. Currently it's about 4 million of what we believe to be the most important feeds. It's still meant to paint a relatively complete picture but ignoring the cruft of the long tail of internet awful.
With respect to sources outside of the US, we definitely have some. Whether we have enough is a question we've not visited yet.
Is anyone else getting a bunch of unrelated hits or none at all? Hopefully this will be a great replacement for Google Alerts.
Hey there!
We'd love to know more about the query you're searching that is not getting results or unrelated results. If you click the Feedback button on the side of the page and send us some information on what query is returning questionable results and maybe some examples of expected results, we'll investigate!
Or feel free to email me directly ([email protected]) if you have any problems submitting the form!
Thanks!
Will do! Hoping this is just a beta issue
Nice start.
Definitely a start. We're wasting no time improving the quality to return better results.
Excellent added value to PRO. Thank you!
Nice job. This looks like interesting info to contrast with Google Trends data. For example, you can see how coverage (mentions) follows a spike in demand for information for something like a major news event.
Sick tool! What's next?
Hi guys, great work!
However I'd like to give a bit of feedback if I may...
I've just tried "box uk" (in quotes, as a phrase match) and the first three results when you sort by highest FA don't have any mention of "box uk" as a phrase on the page whatsoever.
Is this a bug? Perhaps because one of the words is only two characters long?
I've tried a few more terms and gotten a result, so I'll keep playing around. Just wanted to let you know though!
Thanks for this feedback! I've sent this on for further investigation. We'll take a look and see if there is bug buried somewhere. Appreciate the feedback - this is how we'll keep improving the tool!
Awesome. Looks to be a great addition to the toolbox.
We have been using Raven Tools Social Monitor, (more so just to find mentions and engage and respond vs. actually tracking sentiment). I will be interested to see how this data differentiates.
I'm glad to see SEOmoz continuing to improve on their product.
Interesting tool. Glad to see SEOmoz keeps bringing more value to its customers.
Thanks for creating a great tool!I put in a competitor and a lot of pages from the same blog come up. It's showing all banner ads on the side of the web page and has nothing to do with the topic of the blog post. Is this what it should be pulling up?
We have put a lot of effort into trying to eliminate sidebars, headers, footers and just about anything that's not the content of a post. That said, it's a difficult problem and any solution is bound to not be perfect. We'll be talking about this more in an upcoming post, but the goal was to develop an algorithm whose only input is the page itself with no additional context (like other pages from the same site). It does moderately well, but depending on how closely the sidebar content is knitted into the real content it can be quite difficult to extract. It's going to always be a challenge and so we'll be continuing to put a lot of energy into it.
My keywords are generating a lot of irrelevant data. Not usable for me at this time. The reports seem interesting but the links aren't.
Try your searches with quotes around them, so you get exact occurrences of that phrase on a page. I often sort by Feed Authority after performing a search, to prioritize the most important feeds the page was found on.
If you're still seeing irrelevant data, please flag the result or drop us a note in feedback. We'll want to use your experience to help make FWE return better results. Thanks!
I was so happy read this post, but now really not happy, as I am not a pro member
You can take a free 30 day trial of PRO and check out FWE along with all of our other features
Thankyour for your info Keri
This does not work if you have spaces in your brand name. Just returns garbage.
Just use quotes, like you do in Google, and you should be fine. e.g. "fresh web explorer" brings back great results, but fresh web explorer (without the quotes) brings back any page that has all three of those words.
Thanks!
If I had read over the whole blog post I would have seen the various operators to use.
With quotes does return results, also includes brand mentions only a few hours old.
I think there may be some problems in initial day as it is a beta version
The timing of this post couldn't have been any better Matthew! I was talking to one of our clients about monitoring mentions on the web and I've used Radian6 and a few other social media monitoring tools in the past but they are really expensive and would be great to see if the level of detail on the SEOmoz tool is going to give us more tangible results!
I think this has great potential.
Is there a way to setup a campaign so I can easily review new results for a group of search queries and/or get email notifications?
For example, maybe each week I want to review mentions/links to 50 of my competitors. I would like to be able to create a campaign that allows me to view results for all 50 competitors with one click.
I have always used Google Alerts as a 'down, dirty solution' so am looking forward to giving this new tool a try. It seems very fast so far. Looks great. Thanks.
Great looking new tool. I'll spend the next few weeks playing around and give you some feedback.
This looking cool stuff which will be help a lot for you and when you will trying these kind of tools for your work art then you can see how result will come out in favor of you.
Looking good tool, May this helpful ?
Thanks Matthew for posting this articles. Its really helpful tool for us. I hope its work properly.
SEOMOZ have been providing really good and useful tools in SEO. But i wish they would provide a free version of it. :)