Last week, the New York Times opened up their 13 million document archive and dropped their Times Select program (which allowed access in exchange for a fee). This move was covered extensively in the blogosphere and even influenced other giants in the online publishing world (like Murdoch on the WSJ) to question their own content strategies.
The Times' decision wasn't made by any single person, but certainly a driving force behind the questioning of the paid content strategy is Marshall Simmonds, chief search strategist for the New York Times and About.com, and the CEO & Co-Founder of Define Search Strategies. I interviewed Marshall about his role in the TimesSelect move, his company and his strategies for large media sites.
Marshall Simmonds (right) with SEOmoz's Si Fishkin (left) in Xiamen, China
For those who may not be familiar, can you give us the back story of your entry to the search marketing world. How did you get into search and SEO, and how did you get involved with About.com and the New York Times?
I got into search in 1997 with a marketing company in Bend, Oregon where I started my own search department focusing on SEO. At the time I was also moderating and maintaining the I-Search digest. The community all of us built was very strong and active - it was through I-Search I learned of the About.com opportunity. After working on several big name clients I took a job with About.com in 1999 in what, I believe was the first In-House role created specifically for SEO.
My responsibilities were (and still are) to educate the nearly 650 Guides and staff, in addition to setting search strategy. In 2001, About was acquired by Primedia (a large publishing house of niche publications) and 250 additional properties were added to my workload. It was at that point I realized the centralized approach to enterprise level search marketing only goes so far and I adopted a method of pushing as much search information as possible to project managers and anyone who would listen. This process of creating network evangelists allowed me to focus on high level strategy and at the same time leveraged the intrinsic knowledge of each property.
Outside of your work with NYTimes & About, can you tell us about your company, Define Search Strategies - what kind of clients do you work with? What are the primary services you're providing? Who else is involved on the DSS team?
Define Search Strategies is a division of the New York Times. We provide high level consulting with companies interested in bringing search engine optimization, audience acquisition, and retention activities in-house rather than outsourcing. This could mean training an entire company on the best practices of SEO, social media, interactive marketing, and establishing a search team or educating an in-house expert to take over the day-to-day SEO functions.
Define has worked with a fairly large number of publishing clients, due to our familiarity with the space. One big advantage to this much exposure to the publishing space is we’re able to very quickly determine strategies for publishers that are not only effective in increasing online traffic, but work within the limitations of the client’s business model. Once you marry the editorial process with sound search marketing fundamentals, you can create an ongoing procedure that’s truly sustainable.
You've been a driving force for how many large media organizations have built up their search strategies, but it hasn't been a path devoid of resistance. Can you tell us about some of the hurdles you consistently get from working with the web properties of large media firms? What are the toughest biases or habits to overcome?
Ultimately, conveying the practice of writing for both users and the engines is our biggest obstacle.
With publishing, the challenge is educating editors, marketers, business development staff, and senior management that the same process that sells magazines and newspapers on the newsstands also works for search. That is to say, the importance of writing a compelling and relevant message is the key to online success. What attracts the eye when you’re walking down the street isn't the same language you should use online, but the skills and talents to create that message are. Search puts an increased demand on publishers to understand their readers at a much more intimate level if they really want to reach that audience and encourage a high level of engagement. This is where the NYT search team must be diligent as we're dealing with more than 150 years of entrenched journalistic and editorial processes. Publishers are becoming comfortable with how the creative process can be adapted for online. This ship doesn't turn easily, but as you saw this week by ending TimesSelect, the New York Times took a huge step in its commitment to users around the world and I give the company a lot of credit for making a tough decision that only strengthens its long-term strategy as a publisher, and improves the opportunity to further develop a broad audience and increase revenue.
In your work, you're often serving as a go-between for the engines and the companies you help; what are some of the challenges of that position? Do you frequently find that your clients' goals differ from those of the engines?
Actually, the goals of both our clients and the search engines seem more aligned than perhaps ever. More often than not, what’s good for the client is good for the engines, from a content perspective. Where it gets tricky is aligning what we can do and what the engines need. Best intentions on both sides won’t always make up for business objectives, difficult content management systems, convoluted URL structures, marketing efforts that end up cannibalizing search traffic, and all manner of execution mishaps. In general, the more people that participate in the process of content creation on a site, the easier it is to trip yourself up in the engines.
The engines are more transparent about the mechanics of how they operate than they’ve ever been. For obvious reasons, they can’t go the whole nine yards, and in some cases there is less information available now, especially where backlinks are concerned. But we’ve come a long way from the days where Google was only communicating to webmasters via an anonymous message board identity. Of course, the new search giant shrouded in mystery is Baidu.
You're a pioneer of the "Xth-page-view free" model, wherein the first few page views after a visit from the search engines shows the content pages without an ad overlay or subscription message (but subsequent page views will). Can you tell us about the genesis of that concept and the evolution of the idea? How do sites like the NYTimes (where up to 5? page views are free) compare with sites like Forbes that instantly show an ad interstitial to search visitors?
Quite simply, it’s about valuing users. If you do, don't annoy them with registration walls and interstitial ads when coming from search. That was one of my first agenda items when joining the NYT - to ensure a positive user and search experience from the time a visitor clicks on a search result to their final page view. We orchestrated the push-back of the registration wall to the sixth click and eventually I'd like to remove it completely.
As you mentioned, the NYTimes dropped its TimesSelect program for paid content. Do you view this as a positive thing from a search traffic perspective? Is it something you're excited to see? And, what's your opinion of Bill Tancer (of Hitwise)'s perspective, particularly this - "Opening up NY Times Select may or may not help the NY Times attract a larger audience online. What looks more certain is that it would put popular columnists back at the fingertips of the wealthy young readers that could help boost advertising revenues."
This is one of the biggest and most positive changes the NYT has made online to date. It shows a dedication to users and a decision that will no doubt cause other publishers to rethink their strategy. Make no mistake, opening up millions of entry points into one of the richest archives in the world will only have a positive effect for everyone involved. Looking for information on the Battle at Camrgo in 1851? or Thomas Friedman's recent column? It is now open to the entire world. That can only help from a search visibility standpoint.
As many people have correctly pointed out, TimesSelect was certainly not productive from a link building standpoint. But in fairness, it can be difficult to communicate what the long-term value of being part of the conversation and getting these links will ultimately be. Our SEO efforts at NYTimes.com had barely begun when TimesSelect was launched. Now, we have 2 full years of data that can reasonably predict the upside of our search optimization strategy.
With the Times Select switch - what are the metrics you used to forecast and predict that the move would produce positive results? How would you suggest other organizations analyze their own decisions to make decisions about opening up content archives?
It's about search referral volume, first and foremost. From there, you can go deeper and track how users convert and behave to project growth. Using page views isn't the most reliable measuring stick as search referral traffic has a tendency to be transient. Those users typically won't consume as much of your site as someone coming in through the home page or a category page.
How would you suggest other organizations analyze their own decisions to make decisions about opening up content archives?
When content is in a walled garden you're trading off long term search equity. Ultimately the questions to ask are what are the 2 year/5 year traffic and revenue objectives? As well what can be done today to establish a strong foundation and momentum towards maximizing the network's potential?
As social media and the blogosphere have taken off, I'd guess that the pressure to push so-called "old media" websites into this new generation of interactivity would increase. Have you felt that in your position? Are you someone who likes the model of participatory and social media and would you (or do you) recommend it to your clients? Do you see value there?
The NYT has moved gracefully into blogs within our network. Some of our more premier content can be found in DealBook by Andrew Ross or David Pogue's tech column. I've always enjoyed and promoted the need to engage the audience. With the comments section we've done just that, pulled down the traditional wall between journalists and the readers. Sometimes the responses are the best part of an article.
We’ve found that a one-size-fits-all strategy for dipping your feet in the social media world is not the best strategy. Some communities seem to be natural fits on many of the social media networks, while a large number have virtually no visibility or traction at all. Of course, that presents its own opportunity, perhaps a bigger one.
From your perspective, where are the biggest gains to be found on large, content-based, advertising-focused websites? Anything specific that you've seen across the board?
In the case of established publishers, it’s in the archives. Making deep content easily accessible to users and search engines is a really sound strategy. It can be easier said than done, depending on how your content is generated and stored. Sometimes, the best quality content isn’t easily found, either on a site or in the search engine results. That’s typically due to accessibility issues.
We've seen many large sites struggle with passing link juice down through their site architecture to get pages indexed and ranking. What strategies can you share to help large site owners get their hundreds of thousands (or millions) of pages into the engines?
Internal link structure is definitely an ongoing effort that you should monitor. I don't think every site needs to use nofollow to sculpt PageRank, as Matt Cutts recently signed off on as a legit technique for webmasters. It's definitely worthwhile to periodically review your site architecture and internal link structure, to see where some of your weak pages might be hiding. Halfdeck wrote a great article about third level push that's worth taking the time to digest.
It is essential to test, measure and monitor your SEO strategy constantly to maximize every entry point and promotion opportunity. In many situations conventional wisdom doesn't always play out. Every site is unique, the challenge is determining what combination of factors lead to optimal results for both usability and search engines.
Talking about the search industry broadly for a moment - what's your take on the state of search marketing as a profession and of the people involved in search? Where do you see the direction of this industry going - are we on the right track or way off course? What would you like to see happen to make search marketing a better place to work?
The state of search marketing continues to get stronger every year. If you can put a basic level of professional acumen behind your process you'll be successful in this industry. I still hear a couple times a month about bad experiences with so-called SEO experts. Inevitably, articles will come out that question the value of search engine optimization and label it as a black art - but as we say day after day it's simply making the most of your content. SEO shouldn’t dictate every decision made on your site, but it must be taken into consideration. We’ve seen too many companies set themselves back years in the search engines. Building a solid foundation of SEO into any online venture should be mandatory at this point.
Social media is still in an infancy stage so to speak as it goes through a transition to the enterprise level. At Define we do a very good job of taking a message and educating a company on the public relations approach to reaching out to the many social networks. It’s not easy. Whoever described it as the ‘new link building’ is right, assuming they meant it was just as much of a pain.
For the SEO industry in general, there is a dire need for consultants and agencies to truly realize the value of the information given to clients. Not only does the education pay off for a company years after the work is complete, but it can be monetized so heavily it makes me cringe when I hear what some highly skilled professionals and agencies charge. Too often our industry is brutally under-valuing and exploiting the customized expertise it delivers. Truly good SEO services take a vast array of factors and SEO experience into account for each new client challenge. It’s hard work that can last months, but there’s often no marketing effort for a company that will generate as much revenue and growth over the long haul. I know many SEO firms and consultants that are worth every penny and probably quite a few more. At the end of the day I'd love to see the SEO space finally place the same value on its services that our clients know they’ll receive for years to come as our strategies continue to pay off.
The online world has stood up and taken notice of SEO, in a big way. SEOmoz has a big premium subscriber base, and you guys are referenced by the likes of Dave Winer. More and more folks are blazing trails as in-house specialists. We know quite a few and these people are invaluable to the companies they are working for. There are a bunch of SEO blogs that are fantastic.
On a more personal note - despite having one of the best known names in the industry, you've remained relatively quiet in the online search community - blogs, forums, Facebook Your browser may not support display of this image.Is that an active choice to limit participation, or do you secretly wish you could blog, Sphinn and Twitter all day but lack the time?
I read as much as I can, and between that and the hundreds of contacts I make a week, I try to leave enough time for a life. J Not everyone can be as prolific as you! We just have too much that needs our attention.
Last question - tell us about one of your most exciting or interesting projects in the last year - what's something that's really surprised or amazed you in the trenches of search marketing?
The awareness I mentioned above has manifested itself in companies being much more willing to set strategies that will capture search opportunities. This was of course, reflected in the decision to lift the wall on TimesSelect. People seem to get it now, how search plays a role in that kind of decision Those in traditional marketing, editorial and IT roles seem to be much more informed about SEO. It makes the job of implementing strategy much easier. There’s still skepticism, but most people we work with understand now that there are fundamentals that must be put in place to really drive search traffic.
Thanks a ton, Marshall. Your insight is priceless.
Great interview. It helps to reinforce both the value of SEO and the viability of online adserving. Let's see, NYT with 13 million + new pages to display ads on... that should do something.
I'm interested in hearing a bit more of his insights into the value of SEO information and what an SEO expert can charge. Part of Monday's seminar perhaps? Looking forward to that!
Would make a good whiteboard Friday topic too ;-)..
Great interview.
I think that Halfdeck will be really flattered to be mentioned in this - I've long thought that he is an authority figure on all things Pagerank, whereas he seems to be very humble about his own knowledge.
/Goes off to check to see if NYT is using any advanced PR dist. techniques/
A little over a year ago, I remember having a detailed conversation with the editor of a UK-based trade magazine who had one major competitor whose website was doing better than theirs (despite an up-and-coming offline magazine).
The competitor was entirely behind the curtain, and I was advocating a similar setup - I think a subscription would have got access to breaking news and some other features etc. but anyone could get access to archive articles - would have blown the competitor out of the search water...
I think it comes back to value: how much do I need the breaking news? Can I get it elsewhere?
Charging should never be off the cards, but it has to be worth it....
You're absolutely right - I'm not a raving "all information should be free" nutter. I think at least trialling this kind of thing has to be worthwhile though - unless you know what kind of traffic upswing you can get, you can't know whether it'd be worth it...
For sure. At my post before last we charged more for archive than we did for breaing news & jobs. Lots of revenue, little in the way of search magic!
This has always seemed like a no-brainer to me. Search drives the lion's share of online traffic. Any savvy publisher should do better selling advertising and offering the best possible search profile, rather than trying to charge for content.
I am afraid its not all that easy - There are some real financial considerations for charging for content - take SEOmoz for example - I am sure they get thaousands of readers - but would it be advisable for them to open up their premium content to the general public (I am sure its information rich and can drive volumes of search traffic into the site).
But what would the play off be compare to the advertising revenue vs subscription revenue? It depends on what the advertisers are willing to pay and the regularity of their contribution.
To make such a decision, you would have to compare the two revenue streams and then make a valid decison, keeping in mind others factors such as management of the scheme, extra resources needed etc..
A very educational article. Thanks @mdsimmonds and @randfish for the great info.
Brent D. Payne
I don't think it's new that NYT has "opened its doors to search". By what I remembered, even though users are required to register, NYT's always done a "user agent detection" to show search engines all its content. But now when people get to the content, they'll stick around instead of having to register, get annoyed, and leave.Good job NYT.
"user agent detection", otherwise known as cloaking and punishable by Google death to mere mortals.
lol... sad but true... only if applied to small businesses.. yet to see an example of a well known company being penalised for it...
Paul - actually, my understanding is that while they'd show that registration request after your first 5 page views, you could still dismiss it and continue to browse.
And no - the TimesSelect content was always behind the wall for the engines - Googlebot's going to have lots of fun, new spidering to do :)
Randfish: Are you sure nytimes's archive was behind the wall for search engines? I've always thought Googlebot was allowed to crawl it, but when a user gets to it, the user wouldn't be able to see the content, and they've notified Google not to display the "Cached" link in its SERPs?
This is only based off my memory of my experiences, so I definitely can be wrong about this one. :)
It looks to me like American Express just dropped the $10 million to cover the TimesSelect columns- 200,000 at $50/month
A very interesting post, especially for someone who spent the last couple of years in a large publishing company.
He's obviously doing a grand job and I hope that he continues to do so (although he still needs to beat his journos out of the habit of bad puns as headlines!)
What I take away from this interview as a small SEO outfit is that I now have a great model to share with potential clients of how one of the most trusted news outlets of all time really values SEO.
"SEO shouldn’t dictate every decision made on your site, but it must be taken into consideration. We’ve seen too many companies set themselves back years in the search engines. Building a solid foundation of SEO into any online venture should be mandatory at this point. "
I'm interested to hear about the traffic versus lack of backlinks ratio in the upcoming months in relations to Googles link heavy algo.
I think I am being thick here - but what did you mean by "traffic versus lack of backlinks ratio?"
Were you referring to the amount of traffic the site will receive compared to the amount of backlinks it will generate due to the new strategy?
I think in general, giving away the content for free but then charging for ACCESS is the way to go. So let people read the online articles for free, but keep charging for search ability in the archives, getting high res versions of old articles, access to writers, images, etc.
I agree that the second part of your comment might work, but if I understand you correctly, the first part of the suggestion is to make it harder for the readers to find content within the site, because the site search facility is only for registered (paying) users?
So I am searching for Natwest in say the NYtimes site - and am not a registered user, wouldnt using - "natwest" site:www.nytimes.com - in google make the sites own search facility redundant?
Yes and no. While Google may be your go-to-guy for searches of spiderable content, I can totally see the NYT going the Facebook route and building a search engine that understands their content better than Google ever will.
Fair point - but probably what I meant was would you realy subscribe to a the site for a search service, if with a little creativity you could find it via other means?
But I can see myself subcribing to one that may let me profile content via relevance (e.g use of tag based search), authors, so I see where you are coming from.
Well no - search alone would not make me pay to use a website. It's not value added if the value exists through using Google as well.
I have seen that model with other newspapers and it seems to work fairly well. They provide new articles along with 7 or 14 day archives for free but charge a nominal fee to go back further. It also eliminates my biggest issue with the previous model, which IMO lead to poor search results.
Basically, if you're going to charge for something, it has to be worth it, and most of the stuff that you find in mainstream papers is stuff that you can find elsewhere for free; news, comment etc..
I do think that there are B2B areas where the content is of such high value that you can succesfully charge; i.e. must have info for travel agents (in-depth specs of hotels perhaps; lawyers (online case histories)....
umm... may I quote SEOmoz as being one of them? lol ;-)
Good point....
When I heard about the Times opening up its doors - two thoughts skirted my mind - first its blatant that they are gunning for search visitors - and probably will succeed because of the level of quality content they have;
Secondly, I am sure its will start a trend with thos organisations still have their doors closed to search engines and fly by visitors - its content explosion in my eyes...
But thats a good thing. Thats the whole social element of the web - information should be free... and I am glad the trend is moving in that direction, even though it makes work harder or small organisations to compete for keywords these content heavy sites gun for...
It should, but we shouldn't be too harsh on companies who feel that they are better off charging for it, as someone has to pay the journalists, and online advertising for most companies simply doesn't plug the gap left by declining print revenues.
True - isnt it like only 5-10% of advertising budgets are spent online?
But i particularly liked their model - Times to stop charging - Charging for a set time for access to the content, gaining a target revenue, and then releasing it to the web.
It does mean that the most fresh content is available way after it was written, but at the same time makes SEO use of archived content, which has another benefit - it allows potential subscribers to read / sample the quality of past content to make an informed decision to subscribe to the fresh content.
As a reader of the NMA - I think they should adopt a similar strategy - their content is quite solid and UK specific...
I'd love to see NMA's content open to all (I used to work at Centaur and still know several people at NMA, so have a vested interest).
However, if they continue to buck the trend in publishing like they did with their latest figures, they may not feel like they have to!
I honestly did not have a big problem with them charging for some exclusive content. That is perfectly acceptable and well within their rights. My biggest problem was on the search engine side and the fact that they were obviously allowed to cloak their content without any noticeable penalties. Because of that there were far too many listings that took you to a sign up page and not the real content. This compromised the Google results and turned me off the NY Times. Not because they charged a fee for their select content but because they were given a pass to violate Google guidelines. IMO this change benefits searchers and Google as much as it does the NY Times.
Great article. With NYT opening its doors to search, they are definitely going to attract a lot more traffic.
This makes me think about my graduate days doing research, and how many times I was looking for articles did a specific University / Association website come up in the natural results with a JSTOR article. Granted, this is more of an academic example, yet it begs the question of how well integrated the content will be for search in the long term.
I also wonder how many other publishing companys will get "behind the Times". The article mentions Murdoch...
University days...lol..I wonder if Mintel will follow suit?
The Economist has made similar moves, Murdoch is talking (very loudly) about doing the same with the WSJ and it just begs the question of how long the FT could keep up its subs model if the Journal did go free...