My name is Patrick Curtis, and I'm the founder and CEO of Wall Street Oasis, an online community focused on careers in finance founded in 2006 with over 2 million visits per month.
User-generated content and long-tail organic traffic is what has built our business and community over the last 12+ years. But what happens if you wake up one day and realize that your growth has suddenly stopped? This is what happened to us back in November 2012.
In this case study, I’ll highlight two of our main SEO problems as a large forum with over 200,000 URLs, then describe two solutions that finally helped us regain our growth trajectory — almost five years later.
Two main problems
1. Algorithm change impacts
Ever since November 2012, Google’s algo changes have seemed to hurt many online forums like ours. Even though our traffic didn’t decline, our growth dropped to the single-digit percentages. No matter what we tried, we couldn’t break through our “plateau of pain” (I call it that because it was a painful ~5 years trying).
2. Quality of user-generated content
Related to the first problem, 99% of our content is user-generated (UGC) which means the quality is mixed (to put it kindly). Like most forum-based sites, some of our members create incredible pieces of content, but a meaningful percentage of our content is also admittedly thin and/or low-quality.
How could we deal with over 200,000 pieces of content efficiently and try to optimize them without going bankrupt? How could we “clean the cruft” when there was just so much of it?
Fighting back: Two solutions (and one statistical analysis to show how it worked)
1. "Merge and Purge" project
Our goal was to consolidate weaker “children” URLs into stronger “master” URLs to utilize some of the valuable content Google was ignoring and to make the user experience better.
For example, instead of having ~20 discussions on a specific topic (each with an average of around two to three comments) across twelve years, we would consolidate many of those discussions into the strongest two or three URLs (each with around 20–30 comments), leading to a much better user experience with less need to search and jump around the site.
Changes included taking the original post and comments from a “child” URL and merging them into the “master” URL, unpublishing the child URL, removing the child from sitemap, and adding a 301 redirect to the master.
Below is an example of how it looked when we merged a child into our popular Why Investment Banking discussion. We highlighted the original child post as a Related Topic with a blue border and included the original post date to help avoid confusion:
This was a massive project that involved some complex Excel sorting, but after 18 months and about $50,000 invested (27,418 children merged into 8,515 masters to date), the user experience, site architecture, and organization is much better.
Initial analysis suggests that the percentage gain from merging weak children URLs into stronger masters has given us a boost of ~10–15% in organic search traffic.
2. The Content Optimization Team
The goal of this initiative was to take the top landing pages that already existed on Wall Street Oasis and make sure that they were both higher quality and optimized for SEO. What does that mean, exactly, and how did we execute it?
We needed a dedicated team that had some baseline industry knowledge. To that end, we formed a team of five interns from the community, due to the fact that they were familiar with the common topics.
We looked at the top ~200 URLs over the previous 90 days (by organic landing page traffic) and listed them out in a spreadsheet:
We held five main hypotheses of what we believed would boost organic traffic before we started this project:
- Longer content with subtitles: Increasing the length of the content and adding relevant H2 and H3 subtitles to give the reader more detailed and useful information in an organized fashion.
- Changing the H1 so that it matched more high-volume keywords using Moz’s Keyword Explorer.
- Changing the URL so that it also was a better match to high-volume and relevant keywords.
- Adding a relevant image or graphic to help break up large “walls of text” and enrich the content.
- Adding a relevant video similar to the graphic, but also to help increase time on page and enrich the content around the topic.
We tracked all five of these changes across all 200 URLs (see image above). After a statistical analysis, we learned that four of them helped our organic search traffic and one actually hurt.
Summary of results from our statistical analysis
- Increasing the length of the articles and adding relevant subtitles (H2s, H3s, and H4s) to help organize the content gives an average boost to organic traffic of 14%
- Improving the title or H1 of the URLs yields a 9% increase on average
- Changing the URL decreased traffic on average by 38% (this was a smaller sample size — we stopped doing this early on for obvious reasons)
- Including a relevant video increases the organic traffic by 4% on average, while putting an image up increases it by 5% on average.
Overall, the boost to organic traffic — should we continue to make these four changes (and avoid changing the URL) — is 32% on average.
Key takeaway:
Over half of that gain (~18%) comes from changes that require a minimal investment of time. For teams trying to optimize on-page SEO across a large number of pages, we recommend focusing on the top landing pages first and easy wins before deciding if further investment is warranted.
We hope this case study of our on-page SEO efforts was interesting, and I’m happy to answer any questions you have in the comments!
Hey Patrick,
Thanks for sharing this useful case study but about one thing I am really shocked is you experienced 38% decrease (on average on changing URL) in organic traffic. Can you please provide below information:
What sort of change was it in URL?Did you redirect (301) the old URL to new one?Did you replace all old internal linked URLs with new one on your website?What was the duration to analyse these changes in traffic?
Thanks in advance, may be this information can help us to identify the exactly reason of decrease in traffic.
Hi Asim, thanks for the question...
I think the 38% decrease from changing the URL should be looked at critically. Once we saw such a negative impact we decided against making that change moving forward. Thus, the sample size for this specific change is VERY small (I cant recall the exact # but it's in the detailed report that is linked in the article).
Yes, when we changed the URL a 301 redirect was placed on the old URL to the new one. Duration was 28 days.
I would place much more weight in the positive results that were measured since this was over a much larger sample size. :-)
-Patrick
Thanks for this clarification! I also wondered if you tried redirecting the old URL to the new...I guess it might take a while for that big of a change (URL) to catch up.
Seems to vary for every website which is why it's difficult to choose whether to amend a websites structure or not. Personally I feel if a sites structure is dated and difficult to navigate around then it needs the update, even if it does lead to lower rankings for a while, as in the long run this should benefit the site further. Of course this depends on many factors.
Actually I've also come across a situation where we saw an initial decline in rankings after making a URL change on our site after implementing regionalization. So instead of the previous, /product-page we now have /us/product-page and /au/product-page. However after a couple of months and with thorough testing prior to going live in setting up canonicals, redirects etc, we started to see our lost rankings come back again and rank each page in its intended region. And now its a rather positive change which we made. So I think such initial drops should be taken with a pinch of salt as it needs to a) be analyzed further and b) be recorded a quite sometime
Nevertheless this is also impacted by other factors as well, so even if it worked on Site X it doesnt necessarily mean it would work the same on Site Y.
I believe that the decrease in traffic is due to having less url, but I do not know for sure. We made a change in the pagination of our ecommerce reducing url and lost traffic, we returned to change the pagination again and instead of leaving it as we initially gave it more pages. With this the traffic went up a lot the same month and stabilized there.
Hey Patrick Curtis,
Yes, algorithm change impact is the major issue which has affected many websites in the recent time and the growth graph of many websites has been affected. The crests and turfs of the graphs are not elevating as if for now in the recent years.
Well Indeed Patrick, this is a great info which you have shared with us.
Thanks alot.
Thanks Anup - glad you found it useful!
Hi Patrick,
Very interesting read. Thanks for sharing with us :)
A couple of questions I have is on average how long are the videos you were adding to the page and what sort of increase in time on page did you see?
Cheers,
Casey
Hi Casey - our main priority was to find relevant high quality videos ... we tended to favor ones that are shorter (5-8 min) with high quality images/graphics that come from a verified or legit account (other things being equal). we did not track increase in time on page but that would be interesting to see! Maybe on an update post? :-)
I like the idea of consolidating may walk url's to make one or two strong ones. It's the basic idea that many smalls make one large; And many weaklings strong one.
What I find encouraging is that you were able to gain more traffic simply by adding images, video, and H1 headers based on keyword research.
It shows that on page SEO works well on pages that already get traffic. But making the changes on those that are not yet ranking for anything...
It would not have given the same result; Or it would have taken much longer.
Thanks Patrick!
Thanks Nikola - agreed! I think the results were so good because we were already working with pages that had high potential but had not been given much (if any) optimization for on page SEO...
The video is a strategy that we are applying right now, and the truth is that it increases the reading time on the page.
Definitely it is a good idea! :P
Thanks for sharing this case study! Great results and really useful information :)
Great text Patrick.
I've recently did a "Merge and Purge" at my own website and the results were very good and for a very low amount of work (my site is only a couple of hundred pages long).
By redirecting low value/low access pages and/or setting them to No iIdex at the sitemap, we concentrate the link juice of our site to more relevant pages, increasing their ranking and number of organic visitors.
We also have less pages to optimize internally (H1, H2, and so on...), reducing our overall work to optimize the remaining pages in order to increasing their visibility and CTR .
I recommend it to everyone, even with small and medium sites/blogs.
We have done this before, but the long-term payoff has been minimal. How long have you analyzed the traffic for? Can you update us 3-6 months from now as well?
Hi, Patrick!
The fusion of all the comments in a single publication is the task of the moderator of the forum and makes the user experience much easier.
I think it's a great idea to highlight the original publication, but I have a doubt about it. Does leaving an old date affect visits? Maybe it would be a good idea to upload the best answers (which will be of more recent date) at the beginning of the publication.
Great post! best regards!
Hi Estentor, I also have this doubt. I read that older pages mean better ranking at google. I think this should be considered when grouping similar posts. I always try to keep the page with most traffic and consolidate the others to it. But it may also be a good Idea to keep the oldest post and update this content so we benefit from both oldness and great content. Is this be a good idea, a better practice?
In the forums there are many pages and some with almost the same subject, so it is a great idea to concentrate content in several urls to strengthen them and focus the user in a few pages. The embedding of videos is interesting, we do not do it on the web, but yes on the blog, and the results are good, especially if you embed a video of the YouTube channel, Google rewards you.
Thanks Patrick!
Thanks for the kind words! It was good to see the reward from such a simple change (even if small).
It's true, thank you for writing this post :)
Hi, Patrick. Thank you very much for sharing the information and see how just changing H(1-4), adding image and video can improve a page.
On the other hand I have been shocked with this paragraph:
"This was a massive project that involved some complex Excel sorting, but after 18 months and about $ 50,000 invested (27,418 children merged into 8,515 masters to date), the user experience, site architecture, and organization is much better."
I would have liked to see the faces of those responsible when making the decision of that task.
Congratulations and keep growing :)
This is really interesting. I have a small blog, with around 180 posts. A third of these posts (oldest ones) were written and posted before I learned about SEO/using Yoast etc, so are SEO poor. Would you recommend that I work my way through them all to bring them up to SEO 'good' standard - or (because they are old posts) - would you delete them and focus on the new content? I never know what to do for the best.
I would focus on any that get decent traffic first (decent = somewhere close to the average of your site) and/or those that are directly relevant to products or services you offer (would therefore make the investment of time worth it if one of them did improve markedly)...The ones that are not SEO optimized but are still getting some traffic implies that with some SEO optimization that they could see some nice gains. If they are getting limited to 0 traffic, probably not worth the effort.
Hi Patrick,
Thanks for sharing such an informative case study. It will help a lot in tackling such drastic scenarios of drop in organic traffic or drop in ranking. Keep up the good work.
great to hear Akash!
Great article. We have been wondering the same thing with our site ~ what to do with older posts that are still relevant in todays climate. I also love the "Plateau of Pain" analogy because I have been there.
When you mention about using a relevant video are you producing the video or finding a relevant video to share?
Thanks for posting.
Hi,
Thanks Patrick for sharing the case study. It was of great help to me, even I was facing same issue not so much down-fall but a bit of it. I came across your article and applied the same strategy to my website and the output was great.
Really Thanks for the article.
Hi Patrick, It is really cool experiment and thank you for sharing it here with us.
I am wondering about the Title change on the experiment. What kind of changes did you do and do you use any formula on that revised title?
Hey Patrick,
Thank you so much for sharing this! I've been doing an SEO audit and implementation strategy for the largest online forum in the country where I live - almost 3 million indexed URLs! It was mind blowing, so I'll try to dig deeper into your case study.
Very cool. If you want to chat offline about it you can reach me at [email protected]. We've learned a lot over the past 5 years! I'd love to learn more from you as well.
Hi Patrick!
Great read, thank you for sharing! Do you know what specifically about changing the URL caused that tactic to not work? Were redirects not implemented properly, or was the URL structure changed at all? Just curious if there were other mitigating factors there.
Hi JR - I wouldnt read too much into that result since it was on such a small sample size (and the time period measured may not have been enough for the new URLs to potentially "recover"), but anectodally some SEO consultants we were working with at the time also discouraged changing the actual URL to anything new and instead focus on changing the H1/ title since they were already generating traffic...
I recently modified our website's URLs because they were too long and MOZ pointed out how to improve. Our site fell from Google's top 12 to 51+ in a few days. This change is very damaging so? How soon can we recover this loss? Get to know our website at Advento Desentupidora.
When you have a website where the user writes the content there is some risk of this happening, but it is a good strategy to put together similar content.
The same strategy is often used in blogs to power the strongest URLs, so why not use it in forums as well?
Good reading, Patrick!
This is a great read and also an inspiring one for anyone who is having lagging results in their efforts. I recently made some similar changes to a clients site and as you also noted the small investment of time made up for the search results and overall conversion. Too many times I think that we set it and forget it in terms of SEO content and strategy, but instead of just continuing to pile on more we can accomplish so much by looking back at what we have done and crafting it better. This happens to me as well with web development the more times I come back to a build I can improve on the elements that are already there.
Thank you for this wonderful contribution to the moz community.
Thanks for the kind words Tim!
Honestly these are some of the most intense onpage optimization i've look into for a while now. I even started really researching about onpage seo just recently and came across this page by accident but am really happy i did. Will put strategy #1 to good use on my site
Hi Patrick
You have shared very useful case sturdy. These things are very useful to my blog. Thanks for sharing with us!!
Hi Patrick
Thanks for sharing awesome case study. On-Page is a soul of any kind of websites. I ll implement these recommendation....
That's a costly merge and purge project! Great job!
Great article Patrick! With you every day we are more experts.
Well Great piece of information (Y)
I guess merging one type of pages can increase the rankings as well as it boosted traffic for your forums, I am testing this strategy on our websites. I have experienced this strategy on some other websites too, it can also minimize the chances of "Content cannibalization".
One thing which is very strange for me is that changing in URL decreased the traffic for you. Had you placed 301 redirect and for how much time do you observed the drop?
good post Patrick! I have learned a few things that I will take into account from now on.
Great advice re 'merge and purge' but *gulp* at the cost!
Well... I was wondering is it necessary to move my website my HTTPS (Secured Site) version even if I don't have any forms (ed contact form)...
SSL is a must on every pages.
I'm crazy of an article which has done an experiment.
For me, on page Seo is so vital in order to engage the visitors.
Thank you Patrick.
Hey Patrick Curtis,
True, the overall advancement or changes in the alog's had major impact on many of the websites. I see less probability for any sudden improvement, but its true we all as marketers always have a way out!
On the other hand this was well informative post, thanks for all your efforts and contribution!
Cheers.
About merge content. How if the child contents we need to merge located in different subdomain?
Agreed. Today I learned new thing. Thanks for sharing the point of merging the two or more post with two to three comments toghether. I run two forum called EmbroideryShristi and TechShristi and in both the forum, I am facing the problem of user generated. As suggested by you, I will check and will back to you with the result. Thanks for sharing this. I was really in need of it.
Just a question, if you can help me. If i merged the two or more post then how do i can take care of the old url? How should i redirect the old url to new? Please help
It's a very good and complete checklist for those who want to make changes to their traffic strategy
Thank you for your sharing
Hi, thanks for the detailed report and case history, especially for the percentages, where you have illustrated how each element boosts organic traffic.
Very interesting article.
In the next three months I'm going to do architectural changes in my web:
- Change page hierarchy to get semantic sense urls.
- Build page with a lot of content to redistribute link juice and authority.
- Keyword research to improve content and H1...H3 headers.
This article enforces my strategy but leaves me a bit concerned about changing urls....
Regards,
Czd
yes, I would be careful about changing URLs, especially to pages that already enjoy some traffic...
Hi Patrick, nice case study about how could optimize our organic traffic with minimum ON-page changes thanks for sharing with us..
Great article Patrick! I also had really good success for merging smaller posts with one topic theme into one strong post, it even works well for smaller websites too. Thanks for sharing the case study. Cheers.
Could you clarify the url structure for your merge and purge action? You say that you removed the child url and put that user content and your content under another url that was more "pillar" content. Wouldn't this create a very long page between your text and the user's comments? I have seen this typically done by creating a folder using a "/" for the main topic and then putting all the relevant content within that folder. Are you doing something different than this?
Thanks for posting this helpful article.
Hi Steve, great question. you can see an example here: https://www.wallstreetoasis.com/forums/investment-...
So basically we have the "pillar" URL that discusses "Investment Banking Analyst: Day in the Life"...that discussion itself originally only had 4 comments...after merging in 4 "children" URLs into that Master/Pillar URL (all with the same topic), that one piece of content has 144 comments.
Those related topics/discussions (and their comments) were merged as new COMMENTS into the pillar URL and marked with a bold blue outline and tagged "Related Topic" (including date of original post) so that people can now read the ~4 other relevant discussions without having to jump to 5 different URLs (1 master and 4 children in this case).
For someone that is really interested in this topic, this likely increases time on page and improves user experience (even if it does create massive / long pages).
Does that answer the question?
Thanks,
Patrick
That is a lot of annotations. :) Interesting that before annotations you were steadily climbing. It went down when you started messing with it.
ha! to be fair, traffic increased along with the annotations dramatically throughout 2012 and our "plateau of pain" starting Nov 17 2012 corresponds almost exactly to other forums (see the story of metafilter) with long tail losing a significant amount of organic search traffic. So I wouldn't blame our tinkering even though we have broken many many things along the way :-)
Literally algorithm updates make the most impact on the website traffic.. Thanks for sharing the case study
You're welcome Ashok, thanks for reading.
First, congratulations on increasing your organic traffic with 32%. absolutely incredible that you did that by only 4 On-Page SEO Changes! I definitely agree with the fact that you need to optimize your top landing pages to an almost perfect level because that will get you the most result for the least efforts. I think that in today's world with all those massive distractions like social media and the fallen attention span of people from 12 seconds in 2000 to 8 seconds today, it is crucial that pages are relevant with easy to get information. With that in mind, I think it is safe to say that adding videos or pictures to a page will get you more engaging visitors.
Keep up the good work!
Thanks Elias! We're trying!
Great results! Congratulations and thanks for the article.
When adding videos, did you simply embed YouTube videos? Did you employ any additional markup around the video on-site or in the sitemap?
Great article. At JustAnswer we're in a similar boat and in the middle of some of the on -page SEO upgrades you mentioned. Our most recent project was creating a page like this for each of our 217 topics:
https://www.justanswer.com/law/
We have a dedicated SEO content like you mentioned. We're still struggling with some of the backend stuff, and our next task is to create 5 high-quality related articles for every one of those 217 pages (!!!) to leverage link juice.
Thanks for the stuff to ponder!
thank you for sharing the experience with us, I intend to make some changes to see the increase, I have avoided it a little for the doubt of losing traffic (It has already happened to me)
Changing the Urls is one of the main reasons for decreasing your traffic!! So do properly research on how to make Url and then create. By the way good information Patrick!!
Onpage SEO is the backbone of SEO, Thanks for sharing the case study learned a lot :)
Great tips Patrick! Interesting how relatively simple on-page improvements can have quite an impact
We do similar things here at Survey Anyplace, but it is difficult to attribute traffic growth directly to the changes because there are so many other factors & things going on
Thanks Patrick for your informational post. I think on page seo is soul of a website and powerful method for get organic traffic. Please describe how much H1, H2, and H3 tag are adding a content. And also please inform the perfect video duration. Thanks
Hi Patrick Curtis,
I am working on a travel website since last 6 months.
I am doing SEO On page and Off page activities.
But, Still their is no improvement in terms of rankings and traffic. Please, help me out with valuable inputs and other activities.
Thanking you,
James Horner
This is a great case study. I was at Brighton SEO this week and heard of a similar one, where a website removed over 90% of its content (or merged) in order to improve UX. The results were higher SERPs and conversions.