As marketers, many of us leverage Twitter as a direct traffic tool - sharing URLs via the service to encourage clicks and visits to help increase awareness, branding and possibly drive some direct actions (singups, sales, subscriptions, etc). But, from what I've seen and experienced, not many of us spend time thinking about how or taking action to improve the CTR we get from the links we tweet.
Given that I have 21K+ followers, but most of the links I tweet generate 150-250 clicks, my CTR is only averaging 1.34%
As analytics junkies, we're well aware that we can only improve things that we measure, analyze and test. So let's look at a process for measuring our tweets, analyzing the data and testing our hypotheses about bettering our click-through-rates. If we do it right, we could increase the value Twitter brings us as a marketing and traffic channel.
First off, we're going to need some data sets that include each of the following:
- Profile Data
- # of followers
- # of following
- # of tweets
- # of tweets on avg per day
- Tweet Data (only on tweets containing a unique, trackable URL - e.g. bit.ly/j.mp)
- # of clicks
- # of retweets
- time of day
- tweet structure (e.g. text, url, text VS url, text VS text, url VS text, url, hashes)
This can be time consuming to grab, but if you know how to use Twitter & Bit.ly's APIs, you could make a more automated system to monitor this. Once you've assembled these, you'll want to build a spreadsheet something like this:
I've made the version I created for my own stats public here on Google Docs to help provide an example. With the help of my Twitter history page and the bit.ly+ system (which allows anyone to see the click stats on any unprotected bit.ly link) I constructed a chart of my last 25 tweets containing URLs where I had personally created the bit.ly link (retweets and tweets where I used links from others would be noisy and unusable for this particular purpose).
Using this data, I can ask some interesting questions and learn the answer, including:
Do My Wordier Tweets Earn Higher CTR?
To answer, we merely need to look at the number of words per tweet compared against CTR. We can then build a graph to visually illustrate the data.
The trendlines (in dashes) are showing me that there's a slight pattern, and Excel's correlation function returns a value of -0.262, suggesting that there's a very subtle correlation between shorter tweets and more clicks. I might try testing this in the future with particularly short tweets, since my average word length is 15.88 with a standard deviation of only 3.88 (meaning most of my tweets are consistently lengthy).
Do My Shorter Tweets Perform Better?
Let's try asking a similar question as above, but look at the raw length of the tweet. According to Hubspot's data (as presented by Dan Zarrella), shorter tweets are more likely to be retweeted, so perhaps a simliar relationship exists for CTR.
The results are similar, but a little stronger here. The correlation is -0.335, again suggesting shorter tweets might be getting higher CTRs. My average tweet is 108.92 characters in length (standard deviation of 16.94). Given this datapoint and the above, I'm certainly tempted to try a bit more brevity in my tweets.
Do On/Off Topic Tweets Affect My CTR?
In order to find out whether the topic focus of my tweets has an impact on the click-through-rate, I had to create a numerical value mapped to the degree of "on-topicness," then assign that to each URL. Since I'm in the SEO field, my profile says I'm going to be tweeting about SEO, startups and technology and the majority of my tweets are on these subjects, I decided on a scale like this:
- 0 - On a completely unrelated topic
- 1 - On a topic subtly related to marketing/technology/startups/SEO
- 2 - About tech, marketing or startup subjects, or pseudo-on-topic for SEO
- 3 - Specifically about SEO
I then made the following chart representing this data next to CTR:
The correlation function suggests this is a bit higher: 0.43, suggesting that when I tweet about the topics people expect to hear from me about, a higher percentage of them click those links. That's not unexpected - in fact, I would have predicted a higher correlation (and who knows, across a larger dataset, it might have been stronger).
Is My CTR Improving Over Time?
This is a pretty simple one to answer.
Sadly, that answer is no. I hit my peak in early October with a few choice tweets and haven't had much in the high ranges since that time. This is a good lesson in why it's important for me to be monitoring, testing and working to improve, as I'm clearly not doing that through meer experience.
On a broader scale, we also recently conducted some research analyzing 20+ different Twitter accounts and hundreds of tweeted URLs from them. You can see the raw dataset here looking at ~250 tweeted URLs with CTR data, and several metrics about each of the accounts tweeting them. Our hope was to see whether any of the metrics could help predict a higher vs. lower CTR.
The following chart illustrates our findings:
Basically, no single metric about an individual's Twitter accout was particularly predictive of higher CTR with the exception of TwitterGrader Rank. However, in this case, a higher numeric rank (meaning a "worse" rank) had a higher corrrelation, suggesting the relationship is awkwardly inverse. We were also bummed to see that Klout scores, which we'd hoped would be predictive of CTR, were barely correlated.
One interesting thing we found - average CTR across all 250+ tweets to be only 1.17% (0.024 standard deviation). Thus, I shouldn't feel too bad about my 1.34% average CTR.
The research, unfortunately, didn't lead us to any great conclusions, but we are planning to revisit the problem again in the future with larger datasets and more variables. For now, you can download the full report here. Feel free to share, but please do attribute to SEOmoz if/when you do.
While these types of analysis can be interesting, it's not a scalable or practical solution for most marketers. What we need is a tool that can automatically analyze our Twitter accounts, collect more and better metrics, and run over them in an automated fashion. That tool doesn't exist today, but someone should really build a "Twitter Optimizer." If you've got the skills and are feeling up to it, but need financial remuneration, SEOmoz would be happy to contract to have that built - just drop me a line (rand at seomoz dot org).
p.s. Special thanks to Ray Illian for compiling the research and the report above.
Excellent analysis. I still find it curious that Twitter Grader is oddly inversely correlated to CTR. I'm going to try and figure out what I could possibly be doing wrong.
Pretty weird right? Check out the full report for details, but basically, the correlation was looking quite good until we realized it was inverted because lower ranks are better scores.
One thought - it could be biased due to the selection set (we specifically chose users active in the marketing/technology arena so as not to have noise from different "niches" on Twitter).
Considering the huge amount of twitter data the Hubspot twittergrader has collected, wouldn't be a great thing to see a collaboration between SEOmoz and Hubspot about Twitter CTR metrics in the name of the Internet Marketing Science?
Infact, Rand & SEOmoz have conducted the experiment choosing a small - even though representative - twitter universe and a very specific kind of twitter user (tech and web marketers).
The interesting would be to see if the results can be replicated on a larger scale and if there is a consistency between different kind of users.
Great job Rand (food for stats thoughts) and great job Dhamesh for your graders tools.
Post Scriptum: my comment has been written in a pure Open Source Moment :)
Rand and I are friends (as are SEOmoz and HubSpot). Would be happy to open up our Twitter Grader database for a collaborative project some day.
Rand: Lets try to do the next one jointly and see if something even cooler comes out (maybe you can help me figure out if there's a way to improve the Twitter Grader algorithm).
gfiorelli1 (and RandFish & Dshah),
Similarly, our company 3#Labs (https://threepoundlabs.com) is also developing some powerful technology to optimize content sharing on social networks.
Our technology, though we are moving towards an open API, can be seen demonstrated in our consumer application https://Queued.At. Basically, our goal is to help anybody who is sharing content on social networks to be able to get the most bang for their buck. And we are putting some serious science and math behind it.
To your point gfiorelli1, we'd *love* to do some experimenting with HubSpot and SEOmoz one day ;) !!
All the best,
Eric VanderSchaaf
@ericvs
The reduction in CTR over time is a trend I'd have expected, and one that I expect we'll see continue.
As Twitter grows and matures, each user will tend to follow more and more people. As their 'following' count increases, each of us will have more competition for our followers time - and our tweets will appear on the first page of their time line for measurably less and less time.
If it's possible to calculate the 'average number of people followed by each of my followers', I suspect that may correlate well with any particular person's CTR.
Loved the blog post! Good stuff.
I think this data can be skewed by topic and the type of Twitter user in the mix. Take my B2B technology and my B2C music clients for example:
The hip hop group will retweet virtually anything regardless of length, content, or tag. I could say something as generic as I just drank coffee and if I were considered cool in that arena, they'd all tweet it.
The technology - aka C-level geek crowd - is much more particular. They like short tweets that are highly targeted and controversial. I could have the best content around, but if it isn't easily digested, concise, and an attention grabber, it won't go anywhere.
The part I love about this post and Twitter is it is unchartered territory. It is fresh and new and we are all still getting our feet wet and figuring it out.
There has to be enough room for atleast one person to RT your message if you want it to be spread, it's annoying sometimes when people put an essay into a 140 characters and adds in (plz RT)...
The change between the old school and new style RT has surely impacted on the chances of the message going viral but since that feature was rolled out it would be hard to look back at data and say on 12th March 2010 at 1pm the RT behaviour changed...
So if that particular segment/niche will RT anything does that mean they are not engaged and less likely to click it?
That's some good thought put in there Rand! Particularly on the on-topic bits and the relationship between what you say you are(your bio) vs what you actually are(your daily tweets).Action point for me to reword my bio a little. Thanks!
Word length is easy.
Big ideas are hard.
My hunch is if your research shifts from variables like word count to variables like intensity of promised information, curiosity, paradox, etc, that you may discover larger correlations.
I also sense that those who tweet heavily have a lower click through than those who tweet less. I may be way off on this one - but tweet grader gave me some interesting feedback - though I wasn't scientific about it...
Keep up the great research.
There are two things that will greatly impact your CTR, not mentioned here:
1. How many individuals even SAW your tweets with links?
2. How many individual browsers clicked the same link multiple times?
Until you know this, it is nearly impossible to get a true CTR. Your click through is likely much higher that the data you have here.
I think that CTR is very difficult to measure if it's based on followers anyway, because there's no guarantee that only followers look at your Twitter profile and click your links. Particularly when competitors are involved.
We go by number of clicks (in HootSuite) rather than a CTR.
Wow! Timely -- Next Analytics just released a public beta of their Excel add-in that will pull all the Twitter data for you! bit.ly is in the works! Automation here we come! Guess I should post a bit.ly link :-) https://bit.ly/dlOzem
interesting.. thanks. i'd like to add this mini-tool that may also provide some interesting twitter-analytics insights:
https://bit.ly/BITLYme
Isn't the key thing your're missing here the time of day tweeted? I would have thought that is one of the most important metrics.
Would you ever consider re-tweeting a link to the same article more than once? Perhaps worded differently?
i know there is all sorts of data on that but it also depends on your audience, if you are in Australia between 11am-2pm is good but if you tweet or content is specific for US or UK... delayed or scheduled tweets can reach that audience, but interesting about changing the language and time... but is that too many variables to measure?
Relevancy and time of day are the 2 single most important factors.
My work at the worlds leading and largest Networking company (not gonna mention it - but you can guess) led us to realise that 9am Tweets and lunch time Tweets received the most CTR.
Catchy, viral Tweets relevant to your audience was absolutely key. We had CTR around 2-3%.
That's interesting, because 9am (ish) tweets are popular with our followers, but lunchtime is usually very quiet. I guess it depends on the industry.
- Jenni
I'm quite rookie on this matter, as to be able to support my opinion with some numbers or researches, but I'll tell you what happen to me regarding SEOmoz and Rand's tweets: I'm currently following SEOmoz posts through RSS (Google Reader), Facebook and also Twitter. Most of the times, I read first the posts when I get the updates in GReader, or even when you share the links in Facebook, so when I see your tweets, I've already read all the news I received via other sources.
So, the point is that many of the followers you have in Twitter may be also getting to SEOmoz through RSS or Facebook. In my case, reading feeds has more priority in my daily to-do list than reading tweets. I think it would be great to know how many of your followers in Twitter are following you only there, and not getting to the blog directly, or RSS, Facebook, etc.
I think that your right... but you miss also an important thing about Twitter: the RTs
Infact, how much of the CTR has to be considered 1st generation (from the tweet received by a follower) and how much from 2nd/3rd generation (from rt of the follower): to know this could help knowing better how far the influence of a tweet can reach.
Finally, talking about use of Twitter, I usually come directly here, but when SEOmoz tweet the link to a new post I usually RT it. And even if I have not actually clicked on the URL (no CTR), then from Ow.ly stats I see that others have clicked on it thanks to my sharing (2nd generation CTR).
... I hope my blabbling is making sense :) ...
There is a little more insight into this Randfish Klout.... but it's still too early to know the possible reach that one popular tweet might have....
Very interesting. Thanks for sharing!
I've noticed my own tweets get much different CTRs depending on the time of day and day of week. It would be awesome if you had info about that too.
I suspect your CTR is much higher once spam and dormant accounts are filtered out. The rate should really only be derived from the number of people that have the opportunity to click - the same way you don't count hard bounces in the return rate of an email campaign.
If CTR is what you're after... the stats from your Tuesday evening post should be interesting LOL ;-) ---> Whatever you do... DO NOT click this link!https://seomz.me/aHD93H [actually I triple dog dare you to click it]
I think looking at cumulative clicks (or CTRs), as opposed to some arbitrary time series (say clicks in the first 48 hours) is inherently biased towards older tweets. At the extreme, a tweet from last year has had much more time to be clicked on than one from the last hour. I think this is an all too common analytic mistake people make, though it's admittedly only a small improvement. It also can be applied to email marketing.
Another benefit of time series #s is that they're immutable. You won't keep wondering why the old numbers changed when you update your spreadsheet.
Great writeup. For a simple tool that'll give you the CTR for all your tweets, try https://140ctr.com
Maybe my coffee hasn't done it's magic yet, but I think I just read an article studying the click-through rates of tweets based on the number of words in the tweet!??!?1
Have you gone so far down the statistical rabbit-hole that you've forgotten about social engineering, sales tactics, sexy headline tricks and all the rest?
I would bet all the pub change still in my pocket from last night that the number of words has little to nothing to do with the number of cilcks received.
Tweet something like "Top 10 sexy illegal seo-tactics that the government doesn't want YOU to know about revealed (pic)" and see what that does for your CTR!
Then be sure to link it to a page full of pictures of cats and the internet is yours for the taking! :)
Hi! Excellent article! I have a question,...How can we calculate CTR?? How can we know the number of impressions of each tweet?? I'll be grateful for an answer! Thank's!
Sorry, Rand, but this analysis doesn't make sense to me. Can you tell me what is represented by the X axis on the first graph? Is it time? If so your linear best fit lines don't really make much sense. I would have thought if you wanted to visualize a correlation between tweet length and CTR a scatter plot with Tweet Length on one axis and CTR on the other would have been more helpful.
Very well put. I have yet to see such an easy break down
@kqlcik
Wow, that report goes into a lot of depth. Really pushed my statistical comfort zone, well done!
Twitter's CTR, great subject. & a great article randfish!
I love this type of data, Rand. I'd love to see this analysis trying to solve for RTs as well as CTR. I wonder if you'd see anything different?
Rand wait where is the graph or data on time of time influence? One point of data that is much harder to calculate is which platform or URL shortner gets the best CTRs
Does T.co work better than Wp.me or is bit.ly just awesome?
Since bit.ly is the only one we can see public click stats on, right now, it's the only one we're using.
hmm... damn them for being the only awesome and transparent platforms
Rand, very interesting. I see similarities to the challenges faced when using PPC advertising - in which the call to action is constrained to the 25 character headline limit that Google imposes in Adwords.
I find that including numbers and symbols seems to help improve click-through-rates. But in your spreadsheet, the four tweets that include numbers only earned an CTR of 1.17 - lower than your overall average. It would be great to analyze this with a larger data set.
Off the top of my head, other metrics I would want to measure:
I'd love to hear more and I can't wait for the Twitter tool you propose!
About the Twitter Tool... let's spread the SEOmoz offer to all the Devs/Algos genious we all know. I did it.
Hi Rand,
I think the analysis is spot on but want to raise an issue that I'm struggling with sorting out in my mind. It's the way we measure influence. It's got to be more than just # of clickthrus. For B2B audiences especially, I'm convinced that mindshare is a more relevant measure of effectiveness. Do you have any suggestions for other ways to measure this? I'd probably start by segmenting followers by their relative level of influence, and then view their Twitter interactions with me separate from those with less "influence". Thoughts?
Patricia
Nice data collection. Do you think those stats are similar with RSS feed ? Wording, number of posts, ...
Thanks !
Another metric that may benefit would be figure out which tweets generated the most new followers. Finding what kind of information is most likely going to be shared or retweeted would be invaluable to any link baiting campaigns or analyses of your regular followers/subscribers.
Thanks for these great tips Rand.
I'm getting good at SEO, but I still lack some good social media knowledge I guess... :D
This is a lot of work to do by hand, so the idea of a tool to do it for your would be marvellous. I'm sure there must be a developer out there who could do it. And there has to be a ton of potential customers. Who wouldn't want to know which tweets are effective which are not?
Terry
Awesome..awesome..awesome.....