Editor’s Note: This subject line contest is no longer accepting entries. In the next few weeks, we will read all of the entries, select the best ones, and then run the test. Then, check the MarketingExperiments blog in a few weeks to see which entry won, why it won, and what you can learn from that to further improve your own marketing.
This blog post ends with an opportunity for you to win a stay at the ARIA in Vegas and a ticket to Email Summit, but it begins with an essential question for marketers…
How can you improve already successful marketing, advertising, websites and copywriting?
Today's Moz blog post is unique. Not only are we going to teach you how to address this challenge, we're going to offer an example that you can dig into to help drive home the lesson.
Give the people what they want
Some copy and design is so bad, the fixes are obvious. Maybe you shouldn't insult the customer in the headline. Maybe you should update the website that still uses a dot matrix font.
But when you're already doing well, how can you continue to improve?
I don't have the answer for you, but I'll tell you who does – your customers.
There are many tricks, gimmicks and technology you can use in marketing, but when you strip away all the hype and rhetoric, successful marketing is pretty straightforward – clearly communicate the value your offer provides to people who will pay you for that value.
Easier said than done, of course.
So how do you determine what customers want? And the best way to deliver it to them?
Well, there are many ways to learn from customers, such as focus groups, surveys and social listening. While there is value in asking people what they want, there is also a major challenge in it. "People's ability to understand the factors that affect their behavior is surprisingly poor," according to research from Dr. Noah J. Goldstein, Associate Professor of Management and Organizations, UCLA Anderson School of Management.
Or, as Malcolm Gladwell more glibly puts it when referring to coffee choices, "The mind knows not what the tongue wants."
Not to say that opinion-based customer preference research is bad. It can be helpful. However, it should be the beginning and not the end of your quest.
…by seeing what they actually do
You can use what you learn from opinion-based research to create a hypothesis about what customers want, and then run an experiment to see how they actually behave in real-world customer interactions with your product, marketing messages, and website.
The technique that powers this kind of research is often known as A/B testing, split testing, landing page optimization, and/or website optimization. If you are testing more than one thing at a time, it may also be referred to as multi-variate testing.
To offer a simple example, you might assume that customers buy your product because it tastes great. Or because it's less filling. So you could create two landing pages – one with a headline that promotes that taste (treatment A) and another that mentions the low carbs (treatment B). You then send half the traffic that visits that URL to each version and see which performs better.
Here is a simple visual that Joey Taravella, Content Writer, MECLABS create to illustrate the concept…
That's just one test. To really learn about your customers, you must continue the process and create a testing-optimization cycle in your organization – continue to run A/B tests, record the findings, learn from them, create more hypotheses, and test again based on these hypotheses.
This is true marketing experimentation, and helps you build your theory of the customer.
But you probably know all that already. So here's your chance to practice while helping us shape an A/B test. You might even win a prize in the process.
The email subject line contest
The Moz Blog and MarketingExperiments Blog have joined forces to run a unique marketing experimentation contest. We're presenting you with a real challenge from a real organization (VolunteerMatch) and asking you to write a subject line to test (it's simple, just leave your subject line as a comment in this blog post).
We're going to pick three subject lines suggested by readers of The Moz Blog and three from the MarketingExperiments Blog and run a test with this organization's customers. Whoever writes the best performing subject line will win a stay at the ARIA Resort in Las Vegas as well as a two-day ticket to MarketingSherpa Email Summit 2015 to help them gain lessons to further improve their marketing.
Sound good? OK, let's dive in and tell you more about your "client"…
Craft the best-performing subject line to win the prize
Every year at Email Summit, we run a live A/B test where the audience helps craft the experiment. We then run, validate, close the experiment, and share the results during Summit as a way to teach about marketing experimentation. We have typically run the experiment using MarketingSherpa as the "client" website to test (MarketingExperiments and MarketingSherpa are sister publications, both owned by MECLABS Institute).
However, this year we wanted to try something different and interviewed three national non-profits to find a new "client" for our tests.
We chose VolunteerMatch – a nonprofit organization that uses the power of technology to make it easier for good people and good causes to connect. One of the key reasons we chose VolunteerMatch is because it is an already successful organization looking to further improve. (Here is a case study explaining one of its successful implementations – Lead Management: How a B2B SaaS nonprofit decreased its sales cycle 99%).
Another reason we chose VolunteerMatch for this opportunity is that it has three types of customers, so the lessons from the content we create can help marketers across a wide range of sales models. VolunteerMatch's customers are:
- People who want to volunteer (B2C)
- Non-profit organizations looking for volunteers (non-profit)
- Businesses looking for corporate volunteering solutions (B2B) to which it offers a Software-as-a-Service product through VolunteerMatch Solutions
Designing the experiment
After we took VolunteerMatch on as the Research Partner "client," Jon Powell, Senior Executive Research and Development Manager, MECLABS, worked with Shari Tishman, Director of Engagement and Lauren Wagner, Senior Manager of Engagement, VolunteerMatch, to understand their challenges, take a look at their current assets and performance, and craft a design of experiments to determine what further knowledge about its customers would help VolunteerMatch improve performance.
That design of experiments includes a series of split tests – including the live test we're going to run at Email Summit, as well as the one you have an opportunity to take part in by writing a subject line in the comments section of this blog post. Let's take a look at that experiment…
The challenge
VolunteerMatch wants to increase the response rate of the corporate email list (B2B) by discovering the best possible messaging to use. In order to find out, MarketingExperiments wants to run an A/B split test to determine the best messaging.
However the B2B list is relatively smaller than the volunteer/cause list (B2C) which makes it harder to test in (and gain statistical significance) and determine which messaging is most effective.
So we're going to run a messaging test to the B2C list. This isn't without its challenges though, because most individuals on the B2C list are not likely to immediately connect with B2B corporate solutions messaging.
So the question is…
How do we create an email that is relevant (to the B2C list), which doesn't ask too much, that simultaneously helps us discover the most relevant aspect of the solutions (B2B) product (if any)?
The approach – Here's where you come in
This is where the Moz and MarketingExperiments community comes in to help.
We would like you to craft subject lines relevant to the B2C list, which highlight various benefits of the corporate solutions tool.
We have broken down the corporate solutions tool into three main categories of benefit for the SaaS product. In the comments section below, include which category you are writing a subject line for along with what you think is an effective subject line.
The crew at Moz and MarketingExperiments will then choose the top subject line in each category to test. Below you will find the emails that will be sent as part of the test. They are identical, except for the subject lines (which you will write) and the bolded line in the third paragraph (that ties into that category of value).
Category #1: Proof, recognition, credibility
Category #2: Better, more opportunities to choose from
Category #3: Ease-of-use
About VolunteerMatch's brand
Since we're asking you to try your hand at crafting messaging for this example "client," here is some more information about the brand to inform your messaging…
VolunteerMatch's brand identity
VolunteerMatch's core values
Ten things VolunteerMatch believes:
- People want to do good
- Every great cause should be able to find the help it needs
- People want to improve their lives and communities through volunteering
- You can't make a difference without making a connection
- In putting the power of technology to good use
- Businesses are serious about making a difference
- In building relationships based on trust and excellent service
- In partnering with like-minded organizations to create systems that result in even greater impact
- The passion of our employees drives the success of our products, services and mission
- In being great at what we do
And now, we test…
To participate, you must leave your comment with your idea for a subject line before midnight on Tuesday, January 13, 2015. The contest is open to all residents of the 50 US states, the District of Columbia, and Canada (excluding Quebec), 18 or older. If you want more info, here are the official rules.
When you enter your subject line in the comments section, also include which category you're entering for (and if you have an idea outside these categories, let us know…we just might drop it in the test).
Next, the Moz marketing team will pick the subject lines they think will perform best in each category from all the comments on The Moz Blog, and the MarketingExperiments team will pick the subject lines we think will perform the best in each category from all the comments on the MarketingExperiments Blog.
We'll give the VolunteerMatch team a chance to approve the subject lines based on their brand standards, then test all six to eight subject lines and report back to you through the Moz and MarketingExperiments blogs which subject lines won and why they won to help you improve your already successful marketing.
So, what have you got? Write your best subject lines in the comments section below. I look forward to seeing what you come up with.
Related resources
If you're interested in learning more about marketing experimentation and A/B testing, you might find these links helpful…
- A/B Split Testing — How to use A/B Split Testing to Increase Conversion Rates, Challenge Assumptions and Solve Problems
- Don't Fall Into the Trap of A/B Testing Minutiae
- A/B Testing: Example of a good hypothesis
- Multivariate Testing: Can you radically improve marketing ROI by increasing variables you test?
- Marketing Campaign: Landing page optimization can help improve the return on your media spend
- Landing Page Optimization Online Course
- Online Testing Course
- Beyond Marketing Kaizen: How a CMO gaining line of sight into the testing-optimization cycle can drive triple-digit ROI improvements
- Online Marketing Tests: How could you be so sure?
- A/B Testing: Split tests are meaningless without the proper sample size
And here's a look at a previous subject line writing contest we've run to give you some ideas for your entry…
- Are You a Copywriting Hotshot? Test Your Skills in an Email Marketing Duel
- A/B Testing for Fun and Profit [Subject Line Writing Contest]
- Announcing: Winners of the Email Subject Line Contest
- Email Marketing: What elements of your offer get people to click? [Subject line contest winner announced]
Good read!
I'l throw in a suggestion for #3, Ease of Use
Subject Line: No Hassle Volunteering: There's an app for that.
As a former political hack who has sent tens of millions of emails looking looking for volunteers ( and former cofounder of the calling campaign app phonebank.org), the most important thing I saw with b2c volunteer recruitment was connecting with local activists. The more segments you can create with local info in the subject line (and in the body of email), the better your cumulative open/click rates will be, and most importantly, it will increase the actual real life conversion numbers.
When people create accounts on volunteermatch.org they currently enter a zip code. I would make this a prime criteria for segments, unless you have even more information about users.
Peer pressure and local hooks move people to volunteer. Rhetorical tricks rarely convert to real life action.
For category #1 of b2c-- you should try to send as many of them as possible with location specific details in the subject line -- something like:
[X people in Y city] are ready to volunteer with you
Or
Want to work with [x animal rights activists in Y state?]
From a higher level, I'd use a similar strategy for nonprofit outreach. I'd figure out the main city of target nonprofits and then find how many current users you have in each city, then send mail-merged emails with that custom info. Subject lines could be something like:
We have X people ready to volunteer in Y city
You could also do it by category - so categorize all nonprofit targets and then send an email like:
We have 62 animal rights activists ready to volunteer
For B2b outreach, I'd focus on a success story - you will have a much longer sales process with b2b and need to explain it like a five year old, so the effort could be explained to a board.
The narrative could be something like, "companies that volunteer together, work better together" or maybe something from a pr focus, like, "make your company impact on the community."
Either way, I'd make sure that the call to action links to an information page - a sick info graphic or nice video - something that is easy to digest and share. The b2b call to action should not be an app install or generic homepage visit - you should really focus on a detailed visual sales pitch with plenty of opportunities for visitors to reach out, and potentially a live chat during business hours - these are potentially whales - so you should take their website visits and interest more seriously.
//
Seems like a cool app - love the contest -- Good luck!
Nice article but I also can't participate. Unless I buy my own ticket. Still love to help out off course:
So if I got this correctly, you want subject lines for the different categories. Here's one you could use (maybe for all):
"Make a difference helping out good causes".
Maybe to simple but it tells you what you can expect in the E-mail and it suits the Brand identity.
Regards
Jarno
Category #1:
Connect with your coworkers. Change the community.
Good Read! But I am from India so cant participate :(:(:(
#1 - Volunteering matters. We have the proof.
#2 - Thousands of volunteering opportunities in 2015.
#3 - Register and track volunteering on-the-go with our mobile app.
Bah, scheduling conflict means I wouldn't be able to accept the prize for this. Feel free to keep my suggestions in your testing effort, though :)
Very nice article. And who doesn't like a contest.
Busy at work, but here are my three:
1) Volunteering Hopes for 2015
2) Volunteering opportunities for 2015
3) Mobile volunteering app makes helping your community a breeze
I may have gotten carried away, but this was pretty fun!
Category 1:
Category 2:
Category 3:
Great article. About test A/B, i made test in wordpress, not in email marketing. About to use it in wordpress at the post's titles, I use this plugin: https://wordpress.org/plugins/google-content-exper... .
About email marketing, toos like GETRESPONSE use test A/B in their campaigns.
Category #1: Proof, recognition, credibility
Category #2: Better, more opportunities to choose from
Category #3: Ease-of-use
Category 2
"Let us help you find your calling"
Subject Lines:
Category 1: Hello, I am a wealthy prince from the nation of Zamunda and I have a business proposition for you...
"Just Kidding, but we do know..."
Category 2: Can we help you see a double rainbow? Oh my! Maybe even a triple rainbow...
Category 3: What? Others Help?! "Ain't nobody got time for dat!"; Or do they?
#3. Will it Blend? Volunteering and You: There's an App for that!
After reading several interesting articles about the psychology of do-gooding I had to post one more subject line - Category #1: Nobody Likes a Do-Gooder - Alienate your boss today.
#2 - Sure free bagels at work are nice, but THIS would mean so much more...
#2 - You and Your Company CAN Make a Difference!
#2 - Great Way to Get the Whole Company Involved!
#3 - Improve your life AND community with this Mobile App!#3 - Volunteering Opportunities at Your Fingertips...Literally!
I like :)
Fun contest. Here are my entries:
Category 1: Wow. We can do that together?
Category 2: Tired of the Soup Kitchen? We got more.
Category 3: Volunteer while on your phone. Sort of.
-Rock
Austin, TX
Good post ! But I am in France and I can not participate because the date is exceeded..
I often use A/B testing in my job, for new designs.
I too love a fun challenge!
Category #1: Proof, recognition, credibility
Work together. Make a difference together.
Celebrity Apprentice. Imagine if they really worked as a team.
Category #2: Better, more opportunities to choose from
Volunteering. It's about teamwork and options.
Volunteering. Unite teams with options.
Discover what else you have in common with your coworkers.
Get paid to support your cause.
Category #3: Ease-of-use
Volunteering counts more when it's measureable.
Make a difference. Have it count.
Work, play and the causes you support can coexist and be measured.
Category #1: Proof, recognition, credibility
"Take that new open-layout plan on-location: Build a real community"
Category #2: Better, more opportunities to choose from
"Free after work? Someone sweet could use your help"
Open e-mail to photo of soft, furry animal. Photo branded with volunteermatch watermark.
Category #3: Ease-of-use
"Need another resolution? Easier than running, we swear."
OR
"You don't have to run to do yourself some good"
Of course, to be submitted no later than January 31st
Category 1: You Know the Benefits, Help Others Get Them Too
Category 2: Help Wanted: Thousands of Opportunities
Category 3: How Can You Help? Easier than People Think
#1 - 2015 Is Your Year to Make a Difference
#2 - Discover How Your Strengths Can Impact a Community
#3 - Volunteering Just Became a Whole lot Easier!
Category #1: Sign Your Coworkers Up For A Vacation Category #2: Research Has Shown That People Who Volunteer Live LongerCategory #2: Research Has Shown That People Who Volunteer Have Better Sex Lives Category #3: Proof This App SAVES Lives
Category #1- Great Volunteers, Great Causes, Great Results
Category #2- It's a Big World. Volunteer Here.
Category #3- Be There. Click Here.
Category 1: Volunteering Matters in 2015 - See Why
Category 2: Give Employees 1,000 Volunteer Opportunities
Category 3: Easily Track Employees Volunteer Efforts
Category #1: Proof, recognition, credibility
Matching Passion with Purpose
Match Your Passion with Purpose in 2015
Connecting People with their Passions
Category #2: Better, more opportunities to choose from
A Thousand Ways to Help
More Opportunities, More Choice, More Ways To Help
Volunteering is Good For You
Category #3: Ease-of-use
Harnessing Mobile to Find Passionate Volunteers
Making a Difference Made Easy
We Use Mobile to Make Volunteering Easy
I can't participate for a prize,but i'll try to help:
#1 - Volunteers make the world a better place.
#2 - Thousands of opportunities to leave a legacy.
I am from Australia. Discriminatory.
Also do you have to use AB testing there is better science out there for this task?
John,
There are many ways to learn about your customers. Focus groups. Surveys. Etc.
But when it comes to having a scientific understanding of your customers, observing their behavior in a controlled experiment is the most scientific approach because your discoveries are based on empirical and measurable evidence.
But it isn't the A/B test itself that is scientific, your entire approach must follow scientific principles. A/B testing is simply a way to run a controlled experiment with your customers.
Here is a basic primer on A/B testing (while it was published several years ago, the same basic information is still true today and you may find it helpful)...
A/B Split Testing — How to use A/B Split Testing to Increase Conversion Rates, Challenge Assumptions and Solve Problems
Daniel
There are numerous paths to Rome. There are many tools in the tool box. In my view to obtain the optimal outcome, given limited traffic etc I would suggest a Discrete Choice Model, which is a controlled experiment/survey where you need less people for more accurate results. Need 100 people and test a few thousand possibilities in a few hours. A focus group or two would be a great start but not an option here to finalize the options to test.
The Discrete choice experiment would take you to the Apex of the solution where can can A/B test the final choices.
With A/B Testing, you are forced to discount every other variable to influence a decision notwithstanding they are relevant variables in the process. It is a tough starting point and unlikely expeditiously you get to the right end point. Especially as a charity you want to nail it.
I will leave and watch the results come in. It has me intrigued and like everyone I do like a competition.
Good luck with it. Next time let us Aussies in.
Nice information, unfortunately cannot participate as I am from India
Regards
Satta Matka [link removed]
You could write an entire post just on the initial header of "give people what they want". Love the ideas here, and the basic help in understanding A/B testing. Fantastic resource!
Great contest :)
Category #1: You volunteer. Now get your co-workers involved!
This article, competition and test is great on so many different levels. Nicely done Daniel Burstein.
Looking forward to the results of the split test. Here are a few subject lines...
Category 1:
Show your employer how volunteering matters in 2015
Category 2:
Can your biz or employer help YOU do good in 2015?
Good causes + good employers = more ways to make a difference in 2015
Category 3:
Find volunteer matches in a snap with our app
I've used VolunteerMatch in the past to help me find volunteer opportunities. Thank you!
The challenge, I think, for the B2B list, is employers will have to get employees to "buy" into volunteering. When I worked for an international real estate company, my co-workers grumbled (I did on occasion.) about having to volunteer when they had other things to do in their lives, like go to parent-teacher conferences. Today, most people are strapped for time. And most people volunteer because they want to do so. With that said, here are my subject lines:
Category #1: Proof, recognition, credibility
Volunteer, Make Connections
Volunteer, Make an Impression
Volunteering Impacts Your Community
Volunteer and Get Known in Your Community
Volunteering Builds Teamwork
It's True? Volunteering is Good for Your Career.
Volunteer, Develop and Build Your Skills and Get Promoted!
Volunteering Makes You Feel Great!
Category #2: Better, more opportunities to choose from: Employees Choose Where to Volunteer
Choose Where You Volunteer
Got a Passion? VolunteerMatch Matches You with Volunteer Opportunities.
Thousands of Volunteer Opportunities!The Choice is Yours.
You Won't Believe Where You Can Volunteer
Yes! Claim Your Volunteer Opportunity NOW!
Category #3: Ease-of-use
Volunteer with One-Click
One-Click Volunteering
Click Now! Volunteer Tomorrow!
1. Volunteering counts
2. Choices for volunteering
3. Volunteering is easy
Great contest guys! Smart way to "crowdsource" this :). I'll chip in a few ideas...
Category #1: Proven way to help your company help the world
Category #2: This app gives you thousands of opportunities to change the world
Category #3: The ability to improve your community in the palm of your hands
And then there's a general shortened version of the Cat. 1 idea: Help your company help the world
Thanks,
Realluy so much valuable information.