With all the data that today's marketers can access, there's often still no substitute for the quality of information you can get from interviewing real people. In today's Whiteboard Friday, we welcome Rebekah Cancino -- a partner at Phoenix-based Onward and #MozCon 2016 speaker -- to teach us the whys and hows of great interviews.
Video Transcription
Hi, Moz fans. I'm Rebekah Cancino. I'm a partner at Onward, and I lead content strategy and user experience design. Today I'm here to talk to you about how to support the data you have, your keyword data, data around search intent, analytics with real life user interviews.
So recently, Rand has been talking a little more about the relationship between user experience design and SEO, whether it's managing the tensions between the two or the importance of understanding the path to customer purchase. He said that in order to understand that path, we have to talk to real people. We have to do interviews, whether that's talking to actual users or maybe just people inside your company that have an understanding of the psychographics and the demographics of your target audience, so people like sales folks or customer service reps.
Now, maybe you're a super data-driven marketer and you haven't felt the need to talk to real people and do interviews in the past, or maybe you have done user interviews and you found that you got a bunch of obvious insights and it was a huge waste of time and money.
I'm here to tell you that coupling your data with real interviews is always going to give you better results. But having interviews that are useful can be a little bit tricky. The interviews that you do are only as good as the questions you ask and the approach that you take. So I want to make sure that you're all set and prepared to have really good user interviews. All it takes is a little practice and preparation.
It's helpful to think of it like this. So the data is kind of telling us what happened. It can tell us about online behaviors, things like keywords, keyword volume, search intent. We can use tools, like KeywordTool.io or Ubersuggest or even Moz's Keyword Explorer, to start to understand that.
We can look at our analytics, entry and exit pages, bounces, pages that get a lot of views, all of that stuff really important and we can learn a lot from it. But with our interviews, what we're learning about is the why.
This is the stuff that online data just can't tell us. This is about those offline behaviors, the emotions, beliefs, attitudes that drive the behaviors and ultimately the purchase decisions. So these two things working together can help us get a really great picture of the whole story and make smarter decisions.
So say, for example, you have an online retailer. They sell mainly chocolate-dipped berries. They've done their homework. They've seen that most of the keywords people are using tend to be something like "chocolate dipped strawberries gifts" or "chocolate dipped strawberries delivered." And they've done the work to make sure that they've done their on-page optimization and doing a lot of other smart things too using that.
But then they also noticed that their Mother's Day packages and their graduation gifts are not doing so well. They're starting to see a lot of drop-offs around that product description page and a higher cart abandonment rate than usual.
Now, given the data they had, they might make decisions like, "Well, let's see if we can do a little more on-page keyword optimization to reflect what's special about the graduation and Mother's Day gifts, or maybe we can refine the user experience of the checkout process. But if they talk to some real users -- which they did, this is a real story -- they might learn that people who send food gift items, they worry about: Is the person I'm sending the gift to, are they going to be home when this gift arrives? Because this is a perishable item, like chocolate-dipped berries, will it melt?
Now, this company, they do a lot of work to protect the berries. The box that they arrive in is super insulated. It's like its own cooler. They have really great content that tells that story. The problem is that content is buried in the FAQs instead of on the pages in places it matters most -- the product detail, the checkout flow.
So you can see here how there's an opportunity to use the data and the interview insights together to make smarter decisions. You can get to insights like that for your organization too. Let's talk about some tips that are going to help you make smarter interview decisions.
So the first one is to talk to a spectrum of users who represent your ideal audience. Maybe, like with this berry example, their ideal customer tends to skew slightly female. You would want that group of people, that you're talking to, to skew that way too. Perhaps they have a little more disposable income. That should be reflected in the group of people that you're interviewing and so forth. You get it.
The next one is to ask day-in-the-life, open-ended questions. This is really important. If you ask typical marketing questions like, "How likely are you to do this or that?" or, "Tell me on a scale of 1 to 10 how great this was," you'll get typical marketing answers. What we want is real nuanced answers that tell us about someone's real experience.
So I'll ask questions like, "Tell me about the last time you bought a food gift online? What was that like?" We're trying to get that person to walk us through their journey from the minute they're considering something to how they vet the solutions to actually making that purchase decision.
Next is don't influence the answers. You don't want to bias someone's response by introducing an idea. So I wouldn't say something like, "Tell me about the last time you bought a food gift online. Were you worried that it would spoil?" Now I've set them on a path that maybe they wouldn't have gone on to begin with. It's much better to let that story unfold naturally.
Moving on, dig deeper. Uncover the why, really important. Maybe when you're talking to people you realize that they like to cook and by sharing a food item gift with someone who's far away, they can feel closer to them. Maybe they like gifts to reflect how thoughtful they are or what good tastes they have. You always want to uncover the underlying motives behind the actions people are taking.
So don't be too rushed in skipping to the next question. If you hear something that's a little bit vague or maybe you see a point that's interesting, follow up with some probes. Ask things like, "Tell me more about that," or, "Why is that? What did you like about it?" and so on.
Next, listen more than you talk. You have maybe 30 to 45 minutes max with each one of these interviews. You don't want to waste time by inserting yourself into their story. If that happens, it's cool, totally natural. Just find a way to back yourself out of that and bring the focus back to the person you're interviewing as quickly and naturally as possible.
Take note of phrases and words that they use. Do they say things like "dipped berries" instead of "chocolate-dipped strawberries?" You want to pay attention to the different ways and phrases that they use. Are there regional differences? What kinds of words do they use to describe your product or service or experience? Are the berries fun, decadent, luxurious? By learning what kind of language and vocabulary people use, you can have copy, meta descriptions, emails that take that into account and reflect that.
Find the friction. So in every experience that we have, there's always something that's kind of challenging. We want to get to the bottom of that with our users so we can find ways to mitigate that point of friction earlier on in the journey. So I might ask someone a question like, "What's the most challenging thing about the last time you bought a food gift?"
If that doesn't kind of spark an idea with them, I might say something even a little more broad, like, "Tell me about a time you were really disappointed in a gift that you bought or a food gift that you bought," and see where that takes them.
Be prepared. Great interviews don't happen by accident. Coming up with all these questions takes time and preparation. You want to put a lot of thought into them. By asking questions that tell me about the nature of the whole journey, you want to be clear about your priorities. Know which questions are most important to you and know which ones are must have pieces of information. That way you can use your time wisely while you still let the conversation flow where it takes you.
Finally, relax and breathe. The people you're interviewing are only going to be as relaxed as you are. If you're stiff or overly formal or treating this like it's a chore and you're bored, they're going to pick up on that energy and they're probably not going to feel comfortable sharing their thoughts with you, or there won't be space for that to happen.
Make sure you let them know ahead of time, like, "Hey, feel free to be honest. These answers aren't going to be shared in a way that can be attributed directly to you, just an aggregate."
And have fun with it. Be genuinely curious and excited about what you're going to learn. They'll appreciate that too.
So once you've kind of finished and you've wrapped up those interviews, take a step back. Don't get too focused or caught up on just one of the results. You want to kind of look at the data in aggregate, the qualitative data and let it talk to you.
What stories are there? Are you seeing any patterns or themes that you can take note of, kind of like the theme around people being worried about the berries melting? Then you can organize those findings and make sure you summarize it and synthesize it in a way that the people who have to use those insights that you've gotten can make sense of.
Make sure that you tell real stories and humanize this information. Maybe you recorded the interviews, which is always a really good idea. You can go back and pull out little sound bites or clips of the people saying these really impactful things and use that when you're presenting the data.
So going back to that berry example, if you recall, we had that data around: Hey, we're seeing a lot of drop-offs on the product description page. We're seeing a higher cart abandonment rate. But maybe during the user interviews, we noticed a theme of people talking about how they obsessively click the tracking link on the packages, or they wait for those gift recipients to send them a text message to say, "Hey, I got this present." As you kind of unraveled why, you noticed that it had to do with the fact that these berries might melt and they're worried about that.
Well, now you can elevate the content that you have around how those berries are protected in a little cooler-like box on the pages and the places it matters most. So maybe there's a video or an animated GIF that shows people how the berries are protected, right there in the checkout flow.
I hope that this encourages you to get out there and talk to real users, find out about their context and use that information to really elevate your search data. It's not about having a big sample size or a huge survey. It's much more about getting to real life experiences around your product or service that adds depth to the data that you have. In doing that, hopefully you'll be able to increase some conversions and maybe even improve behavioral metrics, so those UX metrics that, I don't know, theoretically could lead to higher organic visibility anyway.
That's all for now. Thanks so much. Take care.
Hi Rebekah,
Research is better than guessing. I couldn't agree more.
A couple of questions:
Thanks in advance.
Eric
I second this. Especially the recruiting part.
What;s your initial pitch and how hard do you push those who ignore your requests or take long to answer?
It is good to interview a few people to make sure the facts and data is coherent I suppose.
1-on-1 is the way to go to get insight about user behavior. Focus groups should only be performed early in the project to discover your target audience.
Hey Eric and Igor,
Great questions! I totally agree with Tim on only using focus groups early on as part of the process to identify your audience (IF you use them at all). I find it's helpful to think of the different segments of your audience by categories of behavior, rather than role or position. Some of that nuance comes out during the interviews, there are always distinct groups of people by behavior. So it's nice to wait on creating personas or finalizing audience segments until AFTER you're talked to some real customers/users.
But anyway, to answer your questions:
1. You asked: "Do you do 1-on-1 or group focus group interviews?"
1-on-1 always. Here's why:
For more on this subject I highly recommend 'Just Enough Research' from Erika Hall. It's a great place to start, we took a lot away from her book and used it to inform our process.
2. You asked: "How do you go about selecting and recruiting the interviewees?" and "What's your initial pitch and how hard do you push those who ignore your requests or take long to answer?"
Igor,
A bit more on the recruiting part for you. In my earlier response I talked about about how I reach out to existing customers and sometimes work with recruiting firms for harder to reach folks (on projects with bigger budgets). But for startups when you're working from scratch, sometimes it helps to get creative. There are lots of crazy ways to do this, but some I've been a part of include:
Hope that helps! Happy to chat more about this.
Hi Rebekah,
Though I agree to the notion that taking group interviews can influence the opinions, however isn't that the case with individual opinions, that they would be influenced by person's state of mind and the environment of interview.
What's the best case scenario for taking interviews that are totally unbiased and carry real opinion of the interviewers.
Regards,
Vijay
Hey Vijay,
Thanks for your thoughtful response! You're totally right about how 1-on-1 interviews can be biased, too. That's why I go through a lot of careful planning to make sure the person I'm talking to feels at ease and start with simple questions that give them a chance to warm up. Whether the 1-on-1 interviews are in person, over Skype or Google Hangout, or over the phone (I prefer to see people I'm talking to because body language and expressions can be so helpful, but any real conversation is helpful), there's a few things you can do to help put them at ease.
In addition to reviewing my questions to make sure they aren't leading or biased, I typically:
1. Send an email before the interview to help give them an overview of what to expect helps them understand:
2. Start with easy questions. Before diving into my most important question areas, I give them a chance to warm up and ask questions they don't have to think too hard about answering, like:
3. Be prepared and get relaxed. If I'm too nervous or too stiff, they'll feel that. There're a few things I do to make sure I'm ready, like:
4. If you are doing interviews in person, try to find a quiet, natural setting that's unintimidating. Real conversations don't happen behind two-way glass in brightly lit conference rooms.
Hope that helps! Let me know how it goes for you.
Rebekah Cancino , Your detailed reply and recommendations are much appreciated. They would be of great help for everyone.
Fantastic watch - and detailed post answers. Thank's so much Rebekah.
Awesome post, Rebekah!
Was very excited to see you were this week's guest after your MozCon presentation. Was very impressed with your insights and recommendations on delivering relevant experiences. Had a bunch of notes to bring back and discuss which I'm excited to dig into.
I felt what you said in this WBF was particularly interesting...
"Moving on, dig deeper. Uncover the why, really important. Maybe when you're talking to people you realize that they like to cook and by sharing a food item gift with someone who's far away, they can feel closer to them. Maybe they like gifts to reflect how thoughtful they are or what good tastes they have. You always want to uncover the underlying motives behind the actions people are taking.
So don't be too rushed in skipping to the next question. If you hear something that's a little bit vague or maybe you see a point that's interesting, follow up with some probes. Ask things like, "Tell me more about that," or, "Why is that? What did you like about it?" and so on."
SEOs tend to leave the "why" details out and look for face value quick wins. We need to get past this mentality and focus more on empathy for our users and delivering truly exceptional experiences that are built on solid reasoning and research. Users can tell when brands genuinely listen and when they pander. With tools out now we have an incredible opportunity to be connecting with users like never before. We need to be using these tools, but also researching WHY we are using these tools and HOW we can use these tools to help deliver relevant experiences.
/rant - great post and presentation - looking forward to more!
Patrick
Hey Patrick,
I love this rant! So rad that you were at MozCon, too! I learned a ton myself. Really glad to hear my presentation resonated with you.
I couldn't agree more on the need to just listen to people. Sometimes I'll catch myself listening only for the opportunity to jump in and be heard. This never works because then I can't really hear what someone's saying because I'm too busy thinking of how I'll respond. Brands get caught in this same trap sometimes. It's rad that you are thinking about how your organization can do a better job at JUST listening. I'd love to hear what tools you use and how that's going for you later!
Funny thing about the short term wins vs. long term results. Sometimes there are short term wins that come WITH long term strategies but we don't notice them. Before I dive into (or pitch) any long term play, I spend some time up front thinking through what short term benefits we might expect. Sometimes they're things like more click throughs, or a higher time on site/lower page view count, or even just less calls with questions around a particular topic. It's cool to think about what evidence (or micro-conversions) could I define and show along the way that would indicate this is working, even if it's not the ultimate big conversion point.
Anyway, keep in touch! Happy to chat more about this anytime (I'm sort of obsessed). :)
Hi Rebekah,
It's good to see Rand taking a break and letting other members at Moz give us new perspectives.
The problem with interviews is that they don't provide right incentive for target users to participate. The incentive need not be something like a freebie but something that would be of interest to target audience, and make them engage in a conversation.
I find Moz's Q&A section a real good example of what a right incentive can look like, you are giving right incentives in terms of points and their benefits for the target audience to participate.
It takes some understanding of your target audience to prepare a right interview where people would interested and excited to participate.
What do you say?
Regards,
Vijay
Yes! Totally agree with you here. I talked about a couple more traditional incentives in an earlier response to this post, but there's tons of room to get creative, too. (Like you mentioned with Moz and the points you get for responding to questions and just being helpful.) I think the right answer is always to start wth thinking about the people you're asking information from and what they would enjoy. What makes them feel important, appreciated, or valuable? Of course that answer will vary a lot depending on who you're talking to, but the more often we can figure that out and then build our incentives around those preferences the better!
Thanks Rebekah, I hope Rand is enjoying the break :)
Terrific post! I really enjoyed your presentation at Moz as well. The point "listen more than you talk" is so hard for us as marketers! We like the idea of listening to our customers and being customer centric, but when the rubber meets the road, most of us just want the customer to confirm the points that we already want to push and believe are true.
Knocked it out the park! Great job Rebekah!
Thanks, Cody!
I loved the checkout example at the end.
We have been creating a bunch of videos to solve customer issues JUST LIKE THAT, but we never thought to ask THE CUSTOMERS which issues were most important to them!
Totally! One thing I noticed when doing interviews in the example I mentioned in the video, is that people didn't realize at first what content was most important to them. We kind of had to come at it in reverse. For example, at first we would ask the person to walk us through what things looked like for them after clicking purchase. In the responses, we noticed they mentioned things like obsessively clicking refresh on the packing tracking information, staking Facebook to try and figure out where the gift recipient would be, etc.
From there we probed further had them unravel the feelings and thoughts behind those actions by asking follow up questions like "And why is that?" It was only then we started to draw a connection between that friction they felt and the lack of information around how the berries were kept fresh. It was only then that we started to see how providing content around what kind of packaging was used (how the box was like its own cooler) at checkout/ in order confirmation emails, and giving them more control over the shipping process could reduce that friction. If we would have started off by asking them what content was most important to them on the checkout page we probably wouldn't have gotten to the same point. It was a super helpful exercise for us!
Good luck with your interviews! Let me know how it goes. :)
Rebekah, you have a great screen presence. I hope to see more WBFs from you!
*blush* Thanks, Margery!
Love the idea of keyword research done right there out in the field. Great WBF, thanks!
Now I have to go and make some chocolate dipped strawberries :)
Right? Even when we're doing longtail keyword research, I love to talk to users first and see how they would search for things. Like what kind of phrases and descriptors they use. On a recent project for a paper supply company, we initially thought that customers might be searching for supplier related keywords as there was a lot of volume around that (like "paper supply company"), and while that was true, we learned that the target audience was also doing a lot of detailed product driven searches like "thermal receipt paper 3-1/8 x 230'". More importantly, the detailed product driven searches were how they STARTED their overall journey. Which was rad to know. We wouldn't have fully understood that nuance of intention if we didn't talk to real people!
On the chocolate covered berries note: DO IT! #treatyoself
Rebekah! Nice to see you. Rand feels some kind of freshness. This post is really informational for me. I like this post.
This Whiteboard Friday is certainly an eye opener for many people like me. Thanks a lot for sharing such a tremendous piece of information.
You totally made my week, Himanshu! Really glad to hear it was useful for you.
Cheers!
Great insights. Comments are also an excellent source to "feel" your visitors.
We do a lot of interviews here at Relevance; but mainly for content and PR. It is interesting to see your take on it to green data to help the SEO side and build even better content.
Where's Rand?? Haha just kidding, thank you for sharing your insights on this topic! Loved your suggestion of not putting pressure on the users to get honest results. "Feel free to be honest" is powerful!
Totally! That's one of the reasons I like to do 1-on-1 interviews and let them know their answers won't be shared in a way that identifies them personally. I'm always surprised by how candid people can be when we preface the conversations with that.
Hey Rebekah! This is great. I love this kind of stuff and I want to do so much more of it.
Is there any chance that you have resources or tips on just getting started with customer interviews? A few things come to mind:
- How do I request an interview from customers?
- How many people should I think about interviewing? How many should I ask?
- What are some standard, non-marketing questions to ask?
Just some thoughts :) Again, thanks! Loved the video.
Hey Josh,
Awesome! Glad you were feelin' the video and planning on doing more interviews! Talking to customers is really so helpful, and you can apply the insights to so many aspects of your marketing and product development, too. To answer your questions:
I posted some tips on how to request an interview in response to an earlier question, you might find that helpful. Here's a sample request email I've used in the past. You will likely need to change it up based on your exact needs, but it is a good starting point.
How many people you interview depends on a few things like: how much time and budget you have, how varied your target audience is, how many products and services you offer, and how geographically spread out your audience is.
To give you a contextual example, say I'm interviewing for a startup with a single offering targeting tech savvy young professionals, I'd maybe interview 12-15. If I were interviewing an array of healthcare professionals (doctors, surgeons, nurses, medical techs) for a company who manufactures pacemakers and has and global reach, I'd probably talk to around 30 healthcare professionals across a variety of regions, roles, and practice types.
Your goal is to have a sample size that lets you see patterns of what's happening beyond a very small number of people without throwing you into the process of endless data gathering and analysis, especially when you're dealing with time constraints.
Before deciding on the sample size that's right for you, it's helpful to first get real about your highest-value users and prioritize them aggressively, this way you can focus on those high priority folks first.
When it comes to what questions you'll ask, you want to make sure you're asking questions that reveal their context and how they make decisions. Don't ask them what they want or what they like, this is arbitrary stuff that can lead you down the wrong path.
Your questions should really just be short prompts that get the people you're interviewing to tell you a story about their real life. The kind of story where they reveal information about their attitudes and behaviors you didn’t even think to ask about. Here's a list of questions I start with, you'll prob want to customize and build them out based on your specific research goals.
Hope that helps! Let me know how it goes. :)
Hi Rebeca
Thanks for sharing this, I could not agree more on the importance of paying attention to the different forms and phrases used in my opinion is very important because you can define a little to the person
спасибо за видео, очень информативный
пожалуйста , скажите мне , что камера вы снимать видео с любым объективом
спасибо за ответ...
Hi there, thanks for the comment and question!
For Whiteboard Fridays, we use a Canon Mark III camera with this lens. :)
Hope that helps!
thank you very much
Hey Rebekah,
Good tips in here. I like the reinforcement of asking open ended questions instead of those typical marketer questions.
- Gaetano
Interesting! Thanks for your insights on this!
With interviews and well-formulated questions we can get to know what are the concerns and motivations of the client. Great post
Hi Rebekah,
Your insights were really good.
In case of the online behavior , how will predict it and develop insights from it ?
Thanks in advance
A.Ashiq Miandad
Good WBF. Its nice to see topics outside of SEO.
I have a great company I use for my UX testing...UserTesting.com. They do a great job in creating real life consumer tests. Video recordings of people using your website, and discussing why they are behaving this way, and how they feel. (or you can test your competitors website and discuss what they liked)
They have given us great insights to our consumers behavior over they years. Fairly expensive, but worth their weight in gold.
I love surveying and interviewing the perceived customer and the actual customer. It's a great way to get some understanding about what the customer wants and needs are, as well as the hows and the whys. Additionally I always get that nugget of information from them that takes me in a direction I hadn't previously thought of. On top of that, you can get some handy case studies / testimonials that can be used and promoted (and that they'll generally promote for you) and which you can generally align to different stages of the buying cycle.
Does anyone have suggestions on ways to find actual people within your target audience? The old stand by would be to talk to your existing customers but obviously they didn't have a problem ordering from you. So how do you go about finding this targeted, green audience?
usertesting.com
Hey John! Totally understand where you're coming from here. I used to run into this very thing when I worked a lot with startups. I'd say, start by defining "What does our best customer look like?" and unpack aspects of why that is. Then, have a discussion around okay, if these are our best customers, where do we actually deserve to win? Meaning, if you want to target a group of people, you better have the the right solutions in place to solve an actual need for them. A lot of times people will want to target a specific audience, but their products or services just aren't there yet when it comes to truly meeting that groups needs. So it's helpful to start off with getting clear about who we're targeting and balancing that with where we deserve to win. Once you have those priorities in place, there are a lot of creative ways you can recruit people for interviews. Check out my response to Igor earlier in the comments and let me know if that's helpful.
In a nutshell, read the best book on this topic: "Buyer Personas" by Adele Revella!
Outstanding read!
Just Enough Research by Erika Hall is great, too! Her book was really helpful when I was getting started and informed a lot of our process. :)
Thanks Rebekah, you make my day great with these informations
Good post Rebekah,
I find 1 to 1 conversations to be my most valuable resource, communicating outside of email helps customers put a "Face with a Name" and it becomes real. Our project coordinators send me emails of people to interview on a regular basis, this provides me insight into what encouraged their purchase, why us over our competitor and sometimes we get a review or testimonial as an extra benefit.
KJr
Hello Rebekah!
That was a nice good article!!
Can you please clear this doubt for me?
In the article at the beginning you have mentioned that we already have a lot of online data, but nothing beats offline actual interaction with people,so interviewing people
Works well for an already existing product in the market to obtain a product marketing fit?
OR
Works well for a new to the market products or service?
Hi Aishwaryah
Qualitative data helps both with existing product marketing as well as new products and services.
There is tons of market research you can do prior to launch to identify those who are most likely to be interested in your product, as well as how to advertise to them. However similarly to her example, it's hard to find the real and emotional "why" of your target market without actually talking to anyone.
Maybe you have determined your ideal audience is 20-30 year old professionals for your new app, which saves them time on organizational tasks. You might assume it provides value to them because they they tend to be busy at work and commuting, and want to speed up their organizational process. That is the what, but interviews will help uncover the WHY. The WHY might be because they feel like their job is robbing them of social time, or that they are simply annoyed with the volume of organizational tasks their job creates.
Understanding the why can help you steer your product development to better meet their needs, refine your value proposition, and create content that supports and reflects the actual desires and needs of prospective customers.
Hi Rebekah,... As beginner, I learn your important idea in supporting real data.
great job and a great article. the interviews with some great people will be more informative.