Posts Tagged ‘audience measurement’

Simple Framework for Marketing Campaign ROI Measurement

I speak so often with clients, at conferences, or with colleagues about measuring the success of a campaign that I figured it made sense to share some of the thinking here.  I’d love to get your critique, ideas, and input.  To me, the basics are simple… people, process, and priorities make it complex.

The way I see it, marketing campaigns need to be evaluated for two reasons:  (1) to demonstrate progress (for the CFO), and (2) to inform mid-course corrections to improve results (for the CMO, marketing teams, agency, etc.).  And, I guess this won’t surprise anyone who knows my bias, the most effective measurement efforts put people in the middle:  what you need me (person) to think, feel, or do to engage in a relationship with you (brand).

Too often, evaluation is relegated to measuring what easily can be, rather than what should be, tracked.  To avoid this pitfall, campaign measurement should be built around concrete business goals and the efficiency of specific tactics to deliver on the expected outcomes (thoughts, feelings, and actions among our target audiences) that will make those goals a reality.

Using this approach, the basic framework for the campaign evaluation should be tracking (A) Business Goals, (B) Consumer Journey Outcomes, and (C) Channel / Tactic Efficiency.

picture-12

Progress toward Business Goals are tracked within client data systems (hopefully).  They need to be timely, specific, and accessible.

Consumer Journey Outcomes simply means how you believe your marketing efforts are going to influence people.  At the basic level, marketing is about creating a demand for a relationship, activating that relationship, and maximizing the (mutually beneficial, we hope) relationship over time.  So this is what we should track in this area.  And the metrics showed in the middle column above give you some ideas of how/what to track.

Consumer Journey Outcomes must either be observed or measured through some type of survey research.  In every case, metrics within this area require you to ask a random sampling of your target audiences a series of questions.

Channel / Tactic Efficiency is all about how much we spend on specific campaign elements, how many people they reach, and how long / how often our target audience is engaged with, or by, these tactics.  Of course, there are interesting things you can do today in this area, too, that get at engagement with the tactic/channel/content that is more than just reach.  But, in the end, these metrics are all channel-centric. And, I believe this still is what most people are referring to when they talk about ROI measurement.  But, hopefully I’ve made a case why they are meaningless without the context of the Consumer Journey Outcomes.

At the very least, huge value can be realized if we simply report progress against Business Goals, Journey Outcomes, and Tactic Efficiency.  Combining all three over time, there are really cool things you can do as you track in these areas to map the relationship between specific tactics to journey outcomes to business goals.  Those tactics (messages or channels or a combination) most effective can be increased, those not working can be modified or eliminated.

So, there it is.  Hope this helps someone thinking through what to measure rather than measuring what you can!

07

08 2009

Social Media Panel at Audience Measurement 4.0 Stumped

What question do you suppose would leave a panel of leading experts in media measurement stumped?images During an otherwise informative and interesting panel discussion at the opening session at yesterday’s Audience Measurement 4.0 conference (put on by the ARF), such a question was asked that resulted in dead silence.

Irfan Kamal of Ogilvy PR Worldwide was the first to capture on Twitter the noticeable lack of response from the panelists to a question about planning for social media within media mix discussions.

Me_100x127_normal
irfankamalSocial media panelists asked how a marketer can evaluate which
channel to spend how much on - no answers from panelists..#am4.0
about 18 hours ago from TwitterBerry 

 

The keynote panel was titled Forecast 2015: Social Media & Their Impact on Audience Measurement.  The discussion was good and the participants were solid:  John Burbank – CEO, Nielsen Online, The Nielsen Company; Chris Cunningham – Founder and CEO, appssavvy, Inc.; Dean DeBiase – CEO, TNS Media; Joe Doran – Founder and CEO, Media6°; and David Smith – CEO, Mediasmith, Inc.

None could answer, however, the audience generated question about “how do I fold in social media into mix decisions?”  Burbank eventually broke the silence by giving a basic “it depends” answer along with “the tools will catch up.”

It’s a tough question.  How do you determine the most effective and impactful spend levels for social media in your overall media plan?  Marketing mix models and econometrics can provide a rear-view mirror analysis to guide budget and mix decisions.  But what if you want to try something you’ve never before done and, therefore, you don’t have any past data, but you still need help anticipating what might happen and how much you should spend on the effort?  These tools alone can’t effectively address such an need.

Enter agent-based simulation techniques.  

Companies like Icosystem, ThinkVine, and Decision Power, among others, are findings ways to create a “virtual test market” from the individual person up, rather than only using the aggregate/total data across the system.  More will come along as they see the benefits of using these tools in tandem with marketing mix and econometric models.

Basically, this technique defines rules of engagement for millions of “agents” (think people as well as media, messages, and other influencers in the real game of life) within a specific environment.  Rules mean how “agents” behave and interact with other agents, etc.  

Once all of the agents are programmed, computers run thousands of simulations to tease out and identify emergent behavior (something that hadn’t been there before and couldn’t be seen without the modeling).  This forward-looking simulation allows you to play what-if scenarios for marketing activities you’ve never before tried.  How does that work?  Because you build the simulation from the bottom-up, you’re modeling individual human interactions and not just looking at the historical relationship between aggregate data like how much you spent and how many people bought your stuff while you spent that.

At our company, PURSUIT, we apply Icosystem’s Concentric platform to our client needs for planning, optimizing, and reporting ROI on all channels, including new and social media. I love it because it is truly people centric in its very design and execution. You have to define how people behave as individuals, then let them interact with each other to see what new behaviors emerge. 

Don’t get me wrong, econometrics and marketing mix models have a solid role to play in analytics and campaign resource allocation.  They’re ideal for incremental improvements in efficiency and effectiveness (how do I get more out of my mix this quarter as compared to last, etc.).  

But, answers to the question posed yesterday will be more fully addressed when marketers and advertisers embrace the application of simulation tools that mimic individual people and how they interact within and across the worlds in which they live.  These tools can directly address the questions of “how do I fold social media into my mix” and/or “what will happen if I try this?”

24

06 2009