Actually deriving and optimizing rich intelligence from data and its analytic results is the tricky part. Absent critical thinking and deep understanding of customer behavior, and the business itself, data-driven intelligence will only be squandered, cheapened, or damaging if the only approach is identifying the next-most-obvious tactic.
This root-cause analysis for two different clients serves as a powerful example. Reporting revealed the same result: high email opt-out rates.
While the results were the same, the underlying drivers and the real opportunity were completely different. And when it comes to evaluating the effectiveness of your email marketing efforts, taking a deep dive and employing critical thinking is the only way you’ll know what’s really working. Let me explain….
Email Client Analysis #1: Who Are You Again?
The first client whose email analysis we feature is an international tech company. They sent a significantly greater number of emails in one month. The result was a surge in the opt-out rate.
The initial reaction was that the email volume was the cause. They had either sent too many messages to the same recipients, or drilled too deep into the file, or committed some sin that drove up the opt-out rate.
In fact, they had committed a sin. But not any of these.
The knee-jerk, tactical solution suggested was that the client send less email.
Statistical analysis revealed, however, that the greatest indicator of email opt-out was the length of time between messages. The client had waited too long, had not stayed front of mind for the reader, or had missed the window of opportunity completely.
Doing a back of the envelope projection of the cost of first acquiring, and then ignoring (only to lose these customers and prospects) did not tell a good-news story.
The impact of this insight was significant. It informed onboarding and message strategy going forward.
Had the client established a message cadence, perhaps extracting additive insights from each response to retarget messages to iteratively refine relevance, it would have maintained its option to market to these customers and prospects.
The company developed a new strategy as a result of this new intelligence, which was triggered by recognizing change in the opt-out rate.
This new perspective was only possible because critical thinking—looking beyond the easy answer—drove additional analysis. That same critical thinking extracted meaning from the results. And critical thinking was responsible for the strategic changes that resulted.
In contrast, had the company followed the tactical recommendation to reduce email volume, they would have unknowingly stimulated the very problem they were trying to fix.
Email Client Analysis #2: I Want What I Want
The second client whose email analysis we’ll feature is a financial services company. They too experienced a high email opt-out rate.
The same customers also opted out of the other proactive channels: telemarketing and, to a greater extent, direct mail.
Analysis revealed the profile of those most opting out of email: they had the longest tenure and the greatest value.
The reflex reaction was that these tenured, high-value customers were at risk. However, further analysis revealed that they had remained loyal and high value well beyond their choice to stop email and other communications.
I note the opt-out of the proactive channels as it was key to understanding the larger issue.
Customers were creating the relationship that they wanted. To remain loyal, and continue to participate as they did, customers had to define the terms. They were not interested in inboxes filled with irrelevant messages (or calls interrupting dinner, or mailboxes stuffed with multiple offers).
They wanted to control the relationship and opting out was their method.
The insight here was significant: It meant that the bank had to look to data to anticipate changes or needs, and had to employ more personal modes of interaction.
This client’s new strategy started by recognizing the difference in the opt-out rate.
Critical thinking prompted further analysis, and critical thinking was responsible too for creating intelligence from the result. Critical thinking conceived an effective strategy specific to the customer base and their needs.
It should be noted that the plan defined to solve the first client’s opt-out problem would not have been effective here. Had the financial services client tried to proactively engage the opted-out population, they would have driven attrition.
When Analyzing Email Campaign Results: The Difference Matters
The larger point when analyzing email campaign results is that the same results, high opt-out rates, had different causes and meanings for the two companies, and they are likely different as it relates to your campaigns as well. In my examples, extracting that meaning required understanding the individual businesses, their customers, their data, and critically applying context.
The companies could have taken the easy way out. They could have:
- Concluded the opt-outs were gone forever and continued business as usual
- Accepted the loss and increased customer acquisition investment—only to fuel the same result
- Increased investment in other channels
- Reduced email volume overall in hopes of not driving customers away
- In the case of the first client, it would have driven up the opt-out rate further
- In the case of the second client, it could have fueled attrition
- Nothing. They could also do nothing
The fact is that all these tactics could appear logical and rational and the next-most-obvious step.
But that is the true issue: Expecting that intelligence will happily pop up and present itself is magical thinking. Expecting that tactics will effectively address a complex business problem is also magical thinking.
What is required is critical thinking.
The examples serve to underscore the very reason that critical, strategic thinkers are necessary to optimize analytic results. Both strategies were founded in the businesses themselves, and understanding of customers’ behavior and needs.
The signals are not always clear. Among the noise there may be rich opportunities that require intelligence and expertise to extract. And with this effort can come big rewards.
Absent that critical thinking data is best left as raw, uncultivated material.