All companies are using data to evaluate themselves. But the worse the performance, the bigger the risk for skewing the analysis. So, how do you validate your business-critical data?
Imagine sitting at your desk with a self-evaluation form to fill out. The standardized template in front of you is there to make your answers more comparable and — hopefully! — guide you through the process. Now, according to yourself, how well did your last marketing campaign or communication campaign actually perform? Ultimately the question is, how well are you performing at your job?
Even if you’re being honest, how do you know whether or not you’re unconsciously biased?
Self-appraisal can be useful, but it’s not the path to unbiased information
Self-appraisal can be useful, for sure. It allows employees to clarify their view of their work so that it can be compared to that of their managers. Also, the ritual might encourage employees to frame their contributions in a bigger business context. Unfortunately, beyond specific psychological use cases, the concept of self-appraisal is mostly a terrible idea.
The polar opposite of self-appraisal is peer-appraisal. The main advantage is obvious — peer-appraisal is much more efficient in producing accurate knowledge. This might be hard to accept in a world of alternative facts, fake news, and moral absolutes. But that doesn’t make it any less of a fact.
The purpose of analyzing business data is all about arriving at actionable insights to inform better decisions. The majority of all companies today are collecting and analyzing their performance data on the brand level using the self-appraisal method. To put it mildly: Self-appraisal isn’t a very scientific way to acquire business-critical insights from data.
Only human after all: The fallacy of overestimating self-performance
In Let’s Abolish Self-Appraisal published by the Harvard Business Review in 2011, the author and management expert Dick Grote wrote:
In researching my book How to Be Good at Performance Appraisals, I found study after study that consistently demonstrated that individuals are notoriously inaccurate in assessing their own performance, and the poorer the performer, the higher (and more inaccurate) the self-appraisal.
Justin Kruger and David Dunning (as made famous by the discovery of the Dunning-Kruger Effect) published an article in the Journal of personality and Social Psychology in which they conclude that less skilled individuals suffer a dual burden:
Not only do these people reach erroneous conclusions and make unfortunate choices, but their incompetence robs them of the metacognitive ability to realize it.
(*The fallacy of knowing next to nothing according to the Dunning-Kruger effect)
Many brands lack a process for validating in-house data analysis
Companies seldom have issues with allocating vast sums of money on product launches, marketing campaigns or more topic-based communication campaigns, yet they might base these decisions on questionable data. Thus, a company using data to evaluate its own performance is treading on thin ice. According to what the science implies, self-appraisal is likely to be used primarily for individual gains or worse — to reinforce an inflated brand image that only exists internally.
Few brands have a strategy or process in place for validating their data analysis.
While it’s true that the digitization of the business world offers unprecedented opportunities for extracting data, data is still just a tool. And as is true for all types of tools: If you use it wrong, you might just end up hurting yourself instead of fixing something.
This is where Whispr Group, as an independent global service provider, tasked with turning data into actionable insights, has taken its stand. Joakim Leijon, Whispr Group’s Founder and CEO writes;
Our business model critically depends on our ability to provide our clients with unbiased and scientifically accurate analysis of their data which they can act on. If we fail in this endeavour, our clients fail. In our last two NPS surveys, we've averaged an 8,8 out of 10 — which indicates that our clients are finding our analysis highly valuable.
How to validate your business-critical data analysis
Whispr Group suggests the following key takeaways in avoiding the pitfalls of corporate self-assessment of data:
- Collect and analyze data with the intent to gain business-critical knowledge, not to bolster internal careers or support already-made decisions (more info: How the right insights will help you set the right KPIs).
- Always verify your business-critical data via an independent third-party analyst to avoid the Dunning-Kruger Effect (more info: Get started with insights from Whispr Group).
- Nurture a corporate culture that acknowledges that the truth can be painful at times, but that, by any measure, ignorance is far worse for business. (more info: Stop just collecting insights and start using the insights from it).
Does your business need a second opinion on a specific data set? Get in touch with one of our data analysts for a free consultation:
|About Jerry Silfwer.
Freelancing Senior Adviser and CMO Whisperer at Spin Factory. Speaker at the World Public Relations Forum, TEDxÖstersund, Eurocom, Sweden Social Web Camp, Internetdagarna, Webbdagarna, given lectures at Uppsala University, Berghs School of Communication, IHM, Beckman's College of Design, and Hyper Island. Jerry was nominated by Cision Scandinavia in 2011, 2012, 2013, 2014, 2015, 2016, 2017 and 2018 for Most Influential Digital PR Professional. In 2016, he won.🙌 More info -> https://doctorspin.org/