Forbes recently published its list of the top billionaires in the world. (Gee whiz, did not find my name on that list.) Fantasy sports leagues could not survive without statistics. How one evaluates performance of professional baseball has been forever altered by what is known as Sabermetrics. Every week the top performing theater movies and TV shows are shared in order of popularity. We are inundated with TV commercials extolling the miles per gallon a car can achieve or the tonnage a truck can pull.
Metrics. They are ubiquitous. A search within the book section on Amazon.com using the word “metrics” results in over 17,000 choices. An equal amount appears when searching for “key performance indicators.” By whatever name, I am willing to wager that everyone reading this article is at least aware of metrics/key performance indicators (KPIs) and accepts that there is value in a metrics-driven organizational structure. (If you do not believe in its value, I would enjoy hearing why not.)
Live with reality. Do not fudge numbers to meet expectations."
With so much already written about the basics of metrics creation and implementation, this article will instead take a different approach. Using real life experiences as the catalyst, I will share some best practices that I believe are fundamentally critical to achieving success in the world of metrics.
Be True to the Numbers
My client, an aerospace and defense manufacturer, has determined that keeping track of on-time delivery is an essential KPI for their company. Every day the staff gathers to review open orders, to identify what can ship that day and what orders are likely to miss the promised shipping date.
As the group is reviewing orders one day, it is clear that a particular order will not ship on the promised date. From a metrics perspective, it is either all or nothing. Meet the date, receive a 100% grade. Miss the date and it is a zero. Nothing in between. So imagine my astonishment when I heard the “relief” question -- the manager asking the rep, “Can we call the customer and ask for some relief?”
If the customer is asked to extend the shipment date . . . “relief” . . . and agrees, and now the manager is able to meet the revised, extended ship date, does that now constitute an on-time shipment?
Not in my book. If the customer had proactively called and extended the time frame, then yes, it is timely. But this manipulation . . . there really is no other way to describe what was happening . . . is just not acceptable. Who is being fooled here? Senior management, for sure. When they get their reports, the on-time numbers will be artificially higher than reality. How can they properly manage with inaccurate data?
I cannot stress this enough. Live with reality. Do not fudge numbers to meet expectations. Doing so hurts everyone involved.
Sit in Your Customer’s Chair
Once again on-time delivery is the KPI being measured. In this instance, my client regards success as making the delivery up to the minute requested by the customer. If the request is 10 a.m., then having the product on-site at 10 was considered OK.
Imagine you were the customer. It is 9:55 and the shipment has yet to arrive. Are you calm and confident that your requested timetable will be met? If it were me, not so. I would be pacing the floor. My eyes would be darting back and forth to my watch. Whatever I was doing at the time would not have my full attention.
There is much value in creating a culture that relies on KPIs/metrics to measure organizational productivity and accomplishments."
The key in this scenario is a question of perspective. From my client’s point of view, having the shipment arrive at any point up to the requested delivery time was acceptable. I proffered that from the customer’s viewpoint, arriving at the exact moment desired was far from acceptable. We changed the expectation moving forward. A successful delivery was now going to be one that arrived no later than 10 minutes prior to the requested delivery time.
What a difference that made. Customers appreciated the new approach. Customer satisfaction grew. And on-time deliveries, even when using the new rule, spiked to record percentages. Always remember that KPIs cannot be myopic but rather must be viewed from your customers’ perspective.
When Is Enough, Enough?
While visiting a recent client, the owner proudly directed me to his computer screen. “Look,” as he pointed me to the monitor. “These are all the metrics we’re capturing.” Oh boy. Was I to be excited? The specially designed dashboard was chalk full of numbers and graphs. Very appealing to the eye. But really, how useful?
I am not challenging the value of dashboards as a tool for data collection. Research suggests that short-term memory only holds about seven chunks of information, and those fade from our brains in about 20 short seconds. So a dashboard overcomes this memory constraint. What it does not overcome is the feeling of being flooded with information. When is the sheer mass of data too much to effectively manage and respond to?
There are no hard and fast rules when it comes to the question of “how many?” And there is probably no “right answer” either. But in my experience, there is the “Rule of Three” that I have found to work quite nicely. (The United States Marines are big believers in the Rule of Three when it comes to getting things done and keeping people alive. The Corps apparently experimented with a rule of four, and retention and effectiveness took a nose dive.)
Back to my client. We discussed the merits of streamlining the dashboard. I asked him to whittle down the vast number of metrics to the top three in each organizational category, for instance operations, production, employee performance, and then work with those KPIs during the coming weeks.
When we reconvened to review his experience, he offered this one word reaction, “Whew.” It was much easier to manage and be productive with the reduced number of KPIs. More is not always better.
Unintended Consequences
KPIs are used to evaluate the success of an organization or of a particular activity in which it engages. They are chosen . . . or should be . . . to support and promote the company’s strategic goals and objectives. Most times the selected metrics are productive. However, in cases where they are poorly structured, implemented or supervised, they can lead to unintended consequences detrimental to the organization.
One of the metrics established at a precision measuring tool manufacturer (where I worked early on in my corporate career) was number of units produced per hour. Management felt that more could be accomplished by the staff if given the “motivation.” So one day the workers on a particular production line were told that they needed to produce 20% more every hour. With no material changes in terms of equipment, training, procedures, the only way to accomplish the new objective was to simply work faster.
And that they did. The numbers rose. But as the production increased, quality declined. As a result of creating a metric that was not achievable without other changes, training and support, the results were counterproductive. Dean Spitzer, a performance measurement expert, asserts, “People will do what management inspects, not necessarily what management expects.” David Parmenter, self-described “King of KPIs,” believes that “over half the measures in an organization may be encouraging unintended behavior.”
Once it was recognized that the KPI was actually doing harm, the whole process was reevaluated. The expected increase was reduced to a more reasonable level. A continuous process improvement initiative was triggered that identified ways to improve the processes leading to faster times. Fortunately, before too much harm was done, the problem was corrected.
Key Best Practices
There is much value in creating a culture that relies on KPIs/metrics to measure organizational productivity and accomplishments. However, doing so is potentially fraught with danger, as we’ve seen through the various experiences shared above.
For best practices, implement KPIs/metrics that are . . .
- Designed with forethought,
- Defined accurately and clearly,
- Aligned with corporate goals and objectives,
- Quantifiable, measurable, achievable, and
- Evaluated consistently and modified where necessary.
These key best practices will ensure that you and your organization will have a productive and successful KPI program.
Lee Schwartz, former CEO and president of manufacturing and distribution companies, is principal of the Schwartz Profitability Group (SPG) that, for almost 13 years, has uncorked the operational bottlenecks of manufacturing and distribution companies, boosting their bottom line results. Lee’s clients range from smaller family-run companies to Fortune 500 firms across a multitude of industries. His consulting and operational turnaround work helps clients find solutions related to process improvement, supply chain management, inventory control, workflow design, and operational performance. Lee can be reached at [email protected] or at 310-450-2628. More info can be found at www.schwartzpro.com or his LinkedIn profile.
