Quantification Archive

Early on, I learned about GIGO, Garbage In Garbage Out. Translated, if you don’t input good data into the computer don’t expect good data in return. Even though a common assumption, as computers become more sophisticated so has their GIGO. They not only receive data from us but also from sensors programmed by us. Consequently, algorithms that are more sophisticated manipulate this data, making it increasingly hard to see inaccuracies and to believe it could be inaccurate.

The article, “Burning Question” (The Atlantic, September 2012 edition), by Michael Behar exemplifies this by exploring the problem long-standing computer models had in predicting the wildfires of 2012. Much of it had to do with the computer models operating on historical experience, thus assuming fires would behave pretty much as they did in the past. As a result, the article delivers this point, which really applies to all of us when we enlist the help of computers:

. . . some experts worry that younger fire analysts lean a bit too heavily on their data-crunching skills, and have little field experience. Dawson is thankful to have spent his early career fighting fires with an ax and a shovel.

This challenges us further because even if we suspect the data, they can still influence us. They anchor in our minds and we unconsciously judge other data against them, even our own observations. Thus, not only does the data taint our observations, but the computer’s sophistication could lead us to doubt what we saw. It’s very similar to people giving false confessions because they believe the police know what they are doing, except here we believe the computer “knows what it’s doing.”

So remember, if you want your computers to work better, remember to apply your experience. After all, they don’t have any.

 

Be the first to comment

This entry is part 13 of 15 in the series Creative Innovation

One of the points Giovanni Gavetti makes in “The New Psychology of Strategic Leadership” (Harvard Business Review, July-August 2011 edition) about associative thinking but holds true for all aspects of creative innovation and decision making are our own biases. As a result of “the human mind’s confirmatory nature,” “Strategists often look selectively for evidence that supports the analogy” they’ve formed in associative thinking.

In other words, when doing our research we are more inclined to focus on evidence, or types of evidence, supporting our points rather than contradicting them. For instance, we might value statistical evidence over anecdotal or empirical evidence. We might value evidence produced by the scientific method rather than an alternative process such as trial and err. Yet, in both cases, accepting different types of evidence or evidence produced by different processes, stimulates creativity. Moreover, by holding the team to these things, such as requiring quantification, not only do we restrict creativity but we reinforce the status quo, inertia.

However, it’s difficult for people to come out from under their own biases. This means it becomes incumbent for the managers of these teams to be prepared and have the talent to lead the change that innovation brings. One thing that truly distinguishes leadership from management is the degree to which each must promote change. That includes change in evidence and processes the team will consider in evaluating options.

Thus, while diversity in our creative innovation teams is important, diversity in our approaches and processes to tackle problems and to make decisions are too. We can look at an organization’s policies and processes as a form of “group bias” that can impose itself on our teams and drastically negate their inherent advantages.

Beware of not only individual biases but institutional ones too.

Be the first to comment

1978 Reprint
Penguin Books 1968

A reader requested more clarification and examples of Clausewitz’s friction in business. Project Management is excellent for this because of its detailed planning, more so than Strategic Planning. In Project Management, friction shows most measurably in two ways:

  1. Friction = Actual cost – Budget
  2. Friction = Actual completion date – deadline

Despite detailed planning though, cost overruns and delays frequently appear, especially in extremely large projects as the article, “Overdue and Over Budget, Over and Over Again” (The Economist, June 11, 2005 edition), highlights. The article “Six Myths of Product Development” (Harvard Business Review, May 2012 edition) by Stefan Thomke and Donald Reinertsen goes even further to enumerate six myths of Project Management, giving us a flavor for the challenges and “friction” in them:

  1. High utilization will improve performance
  2. Processing work in large batches saves money
  3. Assuming the plan is great and problems are with execution
  4. The sooner we start the sooner we finish
  5. More features begets increased client satisfaction
  6. Getting it right the first time increases success

In relating all this to Clausewitz’s four sources of friction we find:

  1. Difficulty and danger: the cost overruns and exceeded deadlines could threaten the viable of the project not to mention the jobs and careers of those involved
  2. Physical effort: the amount and type of work is often difficult to coordinate efficiently thus necessitating Project Managers
  3. Ambiguous information: incomplete, unknown and changing information can necessitate reassessing the initial plan, budgets and deadlines
  4. Multitude of participants: many people with different skill sets and levels can work on these projects, including a hierarchy of Project Managers

The application of Clausewitz’s friction to Project Management is similar to saying that our joints are more susceptible to injury than our bones. In our plans, certain points are more likely to cause cost overruns and delays than others are.

 

Related post: Clausewitz’s Friction: Difference between Plans and Reality

 

Be the first to comment

This entry is part 11 of 15 in the series Creative Innovation

Business prizes quantification; yet, ironically, it restricts creativity and innovation in two ways:

  • Encouraging electrical activity in our brains which restricts idea generation
  • Compelling people to confine their ideas to the quantifiable ones

Evangelia G. Chrysikou’s article “Put Your Creative Brain to Work” (Scientific American Mind, July/August 2012 edition, pgs: 26-27) summarizes the body of research to date by saying “idea generation is associated with a state of lower cognitive control” and

. . . generating novel applications for objects also seems to benefit from less filtering of knowledge and experiences, which enables people to consider a greater variety of possible answers.

Essentially, high cognitive control of our brain emits different electrical waves (beta) than low cognitive control (alpha) does. In Heidi K. Gardner’s article, “Coming Through When It Matters Most” (Harvard Business Review, April 2012 edition), we find quantification correlates to people’s need for certainty and conservatism by writing:

In high pressure situations . . . [people] support their responses with hard, usually quantitative, evidence instead of anecdotes and comparisons . . . Enthusiasm for innovation and improvisation gives way to concern for strict professionalism and covering all the basis.

My previous post, “Knowledge States”, helps us see the restrictive nature of quantification by the amount of knowledge we filter from the problem when we do so. This is partially why altering our normal problem-solving process (i.e. don’t worry about quantifying the problem or aspects of it) can be such an effective problem-solving technique.

Thus, the focus on numbers not only alters us physiologically in terms of the electrical waves our brains emit but also mentally in terms of compelling us to filter out unquantifiable knowledge that might contain the solution. Let’s face reality: problems are like squirrels. Neither goes away simply because we cannot quantify them.

 

Related posts:

 

Be the first to comment

Someone once said to me that you can’t find your way if you don’t know where you are. I countered that that would mean a compass would be useless to you. That’s not true.

Unfortunately, when people talk about intuition in problem solving, then tend to think it should be as specific as cognition is. If it were, it wouldn’t be intuition. Intuition plays more of an introductory role in our thinking and behavioral processes. In this sense, our intuition acts as a compass. When we’re lost we have any number of directions to explore. A compass helps to narrow our selection. Intuition does the same in problem solving.

Many, many forces influence us without our conscious knowledge. On the knowledge map, we might feel these influences as awareness or knowing without having any proof or quantification to support them. These forces also influence our thought processes and encourage us to find rationales to support them.

Typically, we will experience these as feelings or sensations to:

  • Talk to a certain person or people
  • Analyze certain information
  • Visit a certain department, office or facility
  • Attend an certain event
  • Perform a certain analysis or experiment
  • Collect certain information

Now, I’m not referring to the normal, routine feelings that come about as a result of a planned problem-solving approach or one that conforms to a certain methodology. These feelings will encourage you to deviate from that process or plan. Since processes reduce flexibility, it’s important that we don’t become so focused that we ignore the opportunities posed by our intuition. Spontaneity and flexibility are important problem-solving attributes even if it simply means a “chance” encounter that aides us.

Next time you get that feeling to go off-process or off-plan, do it. Experiment!

 

3 Comments so far. Join the Conversation

Emotions in Decision-makingImagine preparing to board a cruise ship, and a Quantnik stops you.

He asks, “What is your suitcase’s volume?”

You are puzzled and slowly say, “What? . . . I don’t know.”

“How about the ship?” he continues, “Do you know its volume?”

Again, puzzled, you respond tentatively, “Noooo.”

“Well, I’m sorry, but you cannot board the ship.”

Now, your puzzled stupor vanishes because you’ve anticipated this trip for some time. Thus, with raised voice, you now become the interrogator, “Why not!?”

With an insulting calmness, the Quantnik answers, “Because we don’t know if your luggage will fit on the ship.”

This irritates you because you feel any idiot can see that the luggage will fit. Yet, I find that it’s not uncommon in business to find stalled decisions because someone could not measure the desired outcome against the required inputs when the answer was intuitively simple. For example, in one case, there were persistent errors in shipping, causing upset customers. Yet, before establishing a process to fix it, several managers wanted to research the return we would get from the new process against our expected costs to establish the process. To this, the sales manager sarcastically responded, “By the time we research that, we won’t have any customers left.”

What is important to remember is that humans have a natural attraction to numbers; yet, this attraction can become an illness just as our attraction to fats and sugars can be (obesity). This doesn’t even include the many assumptions we often need to apply to arrive at the numbers want. Therefore, just because numbers exist doesn’t mean we are any less subjective in our decision making than if numbers didn’t exist.

So, what’s a Quantnik? It’s similar to an alcoholic but the addiction is to numbers, and thus more quantifiable.

 

 

2 Comments so far. Join the Conversation

Tony Hey in his article, “The Big Idea: The Next Scientific Revolution” (Harvard Business Review, November 2010 edition ), and Patrick Spenner and Karen Freeman in theirs, “To Keep Your Customers, Keep It Simple” (Harvard Business Review, May 2012 edition) talk about the challenges of too much information, too much choice. These become tougher when we are acquiring more information at an unprecedented rate. However, these trends also apply to everyday business activities.

For example, research is cited in Spenner’s and Freeman’s article concerning the following:

  • Too much information will tend to cause us to postpone or neglect decisions
  • People naturally tend to overthink and second-guess trivial decisions
  • The harder a decision is the more important we seem to believe it is
  • The more time we spend on a decision the more important it becomes in our minds

Now, if we combine these tendencies with the acceleration of information, we could easily have business leaders thrashing more and more with their decisions. In other words, if you believe your organization has problems making decisions now, it’s only going to get worse.

This creates an ironic paradox. While technological advancements allow us to produce and deliver products and services faster, they slow down our decision-making. This means we become even more wedded to our standard processes for longer periods, thus retarding adaptability. In short, we miss opportunities because we respond more slowly to new facts and circumstances; we can only handle decisions that fit within our standard parameters.

Therefore, the stockpile of unmade decisions will grow and clog our already overstressed decision-making processes. We will wrestle with more decisions longer than we ever did. We’ll have the information at our fingertips, but we’ll be indecisive about what to do with it.

 

2 Comments so far. Join the Conversation

Often we assume fast service is good service; however, we need to challenge constantly this assumption. As I wrote previously, customer service borders on entertainment. To help people feel this, I use my Red Ferrari Analogy. I introduce it by asking, “When you go home from work, which way do you take?” Eventually, people agree: the quickest.

From here, I continue with the following:

All right then, let’s say that instead of going home in your present car at the end of today I give you the keys to a red Ferrari to drive home. How would you like that?

People agree that they would like this very much; however, I then present a caveat:

Great, however, there is only one condition: once you reach home, you give the keys and the car back to me. Now, let me ask you this: Knowing this would you still take the quickest way home?

At this point, people are usually laughing but say, “No.” I’ve even had a few who said, “I would never go home.” Nevertheless, I finish with this point:

So, the question is this: Are you providing people with a quick experience or a Ferrari experience?

 

2 Comments so far. Join the Conversation

How we position things greatly influences the outcome. In the April 7, 2012 edition of The Economist the article, “Dressing Up,” uncovers that women’s sizes have inflated by four sizes since the 1970’s. Unlike men’s sizing which is based on inches, women’s sizing is purely arbitrary and often varies by brand. Thus, depending on the size, a pair of women’s pants might have increased as much as four inches at the waist and three inches at the hips since then.

The generally accepted assumption for allowing this size inflation is that if consumers feel good about themselves they are likely to buy, thus why the fashion industry calls it “vanity sizing.” However, even though it seems like a topic to take lightly or with which to have fun, vanity sizing plays in all aspects of statistics. That is why it’s important to challenge definitions and assumptions in order to understand and solve problems.

For instance, the article “Botox and Beancounting” of the The Economist’s April 27, 2011 edition, discusses how official U.S. economic statistics might be overinflating its performance relative to Western European economies. Ironically, the article’s title makes an appropriate analogy to vanity sizing.

U.S. unemployment figures present another excellent example. They not only conflict with one another on occasions but they are difficult to figure. Additionally, their accounting changed in the 1980′s, making them appear lower than before.

Thus, while it’s commonly said that “numbers don’t lie,” that’s true; however, an ignoramus isn’t lying either if he believes his own ignorance. If we’re ignorant to numbers’ origination, we are more likely to accept them if they tell us our glass is half full rather than half empty, thus reinforcing our own perceptions . . . also known as “vanity believing.”

 

Be the first to comment

House of Arbitrariness & Conditionality

We often view measurements as unchangeable. A meter is a meter, a pound a pound. We often forget that at some time someone somewhere declared what those were and that they would be a standard. The point is this: arbitrariness underlies almost all objective standards by which we live.

For example, in the January 29, 2011 edition of The Economist, the article, “The Constant Gardeners”, explores the kilogram. The official standard is a platinum-iridium alloy cast in 1879. However, today, its weight seems to vary from its copies by up to 69 micrograms, about half a grain of sand, an important variance when weighing small things. So, the question is this: How heavy is a kilogram . . . really?

The relevancy to problem solving is similar to that which I wrote in my post, “Arbitrariness: The Cornerstone of Conditions”:

By searching for the underlying arbitrary aspect of any apparently objective situation, we can often find the perspective – when altered – that can cause us to see that situation in a different light.

For example, when someone asks us, “What’s the best way to get from A to B?” we often give the fastest route. The assumption being that the “best way” is “fastest” when “best” could have many different attributes. Over time, the best-fastest link becomes the arbitrary point – when altered – that sheds a different light on what route might be best such as the most scenic one or the most fuel-efficient.

As a more sophisticated example, consider our reliance upon “proven outcomes.” What does that mean especially when you cannot scientifically prove that good leadership begets good results? Thus, when we look at what it took to be proven, we often find that it’s subjective based upon who is determining what “good leadership” and “good results” are.

 

Be the first to comment