Archives For ATOMs

My kids love pizzookies. That’s what we call a cookie baked in a pizza pan, like the one pictured here. (I think we first called it that after visiting a national restaurant chain where they were served.)

Baking a pizookie, or using any recipe, requires four different kinds of steps in the list of instructions–four Ps: Purpose, Procedure, Process, and Performance.

ATOMs are like a recipe for using information properly to understand uncertainty and risk.

414555_335914426419157_100000018071411_1335954_435687345_o
1. Purpose
Obviously, we want to bake a pizookie and enjoy it’s deliciousness. More specifically, though, our purpose is to follow the recipe, the instructions, to the best of our ability, to help us create this culinary delight. Our purpose is not to learn something about cookies but to actually do something, to make them.

2. Procedure
Some of the steps in the checklist are procedures–I would suggest that these are black and white without need of interpretation or judgment. “Add 2 cups sugar,” for example, is a quantitative step done in a particular order.

3. Process
Then there are steps that do require judgment and experience: “fold ingredients together” or “mix well,” or “stir until…such and such consistency.” When is something mixed well? Did you know you can mix it too well and break down the chemical composition of the ingredients (thus altering the taste)?

For the inexperienced, these words can carry some uncertainty. There’s a specific culinary lexicon that one must understand in order to comply with these process steps, and part of understanding it, like language idioms, is experience.

4. Performance
Finally, when all is mixed together, the last step in transforming the ingredients is to do the actual cooking, and this is a performance step. How well the dessert turns out is a function (partially) of the ingredients and how we mixed them, but it also depends on setting the right temperature and monitoring the baking. The difference between process and performance are subtle, but performance is about measuring the outcome of a process. Our performance matters, because no one likes burnt pizzookie.

These four steps apply to equally well to both leading and also to using analytical tools (ATOMs). Understanding the purpose of a task (or tool) is critical to using it properly. There are black and white steps for use, and then there are processes which require judgment to implement. Finally, evaluating the outcome of the process and making sense of the results is key. Let me close with this question for thought:

Is it necessary to follow the steps exactly in a recipe?

__________________________________________________

How do we find our way then, when we are exploring the unknown, blazing a trail into uncharted territory? How do we apply elementary statistical principles to transform uncertainty into decisive action? What is to prevent us from making a preposterous application of ATOMs when we deal with very complex situations, those in which our intuition fails?

These questions are not much different from those faced by Chuck Yeager before he ever broke the sound barrier or Neil Armstrong as he took that first step on the moon. Neither of these men, nor anyone around them–with hundreds or thousands of highly educated, very scientific people on these teams–knew what to expect. Or did they…?

ATOMs is a monthly column that introduces analytical tools of mathematics and statistics and illustrates their application. To read more about ATOMs, you can read Where Do We Go From Here, or view the online workbook here.

We live in an age of GPS devices, and they can be a fantastic aid. However, a map is also an immensely powerful tool, and I think that its longevity proves its value. On the other hand, a GPS tells you which direction to go, and it usually does not give you many (or any) alternatives. Nor does it give you information to weigh alternative choices.

Maps give us options.

And they give us the information you need to weigh those alternatives. It turns out that alternatives are important. In his wildly popular best seller, EntreLeadership, Dave Ramsey simply states:

A powerful element of good decision making is to have lots and lots of options.

ATOMs are basic building blocks that you can use to build solutions in many situations, like the three presented here.

Here are 3 places you can use a map to create options and collect information: 1) Planning your trip, 2) Making a detour, and 3) Finding your way (when you are lost).

1. Planning the Trip
Have these thoughts gone through your mind when planning a road trip: What’s the shortest distance? What route gives the shortest duration? Is road A susceptible to more traffic than road B?

Before the trip, maps are useful for strategic planning. What if you apply these same kinds of questions to your project or process–will they help you prepare?

Right-Arrow-Detour-Sign-X-M4-9R2. Making a Detour
Have you ever come across one of these dreaded orange signs? My fear has always been that the detour will be vey poorly marked.  These days the GPS units are getting a bit smarter about handling detours, but none compare to my ability to use a map when things get out of hand.

I’ve never met anyone who hasn’t had to make at least one detour during the execution of their plan. Is your plan ready?

3. Finding your Way (when you are lost)
What if you miss your exit? What if that detour leads you astray? Maps are good for helping us figure out where we are.

There’s an elementary process for all three of these steps–it’s the same checklist applied to each situation. It doesn’t require a GPS solution, a complicated algorithm, or an updated database.

__________________________________________________

Where Do We Go From Here

How do we find our way then, when we are exploring the unknown, blazing a trail into uncharted territory? How do we apply elementary statistical principles to transform uncertainty into decisive action? What is to prevent us from making a preposterous application of ATOMs when we deal with very complex situations, those in which our intuition fails?

These questions are not much different from those faced by Chuck Yeager before he ever broke the sound barrier or Neil Armstrong as he took that first step on the moon. Neither of these men, nor anyone around them–with hundreds or thousands of highly educated, very scientific people on these teams–knew what to expect. Or did they…?

ATOMs is a monthly column that introduces analytical tools of mathematics and statistics and illustrates their application. To read more about ATOMs, you can read Where Do We Go From Here, or view the online workbook here.

Previous: It’s not About the Tools — ATOMs #13-5 | Next: How are Maps like Analytical Tools — ATOMs #13-6

Once while preparing for a flight test in a simulator, I flipped a C-17 over its tail onto its back. When something like that happens–especially in a high fidelity simulator–it is very eye-opening, to say the least.

Ares Airdrop Flight Test

Modeling and simulation, or M & S, is just one of several ways we employ the build up approach and prepare for elevated risk testing. Because it is such a fundamental part of the incremental approach to flight test, the flight test community prides itself on the fidelity of its models and simulations.

We had gone to the sim as we were preparing to airdrop the Ares JDTV from the C-17, pictured above. Seventy-thousand pounds of rocket was going to get ripped out the back of the airplane at 25,000 ft by massive parachutes, and this had never been done before.

The sim mission helped us prepare for contingencies, but since I’ve already given away the punchline in the title, let me say it again here:

Modeling and simulation have limitations.

Here are 3 specific obstacles that we encountered on the fateful day we did the back-flip.
1. No model for an airdrop load that weighed 70,000 lbs
The cleared envelope for the C-17 was 60,000 lbs, so models only existed up to that limit.

2. No model for 70,000lbs/1g extraction parachutes
Normally, the force generated by the extraction parachutes was much less than the weight of the aidrop load. But how much less?

3. No model for airdrop malfunctions
Airdrop malfunctions were simulated verbally, by an instructor who would say, “malfunction.” There was no way to make the aircraft simulation respond to any malfunction, of the several that we envisioned.

That represents uncertainty in the model.

Our vision was quite clear and focused, however.  We were there, in the simulator, to develop a response to emergency situations.

For example, what if only one of the extraction chutes inflated–how much would the aircraft pitch up if the extraction was slower than normal? What if the airdrop load did not exit and we were dragging parachutes through the thin air at 25,000 feet? How much would it decelerate the aircraft before the line could be cut?

We had countless questions, but we had no way to quantify the uncertainty in our highest fidelity model.  Well…almost no way…

ATOMs are applied tools for transforming uncertainty and risk into decisive action.

How would you overcome these limitations? What analytical tools would you use?

(I’ll explain how the clarity of our focus helped us develop a solution next time.)

__________________________________________________

Where Do We Go From Here

How do we find our way then, when we are exploring the unknown, blazing a trail into uncharted territory? How do we apply elementary statistical principles to transform uncertainty into decisive action? What is to prevent us from making a preposterous application of ATOMs when we deal with very complex situations, those in which our intuition fails?

These questions are not much different from those faced by Chuck Yeager before he ever broke the sound barrier or Neil Armstrong as he took that first step on the moon. Neither of these men, nor anyone around them–with hundreds or thousands of highly educated, very scientific people on these teams–knew what to expect. Or did they…?

ATOMs is a monthly column that introduces analytical tools of mathematics and statistics and illustrates their application. To read more about ATOMs, you can read Where Do We Go From Here, or view the online workbook here.

Previous: Vision and Uncertainty | Next: It’s not about the Tools