1. Courses
  2. Product Management
  3. Strategy, Priorities & Roadmaps
  4. Stop 2

30 minIntermediate

OKRs and outcome goals

Goals decide what a team pays attention to for the next three months. This lesson shows you how to turn a strategy into two or three outcome goals a team can actually move in a quarter, with guardrails so nobody hits a target by breaking something else, even when the product earns no revenue.

By the end you can

  • Tell outputs, outcomes and impact apart, and rewrite an output goal as an outcome
  • Write an OKR with a baseline, a target, a date, a data source and an owner
  • Pick leading key results the team can move this quarter, linked to the lagging result leadership cares about
  • Add guardrail metrics that catch a target being hit the wrong way
  • Set goals for an internal tool in minutes, errors, money at risk and workarounds removed

The everyday picture

Two friends make a New Year's resolution. The first writes "go to the gym four times a week". The second writes "run 5 km in under 30 minutes by the end of March, without getting injured".

By February the first friend has a perfect record. Four visits a week, every week. Some of those visits were 20 minutes on a bike scrolling a phone. The goal was met and nothing changed. The second friend can't fake it: the stopwatch says what it says. Along the way she watches a number that moves every week, her longest weekly run, because the race time only shows up at the end. And "without getting injured" stops her from chasing the time by running through knee pain.

That is the whole lesson in small. The first goal counts activity. The second names an outcome, watches an early signal that predicts it, and has a guardrail.

Outputs, outcomes and impact

Three words get mixed up in every planning meeting. Keep them apart and most goal problems go away.

  • : what the team ships. "Offline receiving is live in all stores."
  • : a change in what people do. "Staff receive deliveries in the app at the dock, even when Wi-Fi is down."
  • : the business result that follows. "Fewer app orders have an item cut at picking."

Output goals are tempting because the team fully controls them and they are easy to check. That is also their weakness. You can ship on time and change nothing, and the goal still says "done". Melissa Perri calls this the build trap: a team measured on what it ships keeps shipping, whether or not anything gets better.

Impact goals have the opposite problem. Cut orders depend on the Store app, but also on DC deliveries, staff numbers, the weather and a festival. A team can't steer by a number with that many causes, and it shows up months late.

Outcomes sit in the middle. The team can move them within weeks, and they are close enough to the impact that moving them should matter. Aim your key results at outcomes, and keep one eye on the impact they are meant to cause.

Output offline receiving ships week 3 team controls it staff change what they do Outcome deliveries received in the app at the dock weeks 4 to 8 team can move it aim KRs here the business result follows Impact fewer cut orders next quarter many causes
Shipping is in the team's hands but proves little. The business result proves a lot but arrives late and has many causes. Outcomes are the useful middle: they move within weeks and should lead to the impact.

Quick check

Which of these is an outcome?

What an OKR is made of

An OKR has one objective and a few key results. The objective is a short, plain sentence that says what you want to be true. A store manager should understand it on first reading. The key results are the numbers that show the objective is true. John Doerr, who brought OKRs to Google in 1999 after learning them at Intel, sums up the format as "I will (objective) as measured by (these key results)".

Each key result needs five things written next to it:

  • Baseline: the value today, measured, not guessed. If you can't measure it yet, your first job is to measure it.
  • Target: the value you aim for.
  • Date: usually the end of the quarter.
  • Source: the query, report or sample that produces the number, so nobody argues about it in week 12.
  • Owner: one person who reports on it every week.

Keep the set small. Christina Wodtke's Radical Focus recommends one objective per team per quarter with three key results. Two to four is a sensible range. More than that and the team is back to doing everything.

Decide how ambitious each key result is, and say so. Google's internal OKR guidance separates committed OKRs, which the team agrees will be met and which are expected to score 1.0, from aspirational ones, which are expected to average around 0.7. Wodtke suggests setting key results where you feel about a 5 in 10 chance of hitting them. Either way, the label matters: a 0.7 on an aspirational key result is a good quarter, and a 0.7 on a committed one needs an explanation.

Run two tests on every set. The sufficiency test: if we hit every key result, would the objective really be true? The task test: is any key result a task in disguise? "Ship offline receiving" is a task. It belongs on the roadmap (pm-13), not in the OKRs.

Quick check

Which key result is ready to use?

Leading and lagging results

A tells you whether you succeeded, but late: stock accuracy measured by counts, cut orders, write-offs. A moves early and predicts the lagging one: the share of deliveries received in the app at the dock this week.

A good set has both. At least one key result should move in the first few weeks, so you can tell whether the work is landing while there is still time to change course. At least one should be close to the impact, so you can't declare victory on activity alone.

A leading indicator is only useful if it really predicts the lagging one. Check before you commit. Imran asks Tomás to compare stores from last quarter: stores that received most deliveries in the app had stock accuracy about 7 points higher than stores that received mostly on paper. That is a correlation, not proof, but it is enough to bet a quarter on, and the lagging key result will confirm it or not.

key results (%) 100 50 in-app at dock stock accuracy 91 88 pilot, week 4 minutes per delivery 25 10 guardrail 20 min slow in week 5 week 1 week 13
The leading key result (deliveries received in the app at the dock) climbs within two weeks of the pilot. Stock accuracy lags it by about a month and ends at 88% against a 90% target. Receiving time crossed its 20-minute guardrail once, in week 5, which the team caught and fixed.

Guardrails: what must not get worse

Any number you push hard enough can be hit the wrong way. Economists call this Goodhart's law, usually quoted as "when a measure becomes a target, it ceases to be a good measure". If the key result is "receiving takes under 12 minutes", staff will accept deliveries without counting the cases.

A is a number that must stay inside a limit while you push the key results, a line you promise not to cross. Wodtke calls these health metrics and suggests two to five, each marked green, yellow or red at the weekly check-in.

Pick guardrails by asking "how could we hit this key result and make things worse?". Common pairs:

  • Speed and accuracy: faster receiving, but wrong quantities accepted.
  • Adoption and satisfaction: more stores using the app because head office ordered it, while staff hate it and keep a paper copy.
  • Reliability and cost: more on-time "Now" deliveries by adding riders, while the cost per order climbs. You will see this exact trade-off in the metric tree in North star, input and guardrail metrics.
  • New work and old quality: features shipped fast while crash-free sessions drop.

Quick check

The Partner app's key result is "one-tap reorder used for 50% of orders". Which guardrail matters most?

Goals for products that earn no revenue

The Store app sells nothing. Neither do most tools for warehouses, riders, field agents and back offices. Their value still shows up in numbers, if you know where to look:

  • Time: minutes per task × tasks per day × people × the hourly cost of their time.
  • Errors: wrong quantities, mispriced items, lost paperwork, each with a cost.
  • Money at risk: write-offs, fines, lost sales from cut orders, chargebacks.
  • Workarounds removed: paper sheets, spreadsheets and chat-group requests that no longer exist.
  • Cycle time: how long a process takes end to end, such as truck arrival to stock on the shelf.

Be careful with adoption. Internal users often have no choice, so "100% of stores use the app" can be met by an order from head office while staff keep a paper copy on the side. Measure the workaround that should disappear instead: "paper GRN sheets ordered from the print room fall from 400 pads a month to under 50".

Convert to money when you can, because it lets you compare an internal tool's goals with anything else the company could spend on, and you will need it for a business case (Business cases). Say how saved time will be used, too. Minutes saved are only worth money if they go somewhere useful, such as filling shelves before the evening rush.

Output
Valuing a 3-point drop in cut orders (Mangrove estimates)
App orders per day            60,000
Cut-order rate                9% -> 6%   (3 points)
Fewer orders with a cut item  60,000 x 0.03   = 1,800 a day
Lost sale per cut item        about $3
Sales kept                    1,800 x $3      = $5,400 a day
Per year                      $5,400 x 365    = about $2.0 million
(Before any effect on customers who stop ordering after a bad experience.)

Do it

Write one quarter's OKRs for your team, starting from your strategy.

  1. Start from the guiding policy

    Copy the strategy's guiding policy to the top of the page. One objective per team per quarter, two at most. If a candidate objective doesn't follow from the policy, it belongs to someone else or to later.

  2. Write the objective in plain words

    One sentence a frontline user would understand. No metric in the objective itself.

  3. List candidate metrics and sort them

    Write down every number that could show the objective is true. Label each output, outcome or impact. Keep outcomes, keep one impact, and move the outputs to the roadmap.

  4. Fill in the five fields

    Baseline, target, date, source, owner for each key result. Mark each committed or aspirational. Measure the baseline this week; don't guess it.

  5. Check leading and lagging

    Make sure at least one key result moves within a few weeks, and check with your analyst that it has predicted the lagging one before.

  6. Add guardrails

    For each key result ask "how could we hit this and make things worse?". Turn the answers into two to four limits.

  7. Run the tests and set the weekly rhythm

    Sufficiency test, task test, and "can this team move it this quarter?". Then agree a 15-minute weekly check-in: each owner gives the current value and a confidence from 1 to 10.

    Markdown
    # Store app OKRs, Q1
    Guiding policy: make every store's stock record trustworthy before anything else.
    
    ## Objective
    Stores can trust their stock: what the app says is on the shelf is on the shelf.
    
    ## Key results
    | # | Key result                                   | Baseline | Target | Type         | Source                                  | Owner  |
    |---|----------------------------------------------|----------|--------|--------------|-----------------------------------------|--------|
    | 1 | Deliveries received in the app at the dock   | 55%      | 90%    | committed    | GRN timestamp vs truck arrival, weekly  | Imran  |
    | 2 | Stock accuracy, weekly 2,000-line sample     | 82%      | 90%    | aspirational | sample count report (Tomás)             | Tomás  |
    | 3 | App orders with an item cut at picking       | 9%       | 6%     | aspirational | picking events in the data warehouse    | Imran  |
    
    Leading: KR1 (moves within weeks). Lagging: KR2, KR3.
    Check done: last quarter, stores receiving mostly in the app had about 7 points higher accuracy.
    
    ## Guardrails (must not cross)
    - Average receiving time per delivery: at or under 20 min (today 18)
    - Wrong-quantity GRNs: under 1% of lines
    - Store app crash-free sessions: at or above 99.5%
    
    ## Value if we hit KR3
    About 1,800 fewer orders a day with a cut item, roughly $2.0M a year in sales kept.
    
    ## Weekly check-in (Monday, 15 min)
    Each owner: current value, confidence 1-10, one blocker. Guardrails: green / yellow / red.
    
    ## Not OKRs (these live on the roadmap)
    Ship offline receiving · ship damage capture · train 320 store managers

Bring it to your team

Ask these when the draft OKRs come round for review.

  • If we hit every key result, would the objective really be true for a store manager?
  • Which key result will move in the first three weeks, so we know early whether this is working?
  • How could we hit this number and make things worse, and which guardrail would catch it?
  • Where exactly does each number come from, and has anyone run that query this week?
  • Which of these is committed and which is aspirational, and does leadership read them the same way?
  • Is any key result a task we fully control? Can we rewrite it as the change it should cause?

Red flags

  • Key results that start with ship, launch, build or release.
  • No baseline, or a baseline someone estimated in the meeting.
  • Eight objectives for one team in one quarter.
  • Adoption of an internal tool as the only key result, with no measure of the workaround it should replace.
  • OKR scores tied to bonuses, so every target is set where it is sure to be hit.

Practice

Rewrite five weak key results

These are the Partner app team's draft key results for next quarter. Facts: 1,800 partner shops all have the app installed; about 62% of partner orders are placed in the app and the rest by phoning a sales rep; about 12% of app order lines are short-shipped; partner satisfaction is surveyed every quarter (last score 31 on a scale from -100 to 100).

  1. Launch the new catalogue by 15 February
  2. Improve partner satisfaction
  3. Reach 2,000 app downloads
  4. Reduce phone orders
  5. 100% of partner shops use the app

Say what is wrong with each, then write a set of three key results with baselines and targets, and add two guardrails.

  • You label at least four of the five problems correctly (output, no number, vanity, no baseline or target, forced adoption)
  • Your three key results measure outcomes or impact, each with a baseline and a target
  • At least one key result is leading and one is lagging
  • Each guardrail names a way the key results could be hit the wrong way
Show a model answer

Problems: (1) is an output, it can ship and change nothing; (2) has no number or target; (3) is a vanity metric, every shop already has the app; (4) has no baseline or target; (5) is adoption that head office could force, and it says nothing about the phone orders it should replace.

Key results: (a) Share of partner orders placed in the app: 62% to 75% (lagging, the impact the strategy cares about). (b) App order lines short-shipped: 12% to 5% (leading for trust; the team can move it by showing only stock the DC can ship). (c) Partner satisfaction score: 31 to 40 in the quarterly survey (lagging). Guardrails: wrong-item rate on app orders stays under 3%; sales reps' phone-order handling time per order does not rise (shops moved to the app should not leave reps with only the hardest orders and no support).

Put a dollar value on an internal goal

Today a store counts one aisle on paper in about 50 minutes, then someone spends 20 minutes typing the sheet into a spreadsheet. In the app, the same count takes about 35 minutes and needs no typing. Each of the 320 stores counts 5 aisles a week. Mangrove uses $4 an hour as the fully loaded cost of store staff time. Work out the hours and dollars saved per year, write one key result and one guardrail for the cycle-count feature, and say where the saved time should go.

  • Your arithmetic is shown step by step and lands within 5% of the model answer
  • Your key result measures a change in behaviour, not the release of the feature
  • Your guardrail protects count accuracy or another real risk of faster counting
  • You name a concrete use for the saved time
Show a model answer
Output
Minutes saved per aisle   (50 + 20) - 35          = 35 min
Per store per week        35 x 5 aisles            = 175 min
All stores per week       175 x 320                = 56,000 min = about 933 hours
Per year                  933 x 52                 = about 48,500 hours
Value                     48,500 x $4              = about $194,000 a year

Key result: share of weekly aisle counts done in the app rises from 0% to 80% of stores' scheduled counts by the end of the quarter. Guardrail: count accuracy (recount agreement on a 5% sample of counted lines) stays at or above 97%. Saved time: about 2 hours 55 minutes per store per week, moved to evening shelf filling before the 6 pm rush, which the store ops head agrees to track.

Check yourself

The receiving team hit its key result, cutting average receiving time from 18 to 12 minutes. In the same quarter, stock accuracy fell. What was most likely missing?

Which pair is a leading indicator followed by the lagging result it should predict?

At the end of a quarter, an aspirational key result scores 0.7 and a committed one scores 0.7. How should the PM report them?

Flashcards

Open my review

Key takeaways

  • Aim key results at outcomes, changes in what people do, and keep one tied to the impact leadership cares about.
  • Every key result has a measured baseline, a target, a date, a source and an owner. Keep it to one objective and about three key results.
  • Mix a leading result that moves within weeks with a lagging one that proves it mattered, and check the first predicts the second.
  • Add two to four guardrails by asking how each target could be hit the wrong way.
  • For products without revenue, count minutes, errors, money at risk and workarounds removed, and say where saved time goes.

Sources and further reading

  • Google's OKR Playbook, Google, published on What Matters (committed and aspirational OKRs)
  • John Doerr, Measure What Matters, Portfolio, 2018
  • Christina Wodtke, Radical Focus, 2nd edition, Cucina Media, 2021
  • Melissa Perri, Escaping the Build Trap, O'Reilly, 2018
Episode transcriptWhy ship it is a terrible key result · about 11 minutes · tap any line to play from there
  1. NadiaImran, read me your first draft of next quarter's key results.
  2. ImranKey result one, ship offline receiving. Two, ship cycle counts in the app. Three, ship expiry scanning. All three are on the roadmap, so I know the team can hit them.
  3. NadiaThat's the problem. You could score a perfect quarter by shipping three features that nobody uses.
  4. ImranFair. But if I can't commit to shipping, what can I commit to?
  5. NadiaLet me tell you about two friends and a New Year's resolution. The first writes, go to the gym four times a week. The second writes, run five kilometres in under thirty minutes by the end of March, without getting injured.
  6. ImranAnd by February the first one has a perfect record.
  7. NadiaFour visits a week, every week. Some of them were twenty minutes on a bike, scrolling a phone. Goal met, nothing changed. The second friend can't fake it. The stopwatch says what it says.
  8. NadiaAnd she watches her longest run each week, because the race time only shows up at the end. The words without getting injured stop her from chasing the time through knee pain.
  9. ImranSo the first goal counts activity. The second names a result, watches an early signal, and has a limit.
  10. NadiaThat's the whole lesson in one story. Activity, outcome, early signal, guardrail.
  11. ImranThe lesson splits it into output, outcome and impact. The first diagram has three boxes going down, if you can see it.
  12. NadiaOutput at the top. Offline receiving ships, around week three, and the team fully controls it. Then outcome in the middle. Staff actually receive deliveries in the app at the dock, which shows up in weeks four to eight. The team can move it, but can't force it.
  13. NadiaAnd impact at the bottom. Fewer app orders with an item cut at picking. That shows up next quarter and has many causes. Deliveries from the warehouse, staffing, rain, a festival.
  14. ImranSo output is easy to control and proves nothing. Impact proves a lot but arrives late.
  15. NadiaAnd outcomes are the useful middle. Aim your key results there, and keep one eye on the impact. Melissa Perri has a name for teams measured only on what they ship. The build trap. They keep shipping whether or not anything gets better.
  16. ImranOkay, so what does a good key result actually look like?
  17. NadiaOne objective, a plain sentence a store manager would understand. Then about three key results. Christina Wodtke's book Radical Focus suggests one objective per team per quarter with three key results.
  18. NadiaAnd each key result needs five things written next to it. A baseline you measured, a target, a date, the source of the number, and one owner.
  19. ImranThe source sounds fussy.
  20. NadiaIt saves you in week twelve, when two people bring two different numbers to the review. Write down the query or the report now, and the argument never happens.
  21. ImranWhat about how ambitious to be? My boss likes stretch targets, my engineers hate missing them.
  22. NadiaLabel each one. Google's OKR guidance separates committed key results, which are expected to score one point oh, from aspirational ones, which are expected to average around zero point seven.
  23. NadiaSo a zero point seven on an aspirational result is a good quarter. A zero point seven on a committed one needs an explanation. The label tells everyone how to read the score.
  24. ImranAnd the test for my shipping key results?
  25. NadiaTwo tests. Sufficiency. If we hit every key result, would the objective really be true? And the task test. Is any key result a task in disguise? If it starts with ship, launch, build or release, it's a task. It goes on the roadmap.
  26. ImranThen let me redo mine. Objective, stores can trust their stock. What the app says is on the shelf is on the shelf.
  27. ImranKey result one, deliveries received in the app at the dock, from fifty-five percent to ninety. Two, stock accuracy in the weekly sample count, from eighty-two to ninety. Three, app orders with a cut item, from nine percent down to six.
  28. NadiaMuch better. And notice the mix. The first one moves within weeks of the pilot. That's a leading indicator. The other two take longer to show. Those are lagging.
  29. NadiaThe second diagram is a chart over the thirteen weeks of the quarter. If you can't see it, picture a thick line that sits flat, then climbs steeply right after the pilot in week four. A thinner line above it stays flat for another month before it starts rising.
  30. ImranThe thick line is receiving in the app. The thin one is stock accuracy, catching up later.
  31. NadiaRight. You need both. The leading one lets you steer while there's still time. The lagging one stops you declaring victory on activity alone.
  32. ImranHow do I know the leading one actually predicts the lagging one?
  33. NadiaCheck before you bet the quarter on it. You asked Tomás to compare stores from last quarter, remember. Stores that received mostly in the app had stock accuracy about seven points higher. That's a correlation, not proof. But it's enough to bet on, and the lagging result will tell you if you were wrong.
  34. ImranNow the guardrails. What goes wrong without them?
  35. NadiaHere's a story. A team gets the key result, cut receiving time from eighteen minutes to twelve. They hit it. And stock accuracy falls in the same quarter.
  36. ImranBecause the fastest way to receive is to stop counting the cases.
  37. NadiaExactly. Any number pushed hard enough gets hit the wrong way. A guardrail is a line you promise not to cross. Not a goal to improve. Wrong quantity receipts under one percent would have turned red and stopped it.
  38. ImranAnd the bottom half of that chart shows a guardrail too.
  39. NadiaReceiving minutes per delivery, with a dashed line at twenty. The line crosses it once, in week five. In our story a new confirmation screen added two minutes, the guardrail turned yellow, and Leila removed the screen the next week.
  40. ImranSo how do I find guardrails?
  41. NadiaFor each key result, ask how could we hit this and make things worse. Speed against accuracy. Adoption against satisfaction. On-time delivery against cost per order. New features against crash-free sessions. Two to four guardrails is plenty.
  42. ImranThe Store app doesn't make money. Head office keeps asking me what it's worth.
  43. NadiaIt's worth plenty, you just count it differently. Minutes saved, times tasks, times people, times what their time costs. Errors avoided. Money at risk, like write-offs and lost sales. And workarounds that disappear.
  44. ImranWhat about adoption? Percentage of stores using the app?
  45. NadiaCareful. Store staff have no choice. Head office can order a hundred percent adoption, and staff will keep a paper copy on the side. Measure the workaround disappearing instead. Like paper receiving pads ordered from the print room.
  46. ImranI like that. And for the cut orders, the lesson does the sum. Sixty thousand orders a day, three points fewer cut orders, about eighteen hundred orders. At roughly three dollars per cut item, that's about two million dollars a year in sales kept.
  47. NadiaA Mangrove estimate, so say roughly. And say where saved time goes. Minutes saved are only worth money if they go somewhere useful, like filling shelves before the evening rush.
  48. ImranSo the method, start to finish?
  49. NadiaCopy the guiding policy from your strategy to the top of the page. Write one objective in plain words. List every number that could show it's true, and label each one output, outcome or impact. Move the outputs to the roadmap.
  50. NadiaFill in baseline, target, date, source and owner, and mark each one committed or aspirational. Check you have something leading and something lagging. Add guardrails. Then agree a fifteen minute check-in every Monday, where each owner gives the number and a confidence from one to ten.
  51. ImranAnd how did the quarter end, in the lesson's story?
  52. NadiaReceiving in the app reached ninety-one percent, so a full score. Stock accuracy reached eighty-eight against ninety, about zero point seven five. Cut orders reached seven percent, about zero point six seven. A good quarter for aspirational targets, with a clear reason why accuracy lagged.
  53. ImranQuestions for my next OKR review, then. If we hit every key result, would a store manager agree the objective is true? Which result moves in the first three weeks? And how could we hit each number and make things worse?
  54. NadiaAnd one more. Where exactly does each number come from, and has anyone run that query this week?
  55. NadiaA question to think about. The Partner app team writes the key result, one tap reorder used for half of all orders. What guardrail matters most? Take a second.
  56. ImranOrders that get changed or returned afterwards. If reorder is too easy, shops repeat last week's order without checking.
  57. NadiaThat's the one. Time spent in the app wouldn't work, because spending less time is the whole point of the feature.
  58. ImranLet me sum up. One, aim key results at outcomes, what people do differently, not what we ship. Two, each one needs a measured baseline, a target, a date, a source and an owner. Three, every target gets a guardrail, because any number can be hit the wrong way.
  59. NadiaGood. One nuance on the first. Keep one key result close to the impact, the lagging number leadership cares about. Otherwise you can hit every outcome and still not know whether it mattered.
  60. ImranNext, I still have eighteen requests to rank.
  61. NadiaNext time, prioritisation. Scoring models, and the two tricks that let the loudest person in the room quietly win anyway.
Finished reading?Mark it complete to fill in its stop on your course line.

Use it at work

PRD for a new feature

Problem with numbers, users, goals and non-goals, measurable metrics with a guardrail, user stories with acceptance criteria, scope, risks and launch.

Open in the Product & BA Lab
Next stopPrioritisation that survives the meeting
Was this lesson helpful?
Questions and discussion

Loading the discussion…