1. Courses
  2. Product Management
  3. Metrics & Product Analytics
  4. Stop 1

35 minIntermediate

North star, input and guardrail metrics

One number should tell everyone whether customers are getting the value you promise. Below it, a tree of input metrics tells each team what it can move this month, and guardrails stop anyone winning by breaking something else. This lesson shows you how to pick the number, build the tree, find the input that matters most and check that the tree still holds.

By the end you can

  • Pick a north star metric that measures value delivered, and reject vanity metrics
  • Break the north star into a metric tree whose inputs a team can move within weeks
  • Work out with simple arithmetic which input moves the north star most
  • Pair inputs with guardrails and counter-metrics that catch a number being hit the wrong way
  • Build a metric tree for an internal tool, where the value is time and accuracy

The everyday picture

A farmer can't order her mango trees to give a bigger harvest. The harvest is what she cares about, and it arrives once a year, far too late to steer by. So she watches the things that make it: how many trees are healthy, how many flowers set fruit, how heavy each fruit grows, and how many reach the market before they spoil. Each of those she can change this month. She waters, prunes, nets the trees against birds and picks at the right time.

She also knows the trap. A heavy dose of fertiliser gives a bigger harvest this year and tired soil for the next five. So she tests the soil every season and stops pushing when it starts to suffer.

That is a metric tree. The harvest is the north star, the one result that shows the farm is working. The things she watches are the input metrics. The soil test is a guardrail. This lesson builds the same three things for a product.

A north star measures value delivered

A is the one number that best captures the value customers get from your product. Amplitude's North Star framework, written up by John Cutler and colleagues, pairs it with three to five input metrics that the team can move directly. The idea is old and simple: if customers get more of the value, the business results follow, and the team has one shared answer to "are we winning?".

A good north star passes six tests:

  • It counts value received, not activity you caused. "Orders delivered on time" counts groceries in a kitchen. "App opens" counts taps.
  • It moves before revenue. Revenue and profit are results. They arrive late and have many causes, so they make poor steering numbers (the output, outcome and impact split from pm-11).
  • The team can influence it through inputs it controls.
  • Anyone can say it in one sentence, from a store manager to the managing director.
  • It fits the strategy. Someone reading it should be able to guess what the company is betting on.
  • It is hard to game on its own, and where it can be gamed, a guardrail sits next to it.

The opposite is a . Mangrove has about 2 million registered customers. That number only ever goes up, even in a week when half of them had a bad experience and stopped ordering. Downloads, page views and total sign-ups behave the same way. They feel good and decide nothing.

Amplitude describes three "games" a product can be playing, and the game tells you what kind of north star to look for. In the attention game (streaming, social media) value is time well spent. In the transaction game (grocery delivery, ride-hailing, wallets) value is a completed exchange. In the productivity game (work tools, internal apps) value is work done faster and more accurately.

Mangrove's customer app plays the transaction game, and its promise is groceries in 30 minutes. A plain count of orders would miss half the promise, so the north star is weekly on-time orders: orders delivered within 30 minutes of checkout, counted per week. Weekly fits a grocery habit. Daily numbers jump with rain and payday, and monthly numbers arrive too slowly to steer by.

Quick check

Which is the best north star for the Partner app, where 1,800 corner shops order stock?

From one number to a tree

A north star on its own tells a team whether it is winning, but not what to do on Monday. A breaks it into the parts that produce it, until each leaf is something one team can move with its own work. Build it in four moves:

  1. Write the north star as a formula. Weekly on-time orders = active customers × orders per active customer × on-time rate.
  2. Split each part. Parts that multiply are rates and averages. Parts that add are segments that don't overlap: active customers = new customers + returning customers.
  3. Add the drivers. Some inputs aren't arithmetic parts but causes. The on-time rate is driven by how fast a store picks the order, how fast a rider is assigned, and how long the ride takes.
  4. Stop at a team. A leaf is finished when one team owns it, can move it within weeks, and has a data source for it.

Then put this week's numbers on every box and check they multiply back to the top. At Mangrove: 62,500 new customers plus 187,500 returning (75% of last week's 250,000) gives 250,000 active customers. They place 1.70 orders each, and 91% arrive within 30 minutes. 250,000 × 1.70 × 0.91 = 386,750 on-time orders a week. If your numbers don't multiply back, a definition is wrong somewhere, and you have found it before anyone argued about it.

Weekly on-time orders 386,750 a week Active customers 250,000 × Orders each 1.70 a week × On-time rate 91% in 30 min New 62,500 + Returning 187,500 Cut-item rate 9% of orders Stock accuracy 82% of lines Picked ≤ 10 min Rider ≤ 5 min Ride ≤ 15 min more riders Cost per order $2.10 guardrail, limit $2.60
Mangrove's metric tree for "Now" delivery. Plain lines are arithmetic: the three middle boxes multiply to the north star, and new plus returning make active customers. Arrows are causes: stock accuracy drives cut items, which drive how often customers order; picking, rider assignment and ride time drive the on-time rate. Buying on-time with standby riders pushes up the cost guardrail.

Notice the difference between the two kinds of link. Arithmetic links are certain: if orders per customer rises 1%, the north star rises 1%. Causal links are beliefs that need evidence. "Better stock accuracy means fewer cut items, which means customers order more often" is a good bet, but it is a hypothesis until data supports it. Draw the two differently, so nobody mistakes a guess for a law.

The drivers of the on-time rate also show why averages mislead. A typical "Now" order spends about 9 minutes being picked and packed, 4 waiting for a rider and 13 on the road: 26 minutes, comfortably inside 30. The late orders are the ones where two stages run slow at once. So the drivers are written as shares of orders inside a time limit ("picked within 10 minutes"), which track the slow tail, instead of average minutes, which hide it. Percentiles and tails are explained in Measuring speed and reliability.

Input metrics a team can move

An earns its place in the tree when it is:

  • Controllable: the team's own work moves it. Store operations can change pick paths; it can't change the weather.
  • Fast: it moves within days or weeks, so the team sees whether its work is landing.
  • Predictive: when it moves, the north star moves too. Check this in past data, and later with a test (Experiments).
  • Owned: one team reports it every week.

Amazon calls these controllable input metrics, and Colin Bryar and Bill Carr's Working Backwards (2021) tells how its selection metric was refined. The first version counted new product detail pages, and teams added pages for products few people wanted. It became detail page views, so a page only counted if customers looked at it. Then the share of those views where the item was in stock. Finally, the share where it was in stock and ready for two-day shipping, which Amazon named Fast Track In Stock. Each change came when the old version stopped predicting sales. Expect to refine your inputs the same way.

If you are stuck for inputs, Amplitude suggests four prompts: breadth (how many customers or stores use it), depth (how much of the job they do in the product), frequency (how often) and efficiency (how fast or cheaply the job gets done).

Which input moves the north star most?

The arithmetic is short. In a product of factors, a 1% rise in any factor raises the result by 1%. In a sum, a 1% rise in one part raises the total by that part's share. New customers are 25% of active customers, so 1% more new customers adds only 0.25% to the north star.

Output
North star now: 250,000 active x 1.70 orders x 91% on time = 386,750

+1% orders per customer (1.70 -> 1.717)       +1.00%  = about +3,868
+1% on-time rate (91% -> 91.9%)               +1.00%  = about +3,868
+1% returning rate (75% -> 75.75%)            +0.75%  = about +2,901
+1% new customers (62,500 -> 63,125)          +0.25%  = about   +967

Sensitivity is half the answer. The other half is what a 1% rise costs. Adding 625 new customers a week may be one campaign. Adding 0.9 points of on-time at 91% may need a new dispatch rule, and at 97% it may need many more riders. Put the sensitivity next to the effort, then decide.

Quick check

The returning rate rises from 75% to 78% and nothing else changes. About how many more on-time orders a week?

Guardrails and counter-metrics

In pm-11 you added guardrails to OKRs. A metric tree needs them for the same reason: any input pushed hard enough can be hit in a way that hurts. Pair each input that can be gamed with a , the number that gets worse when the input is hit the wrong way.

Input pushedHow it can be hit badlyCounter-metric (limit)
On-time rateKeep many riders waiting on standbyDelivery cost per order (under $2.60)
Picked within 10 minutesPickers rush and grab the wrong itemWrong or missing items per 100 orders (under 3)
Ride within 15 minutesRiders speed in traffic and rainSpeed alerts and incidents per 1,000 rides
Orders per customerBuy orders with vouchersDiscount spend per order (under $0.80)
New customersBig first-order discounts attract people who never returnWeek-4 retention of the new cohort (pm-23)

One more guardrail protects the measurement itself. Mangrove counts an order as delivered when the rider taps "delivered" in the Rider app. Put enough pressure on the on-time rate and some riders will tap it a street early. So the team also tracks the share of "delivered" taps made more than 100 metres from the address, and customer reports of orders not received. When a metric becomes a target, guard the way it is measured as well as what it measures.

Keep the list short: two to five guardrails for the whole tree, each with a limit written down before anyone pushes. In the cost example, Mangrove's riders can carry the load up to about 95% on time. Above that, every extra point needs more standby riders, and cost per order climbs faster and faster.

Quick check

The dispatch team proposes measuring "rider assigned within 5 minutes" and paying a bonus on it. Which counter-metric matters most?

Metric trees for internal tools

The Store app sells nothing, so its tree plays the productivity game: value is work done faster and more accurately. Its north star could be supplier deliveries received right in the app per week: received by scanning at the dock, and never corrected later. Each store gets about 4 supplier deliveries a day, so 320 stores receive about 8,960 a week. If 60% are received in the app at the dock and 92% of those are right first time (today about 1 goods received note in 12 is corrected later), the north star is about 8,960 × 0.60 × 0.92 ≈ 4,950.

The inputs come from the four prompts. Breadth: stores where receiving in the app is switched on. Depth: the share of a store's deliveries received in the app. Efficiency: minutes per delivery, which also acts as a guardrail, because an app that slows receiving will be dropped for paper as soon as nobody is watching. Below the inputs sit the things that make or break them on a handheld: staff signed in at shift start, scanners charged, and offline receipts that sync without errors (Offline-first apps and data sync).

Store app tree Received right in app about 4,950 a week Deliveries 8,960 a week × In app at dock 60% × Right first time 92% signed in, charged, syncs work feeds Stock accuracy 82% fewer cut items Customer orders each
An internal tool's tree, linked to the customer tree. The Store app's own north star counts deliveries received right in the app. Its effect reaches customers slowly, through stock accuracy and fewer cut items, which is why the Store app team steers by its own north star and reports the link to the customer tree as a slower result.

The link to the customer tree matters in two ways. It lets Imran explain the Store app's work in the terms the managing director already uses: better receiving should mean fewer cut items and more repeat orders. And it warns him not to steer by stock accuracy alone, because accuracy also depends on theft, damage, counts and DC deliveries, and it moves over months. The Store app team steers by its own north star and reports the downstream link once a quarter.

Internal tools add one trap that consumer apps rarely have: what counts as "a delivery" in the denominator. If stock transfers from the DC, which arrive with an electronic note and are always received in the app, are mixed with supplier deliveries, the adoption number looks better than the dock really is. You will take that number apart in Funnels, activation and adoption.

Try it. The simulator draws Mangrove's tree with this week's numbers: 250,000 active customers × 1.70 orders × 91% on time = 386,750. Read the bars under the tree first and find which input adds most for a 1% rise. Then drag On-time rate up towards 99% and watch the delivery cost box: it turns red above $2.60, at about 97.3% on time. Finally, slide New customers down to 0 and see what still carries the tree.

Simulator

Loading the simulator…

  • Factors that multiply the whole tree (orders per customer, on-time rate) move it 1% for 1%. Parts of a sum (new and returning customers) move it by their share, so returning customers matter three times as much as new ones here.
  • Past 95% on time, the north star still rises but each point costs more riders. A north star without a counter-metric can be "won" by burning money.

Do it

Build a metric tree for a product you own, with numbers on every box, owners for every input and guardrails written down.

  1. Write the value sentence

    One sentence, in the user's words, saying what they get. "Customers get their groceries within 30 minutes, every week." "Store staff receive every delivery right, first time, without paper."

  2. Pick the north star and test it

    Choose the count of that value per period. Run the six tests: value received, moves before revenue, team can influence it, one sentence, fits the strategy, hard to game alone. Write the exact definition and the data source.

  3. Write the formula and split it

    Multiply rates and averages, add non-overlapping segments, then add the causal drivers underneath. Stop each branch when one team can move the leaf within weeks.

  4. Fill in owners, levers and numbers

    For every input: today's value, the owning team, the levers they control, how fast it moves and where the number comes from. Check the numbers multiply back to the north star.

  5. Run the sensitivity, then add effort

    Work out what +1% in each input does to the north star. Put the rough cost of that 1% next to it.

  6. Add guardrails and validate the links

    For each input, ask "how could we hit this and make things worse?" and pick the counter-metric with a limit. Mark every causal link as a hypothesis, check it against past data, and plan a test for the ones you will bet a quarter on. Review the tree every quarter.

    Markdown
    # Metric tree: Mangrove "Now" delivery
    Value: customers get their groceries within 30 minutes, every week.
    North star: weekly on-time orders (delivered within 30 min of checkout)
      = active customers x orders per active customer x on-time rate
      = 250,000 x 1.70 x 91% = 386,750     Source: order table, delivered_at - placed_at
    
    | Input                        | Now    | Owner          | Levers                    | Moves in | +1% moves NS |
    |------------------------------|--------|----------------|---------------------------|----------|--------------|
    | New customers a week         | 62,500 | Growth         | campaigns, referrals      | days     | +0.25%       |
    | Returning rate               | 75%    | App team, CRM  | onboarding, reminders     | weeks    | +0.75%       |
    | Orders per active customer   | 1.70   | App team       | reorder, slots, in stock  | weeks    | +1%          |
    | On-time rate                 | 91%    | Ops, dispatch  | the drivers below         | weeks    | +1%          |
    |   Picked within 10 min       | 78%    | Store ops      | pick paths, staffing      | weeks    | driver       |
    |   Rider within 5 min         | 85%    | Dispatch       | assignment rules          | days     | driver       |
    |   Ride within 15 min         | 88%    | Dispatch       | delivery zones            | weeks    | driver       |
    |   Stock accuracy (cut items) | 82%    | Store app      | receiving, counts         | months   | driver       |
    
    Guardrails (limit, set before pushing)
    - Delivery cost per order: $2.10 today (max $2.60)
    - Wrong or missing items per 100 orders: 2.1 (max 3)
    - "Delivered" taps over 100 m from the address: 0.8% (max 2%)
    - Discount spend per order: $0.55 (max $0.80)
    Hypotheses to check this quarter: picking -> on-time (20-store pilot);
    stock accuracy -> repeat orders (history, then a store-level test)

Bring it to your team

Ask these when a team proposes a metric or a target.

  • What value does this number say the customer got? Could it rise while customers are worse off?
  • Where does this input sit in the tree, and what does +1% in it do to the north star?
  • Is the link from this input to the north star arithmetic or a belief? What evidence do we have?
  • How could we hit this number and make things worse? What is the counter-metric and its limit?
  • Who owns this input, how fast can they move it, and where exactly does the number come from?
  • When did we last check that this input still predicts the north star?

Red flags

  • A north star that only goes up, such as registered users or total downloads.
  • A dashboard with thirty metrics and no tree showing how they connect.
  • Inputs no team owns, or one input owned by three teams.
  • A target with a bonus attached and no guardrail.
  • Causal links drawn as if they were arithmetic, never checked against data.

Practice

Build the Partner app's metric tree

The Partner app serves about 1,800 corner shops and about 4,000 orders a week. About 62% of orders are placed in the app; the rest are phoned to about 40 sales reps. In a typical week, about 1,100 shops place at least one order in the app, 2.25 app orders each on average, and 85% of app orders are delivered complete (no short-shipped lines). Pick a north star, write its formula with these numbers, list four inputs with an owner each, and add two guardrails with the way each input could be gamed.

  • Your north star counts value a shop received (for example, app orders delivered complete per week), not registrations or sessions
  • Your formula multiplies back to about 2,100 a week (1,100 × 2.25 × 85%)
  • Each input has one owner and a lever that owner controls
  • Your guardrails would catch a real way to game an input, such as reps entering phone orders in the app on shops' behalf, or shops switching channel but ordering less in total
Show a model answer

North star: weekly partner orders placed in the app and delivered complete = shops ordering in the app × app orders per shop × complete rate = 1,100 × 2.25 × 0.85 ≈ 2,104.

Inputs: shops ordering in the app each week (sales reps and the Partner app team: onboarding, rep visits); app orders per shop (Partner app team, Lagoon Digital: one-tap reorder, credit visibility); complete rate (DC operations and buyers: show only stock the DC can ship); time from order to delivery (DC operations and drivers).

Guardrails: total orders per shop across all channels, which catches shops ordering less after moving to the app; share of app orders created by a rep's login, which catches reps moving phone orders into the app to hit the number; orders amended or returned after delivery, which catches one-tap reorders repeating the wrong items.

Pick the proposal that moves the north star most

Using the tree from the first task (1,100 shops × 2.25 orders × 85% complete), work out the change in the north star for each proposal, rank them, and name one guardrail each. A: 100 more shops order in the app each week, at the same rate. B: app orders per shop rise from 2.25 to 2.40. C: the complete rate rises from 85% to 90%.

  • Your three answers are about +191 (A), +140 (B) and +124 (C), ranked A, B, C
  • You show the relative effect as well (A +9.1%, B +6.7%, C +5.9%)
  • You add one cost or risk to each, so the ranking is not decided by sensitivity alone
Show a model answer
Output
Now:  1,100 x 2.25 x 0.85 = 2,104
A:    1,200 x 2.25 x 0.85 = 2,295   +191  (+9.1%)
B:    1,100 x 2.40 x 0.85 = 2,244   +140  (+6.7%)
C:    1,100 x 2.25 x 0.90 = 2,228   +124  (+5.9%)

A moves it most, but new app shops may be the less engaged ones, so watch their week-4 retention and total orders across channels. B could come from splitting orders into smaller ones, so watch delivery cost per drop. C is the slowest to deliver but improves the experience for every existing shop, and its guardrail is lost sales from removing items the DC can't ship.

Check yourself

A ride-hailing PM proposes "weekly app opens" as the north star because it moves fast and the team can influence it. What is the strongest objection?

Over six weeks the north star rose 4%. In the same weeks, week-4 retention of new customers fell from 22% to 14% and discount spend per order doubled. What is the best reading?

Store operations raised "orders picked within 10 minutes" from 78% to 90% in a month. The on-time rate didn't move. What should you do first?

Flashcards

Open my review

Key takeaways

  • A north star counts value customers received, moves before revenue, and fits in one sentence. Registered users and downloads are vanity metrics.
  • A metric tree splits the north star into multiplying factors and adding segments, then adds causal drivers, until each leaf is owned by one team.
  • Factors move the north star 1% for 1%; parts of a sum move it by their share. Weigh that sensitivity against what each 1% costs.
  • Every input that can be gamed needs a counter-metric with a limit, and the way the metric is recorded needs guarding too.
  • Internal tools play the productivity game: count work done right, link it to the customer tree, and steer by your own north star.

Sources and further reading

Episode transcriptOne number, and the soil beneath it · about 12 minutes · tap any line to play from there
  1. NadiaImran, quick question. How many customers does the Mangrove app have?
  2. ImranAbout two million registered. It's on the first slide of every head office deck.
  3. NadiaAnd last week, when that rainy Tuesday wrecked deliveries in two cities, what happened to the two million?
  4. ImranNothing. It went up a little, actually. It only ever goes up.
  5. NadiaThat's the problem. A number that only goes up can't tell you anything went wrong. Today we're picking the one number that can, and building everything underneath it.
  6. NadiaPicture a mango farmer. She cares about the harvest, but the harvest comes once a year. Too late to steer by.
  7. ImranSo she watches what makes the harvest.
  8. NadiaExactly. How many trees are healthy, how many flowers set fruit, how heavy the fruit gets, how much reaches the market before it spoils. Those she can change this month. Water, prune, net the trees against birds.
  9. ImranAnd the trap?
  10. NadiaFertiliser. Pile it on and this year's harvest is bigger, and the soil is tired for five years. So she tests the soil every season. The harvest is the north star. The things she watches are input metrics. The soil test is a guardrail.
  11. ImranLet's start with the harvest then. What makes a good north star?
  12. NadiaIt counts value the customer actually received. Not activity you caused. It moves before revenue does. The team can influence it. Anyone can say it in one sentence. It fits the strategy. And it's hard to game on its own.
  13. ImranRegistered customers fails the first test straight away.
  14. NadiaSo do downloads and page views. They're vanity metrics. They feel good and decide nothing.
  15. NadiaThere's a handy idea from Amplitude, the analytics company. Products play one of three games. The attention game, like streaming, where value is time well spent.
  16. NadiaThe transaction game, like grocery delivery or ride-hailing, where value is a completed exchange. And the productivity game, like work tools, where value is work done faster and better.
  17. ImranWe're a transaction game. So, orders?
  18. NadiaOrders miss half the promise. The promise is groceries in thirty minutes. So the north star is weekly on-time orders. Orders delivered within thirty minutes of checkout, counted per week.
  19. ImranWhy weekly and not daily?
  20. NadiaGroceries are a weekly habit. Daily numbers jump around with rain and payday. Monthly is too slow to steer by.
  21. ImranOkay. So how does one number tell my team what to do on Monday?
  22. NadiaYou break it into a tree. If you can see the screen, the first diagram has the north star at the top and three boxes under it, joined by times signs. Active customers, times orders each, times on-time rate.
  23. ImranAnd the numbers this week?
  24. NadiaTwo hundred and fifty thousand active customers, one point seven orders each, ninety-one percent on time. Multiply them and you get about three hundred and eighty-seven thousand on-time orders a week.
  25. ImranUnder active customers there's new plus returning.
  26. NadiaSixty-two and a half thousand new, and a hundred and eighty-seven and a half thousand returning. That's seventy-five percent of last week's customers coming back. Always check the numbers multiply back to the top. If they don't, a definition is wrong somewhere, and you found it before the meeting did.
  27. ImranSome links in the diagram are plain lines and some are arrows. Why?
  28. NadiaGood catch, Imran. Plain lines are arithmetic. They're certain. If orders each goes up one percent, the north star goes up one percent. Arrows are causes, and causes are beliefs.
  29. ImranLike stock accuracy driving cut items, and cut items driving how often people order.
  30. NadiaA good bet, but a hypothesis until data supports it. Draw them differently, so nobody mistakes a guess for a law.
  31. ImranAnd under on-time rate there are three drivers. Picked within ten minutes, rider within five, ride within fifteen.
  32. NadiaNotice they're shares inside a time limit, not average minutes. A typical order is about nine minutes picking, four waiting for a rider, thirteen on the road. Twenty-six minutes. Fine. The late ones are where two stages run slow together. Averages hide that tail.
  33. ImranSo which input should we push? My instinct says new customers. Growth always wants more new customers.
  34. NadiaThat's the usual instinct, and the arithmetic disagrees. In a product of factors, one percent more of any factor gives one percent more north star. In a sum, one percent more of one part gives its share.
  35. ImranNew customers are a quarter of active customers.
  36. NadiaSo one percent more new customers adds a quarter of a percent. About a thousand on-time orders. One percent more orders each, or one percent more on-time, adds about three thousand nine hundred.
  37. ImranAnd returning customers sit in between, about two thousand nine hundred.
  38. NadiaRight. But sensitivity is only half the answer. The other half is what that one percent costs. Six hundred more new customers might be one campaign. Another point of on-time at ninety-seven percent might mean a lot of riders standing around.
  39. ImranWhich brings us to the soil test.
  40. NadiaGuardrails. You met them with OKRs. In a tree, you pair each input that can be gamed with a counter-metric. The number that gets worse when the input is hit the wrong way.
  41. ImranOn-time rate pairs with delivery cost per order.
  42. NadiaTwo dollars ten today, with a limit of two sixty. Picking speed pairs with wrong or missing items. Ride time pairs with speed alerts, because nobody wants riders racing through the rain. Orders per customer pairs with discount spend.
  43. ImranAnd new customers pairs with how many of them are still around in week four.
  44. NadiaYes. And one more, the one people forget. Guard the measurement itself. We count a delivery when the rider taps delivered. Push hard on on-time and some riders tap it a street early.
  45. ImranSo we track taps made more than a hundred metres from the address.
  46. NadiaAnd customers saying the order never came. Two to five guardrails for the whole tree. Limits written down before anyone pushes.
  47. ImranWhat about the Store app? It doesn't sell anything.
  48. NadiaIt plays the productivity game. The second diagram shows its tree. The north star is supplier deliveries received right in the app each week. Scanned at the dock, never corrected later.
  49. ImranAbout four deliveries a day per store. Across three hundred and twenty stores that's roughly nine thousand a week.
  50. NadiaIf sixty percent are received in the app at the dock, and ninety-two percent of those are right first time, you get about five thousand a week. Below that sit the handheld basics. Staff signed in, scanners charged, offline receipts that sync.
  51. ImranAnd the arrow coming out of the bottom of the frame?
  52. NadiaThat's the link to customers. Better receiving feeds stock accuracy, which means fewer cut items, which should mean customers order more often. It lets you explain your work in the managing director's terms.
  53. ImranSo why not just use stock accuracy as my north star?
  54. NadiaBecause it also depends on theft, damage, counts and DC deliveries, and it moves over months. Steer by your own north star. Report the link to the customer tree once a quarter.
  55. ImranThat's exactly what happened at planning. Three teams, three proposals.
  56. NadiaWalk me through them.
  57. ImranGrowth wanted a first-order discount, ten thousand extra new customers a week. That's sixteen percent more new customers, so about four percent on the north star while it runs.
  58. ImranStore operations wanted new pick paths, orders picked within ten minutes from seventy-eight to eighty-six percent. Tomás found about four tenths of a point of on-time per point of picking. Roughly three and a half percent on the north star, and still below the line where rider cost climbs.
  59. NadiaAnd yours?
  60. ImranBetter receiving, stock accuracy from eighty-two to eighty-eight. About one percent more orders per customer within two quarters, with low confidence.
  61. NadiaSo what went wrong in the discount plan, on paper?
  62. ImranThe last discount cohort kept about eight points fewer customers by week four. And discount spend per order would blow through its limit. So it was approved at half the size, with a written stop rule. If week four retention falls below eighteen percent, it ends.
  63. NadiaAnd the pick paths went first, as a twenty-store pilot, because the link was a correlation.
  64. NadiaHere's a real-world version of refining inputs. In the book Working Backwards, Amazon's selection metric started as new product pages. Teams added pages for things nobody wanted.
  65. ImranSo the number went up and sales didn't.
  66. NadiaThey changed it to page views, then to views where the item was in stock, then in stock and ready for two-day shipping. Each time the old version stopped predicting sales. Expect to refine yours too.
  67. ImranSo if I build one this week, what are the steps?
  68. NadiaWrite the value sentence in the user's words. Pick the north star and run the six tests. Write the formula and split it until each leaf has one owner. Put this week's number, the owner, the levers and the data source on every input.
  69. NadiaThen the sensitivity, one percent each, with the rough cost next to it. Then a guardrail for every input that can be gamed. Mark every causal link as a hypothesis, and plan how you'll check it.
  70. ImranAnd there's a simulator for this lesson.
  71. NadiaThere is. Find which input adds most for a one percent rise. Then drag the on-time rate up towards ninety-nine and watch the cost box turn red above two dollars sixty, at about ninety-seven point three percent.
  72. ImranFor my next review, the questions I'd ask are: could this number rise while customers are worse off? Is this link arithmetic or a belief? And how could we hit it and make things worse?
  73. NadiaAdd one. Who owns this input, and where exactly does the number come from?
  74. NadiaNow a question for you. The pick path pilot raises picking within ten minutes from seventy-eight to ninety percent. On-time doesn't move at all. Take a second. What would you check first?
  75. ImranWhether pickers are tapping picked before they're done. Or whether the slow part has moved to rider assignment.
  76. NadiaBoth, in that order. When an input moves and its parent doesn't, either the measurement is being gamed or the bottleneck moved. You can find out which in a day.
  77. ImranSo my three takeaways. One, the north star counts value received, so on-time orders, not registered customers. Two, a tree breaks it into factors and drivers until each leaf has an owner, and multiplying factors matter more than small parts of a sum. Three, every input needs a guardrail.
  78. NadiaOne nuance on the third. Guard the way the number is recorded as well as what it measures. The delivered tap is a number too.
  79. ImranNext time, funnels. Where stores drop off on the way to really using the Store app.
  80. NadiaAnd why a festival can make adoption look better than it is.
Finished reading?Mark it complete to fill in its stop on your course line.

Use it at work

KPI dashboard notebook

Weekly revenue, orders, average basket and active customers, with a chart per KPI.

Open in the Data Lab
Next stopFunnels, activation and adoption
Was this lesson helpful?
Questions and discussion

Loading the discussion…