ADVANCED · 8 MODULES · 64 LESSONS
Metrics and Reporting for Leadership
Whoever leads product or engineering ends up in front of leadership and the board with a dashboard in hand. This guide teaches you to build that dashboard and defend it: separate the metrics that drive decisions from the ones that only decorate, read a funnel and a cohort table without the average fooling you, choose a North Star with its metric tree and its guardrails, know what to ask your team to measure and, above all, read the result of an A/B experiment without fooling yourself: significance, confidence interval, sample size, peeking and multiple comparisons, explained for deciding, not for coding. You learn it as Head of Product at **Brava Fit**, a subscription home workout app with 400 thousand subscribers in Latin America and a base that stopped growing. The Head of Growth announces that the new AI onboarding "lifts activation +12%" and wants to launch it to everyone on Monday, and the CEO asks you for two things: tell her whether to believe it, and bring the board a dashboard that is no longer a list of pretty numbers. Module by module you build the answer: an audit of the current dashboard, the funnel and cohort views, the North Star with its guardrails, the review of the experiment, the reading of its results, the audit of traps, and the final report that tells the impact honestly. There is no code to write. The math is done in tables and by hand, only where it helps you decide, and the sources come with their date.
- You need
- Having seen a product dashboard or a results report; you do not need to know statistics or how to code

What you will learn
- 01Separate actionable metrics from vanity metrics and decide what goes into the leadership dashboard
- 02Read a funnel and a cohort table to find where to act and what the average hides
- 03Choose a North Star, build its metric tree, and protect it with guardrails, including those of an AI feature
- 04Specify what to ask the team to measure, with one spec card per metric
- 05Review an A/B experiment plan before believing it: control, randomization, primary metric, and lift
- 06Read a p-value and a confidence interval without misreading them, and tell what is significant from what matters to the business
- 07Spot the traps that make a result look good: insufficient sample, peeking, multiple comparisons, and Simpson's paradox
- 08Report impact to leadership and the board honestly, even when the number is not the one everyone expected
Who it is for
- 01Heads of product, directors, and VPs of product or engineering who report results to leadership
- 02Startup CTOs and technical founders who bring metrics to the board
- 03Tech leads and engineering managers who have to decide with the data their team brings them
Curriculum
01What a leadership dashboard measures
- Introduction: do you believe the +12%?
- Metrics that decide versus metrics that decorate
- Rates, not totals
- HEART as an experience checklist
- AARRR to see where the dashboard looks and where it doesn't
- The metric tree: from MRR to what the team moves
- What makes a good metric, and what to ask the team to measure
- Project: audit of the current dashboard
02Reading a funnel
- Introduction: which step does the +12% live in?
- What a funnel is: Brava Fit's free trial journey
- The conversion rate of each step
- Overall conversion: the 12% and what it doesn't tell you
- Where the biggest drop is: in people, in rate and in money
- Intermediate conversions versus the conversion that pays
- Reading a funnel in context: channel, January, windows and mix
- Project: the dashboard's funnel view
03Cohorts: what the average hides
05Reading an A/B experiment: the basics
- Introduction: is Growth's experiment well designed?
- Correlation is not causation
- Control and variant
- Randomization and sample ratio mismatch
- The hypothesis: what you expect and what would refute it
- Measuring lift: points versus relative
- What an A/B experiment can't answer
- Project: review the experiment plan before believing it
06Real or chance? Significance for deciding
07Sample size and the traps that fool you
08Project: Brava Fit's metrics report
- Introduction: Brava Fit's metrics report
- Business health: metrics, funnel, and cohorts
- North Star and guardrails in the final dashboard
- The plan for the new experiment
- The results reading of the first experiment
- The package's trap review
- The readout: telling the story with data
- Final deliverable and self-assessment
What students say
These reviews are from enrolled students who completed at least 50% of the course. We moderate reviews only on content grounds (spam, offensive language, personal data), never for being critical or negative.
No approved reviews yet.
Be the first to share your experience!