Product Sense

Downloadable Code Files

Getting Started with Code Files

Getting Started

Introduction

Experiment Goals

Key Members

Product KPI

The North Star Metric

Driver Metric

Guardrail Metrics

Secondary Metrics

Segmentation Metrics

Launch Criteria

Experiment Data

Amazon AB Testing Case - Question

Amazon AB Testing Case - Solution

Code Walkthrough

Understand the Business Problem

State the Experiment Hypothesis

Hypothesis Statement

Significance Level

Statistical Power

Minimum Detectable Effect (MDE)

Design the Experiment

Randomization Unit

Sample Size Calculation

Experiment Duration

Run the Experiment

Experiment Platform

Peeking at P-Values

Assess Validity Threats

Stable Unit Treatment Value Assumption

Survivorship Bias

Sample Ratio Mismatch

Primacy Effect

Novelty Effect

Holiday Effect

Other Effects to Consider

AA Test

Conduct Statistical Inference

Chi-Squared Test of Independence

Z-Test for Proportions

T-Test for Means

Decide Whether to Launch

Interpret Test Results (Relative vs Absolute Difference)

Launch Decisions

Decision Rule

Decision Rule with Confidence Interval

Holdout Set

[Google] An experiment is statistically significant, but the sample is low. Should you change?

[Amazon] An AB test on "frequently bought together" showed improve in test, but not after launch. What happened?

[Amazon] New UI and algorithm are tested on product search. How would you design an experiment?

[Facebook] An experiment on News Feed showed increase in CTR, but the p-value is 0.06. Should you launch the change?

[Instacart] What are important statistical parameters in AB testing?

Interview Cases

[Amazon] Testing Recommender Systems

[Uber] Improving Driver Enrollment Rate

Mock Interviews

Master the art of product sense by analyzing real-world case studies from leading tech companies like Facebook, LinkedIn, and Google. This course is designed to help you build a strong foundation in product metrics, user journeys, and product quality through practical exercises and interview-focused insights. Whether you're a beginner or looking to refine your skills, this course covers essential topics such as product vision, metric frameworks, and feature prioritization, often asked in data product interviews. With in-depth mock interviews and 40+ curated lessons, this course provides an invaluable resource for anyone aspiring to excel in product sense interviews at top tech firms.

Acing Product Sense Interviews

Google Photos Question

Google Photos: Solution

Growth

Health

Measure Reaction: Question

Measure Reaction Solution

Measure Success on Facebook

Measure Success on FB Solution

Overview

Product Quality Template

Slack: Question

Slack: Solution

Success

Uber Eats: Question

Uber Eats: Solution

Measuring Product Quality

Clarify

Diagnosis

Facebook Metric: Question

Facebook Metric: Solution

Framework

Metric Investigation Template

Root Causes

Youtube Comments: Question

YouTube Comments: Solution

YouTube Comments: Solution Part B

Metric Investigation

Analyze User Behavior

Business Goal

Clarification

Experimentation

Facebook Restaurant: Question

Facebook Restaurant: Solution

Feature Prioritization

Improve Gmail: Problem

Improve Gmail: Solution

Improve Gmail: Solution Part B

Improving a Feature

LinkedIn: Question

LinkedIn: Solution

Prioritization Matrix

Product Improvement Intro

Product Improvement Question

Product Improvement Template

User Journey

Product Improvement

Driver & Secondary Metrics

Metric Frameworks

Metric Recipe

Mission Statement

Monetization

Product Goal

Product Vision

The North Star Metric (NSM)

YouTube Case Study

Product Metrics

Product Breakdown

Product Breakdown Template

What is Product Sense?

Product Sense Basics

LinkedIn Mock Interview: Part B

LinkedIn Mock Interview: Part A

LinkedIn Mock Interview: Solution

Mock Interview

Declining Users on Facebook

Driver Satisfaction on Lyft

Engagement on Uber

Improve Facebook Messenger

Improve Google Maps

Increase Posts on Facebook Groups

Measure Active Users on Instacart

Measure Spam on Facebook

Measure Success on Instagram Stories

Videos on LinkedIn

Practice Cases