Module 2

Product Discovery with AI

๐Ÿ“– 3 Lessonsโฑ 60โ€“90 min ๐Ÿงช Lab: AI-Powered Interview Synthesisโœ… Quiz: 7 questions

Learning Objectives

Lesson 2.1
What Discovery Is and Isn't
โœ—
Discovery is NOT:
  • Asking users for feature ideas
  • Collecting random feedback
  • Building based on the loudest voice
โœ“
Discovery IS:
  • Understanding behaviors and motivations
  • Identifying unmet needs
  • Evaluating opportunity size
  • Separating symptoms from root causes
Lesson 2.2
Customer Interview Framework

Interview Structure (30 minutes)

SectionTimeFocus
Context5 minRole, environment, current workflow. What tools they use today.
Problems10 minFrustrations, bottlenecks, workarounds. "Tell me about the last time you..."
Behaviors10 minWhat did they actually do? How often? What triggered the behavior?
Impact5 minTime lost, revenue impact, stress level. "What happens if this isn't solved?"

Key Interview Rules

  1. Never ask "Would you use X?" โ€” ask "Tell me about the last time you dealt with X"
  2. Never pitch solutions โ€” stay in the problem space
  3. Always ask for specifics, not generalizations
  4. Silence is okay โ€” let them fill it

Five Critical Interview Techniques

Technique 1

The Echo Probe
When a user mentions something interesting, echo their exact words back as a question:
User: "The setup was really confusing."
You: "Confusing?" (pause, let them elaborate)
This signals you're listening and invites depth without leading. Never rephrase their words.

Technique 2

The Specificity Ladder
When users speak in generalities, climb down to concrete specifics:

LevelExampleWhat to Ask
General"We have problems with onboarding""What kind of problems?"
Specific"People get stuck in the setup""Where exactly do they get stuck?"
Concrete"At step 3, connecting data sources""Tell me about the last person who got stuck there"
Actionable"They don't know what an API key is"(You now have a design problem to solve)
Technique 3

The "Show Me" Request
Whenever possible, ask users to show you rather than tell you. Observed behavior always overrides self-reported behavior โ€” users rationalize their actions after the fact.

Technique 4

The Timeline Walk
For complex workflows, have the user walk you through chronologically: "Walk me through what happens from the moment you decide to add a new team member to FlowScale, step by step, until they're fully set up." This reveals hidden steps, dependencies, and pain points.

Technique 5

The Dissent Question
At the end, always ask: "Is there anything I should have asked that I didn't?" and "Is there anything you think I'm getting wrong about your experience?"

Common Interview Mistakes

MistakeWhy It HappensFix
Leading questionsWanting confirmation of your hypothesisReplace with open questions
Accepting solutions as requirementsUsers are helpful; they want to solve itDig into the problem behind the suggestion
Talking too muchNervousness, wanting to explain the productTarget: you talk 20%, they talk 80%
Only interviewing happy usersEasier to recruit, less uncomfortableActively seek churned and unhappy users
Not recordingThinking you'll rememberAlways record (with consent)
Interviewing one person and generalizingOne data point feels like enoughMinimum 5 interviews before drawing conclusions
Lesson 2.3
Jobs-to-be-Done (JTBD)

Customers "hire" products to make progress in specific situations. JTBD shifts your thinking from features to outcomes.

Bad Framing (Feature-Centric)Good Framing (JTBD)
"Users want dark mode""Users working late need reduced eye strain to maintain productivity"
"Users want export""Ops managers need to share workflow data with leadership who don't use the platform"
"Users want AI""Ops managers spending 3+ hours/week on manual scheduling need automated workflow triggers"
JTBD Formula

When [situation], I need to [motivation], so I can [outcome]

Example: When I hire a new team member, I need to get them set up on FlowScale without spending 45 minutes sitting with them, so I can focus on actual operations work.

Lab 2

AI-Powered Interview Synthesis

Scenario: You conducted 5 customer interviews at FlowScale last week. You need to synthesize findings by Thursday's product review.

Interview Data

Interview 1 โ€” Sarah, Operations Manager (200 employees)
"Our biggest pain is onboarding new team members. Right now I have to sit with each person for 45 minutes
walking them through the setup. We hire 5-10 people a month, so that's 5-8 hours a month just on onboarding
walks. When someone gets stuck, they message me on Slack and I have to stop what I'm doing to help them."

Interview 2 โ€” Marcus, VP Operations (500 employees)
"The problem isn't the tool itself โ€” it's getting our team to actually use it properly. We pay for 200 seats
but only 60 are active. I think people create their account, get confused by the setup, and then go back to
spreadsheets. I've asked for better onboarding materials three times now."

Interview 3 โ€” Lisa, Operations Coordinator (80 employees)
"The first time I used it, I got stuck on step 3 where it asks me to connect my data sources. I'm not
technical โ€” I don't know what an API key is. I had to ask our IT person to help. That took two days to
schedule. Once we got past that, it was fine. But I almost gave up."

Interview 4 โ€” James, Operations Director (350 employees)
"We need better permissions. Right now everyone can see everything. We have contractors who shouldn't see
financial workflows, and junior staff who shouldn't be able to delete things. We've had two incidents where
someone accidentally modified a production workflow. If you had role-based permissions, we'd expand immediately."

Interview 5 โ€” Priya, Senior Ops Manager (150 employees)
"The templates are useless. They're too generic. I spent last weekend building a custom onboarding flow from
scratch โ€” took me 6 hours. A template that was even 50% right would have saved me a full day. Also, there's
no way to share workflows across our team โ€” everyone builds their own version."
Step 1

Create prompts/discovery-synthesis.md:

# Discovery Synthesis Prompt

You are a senior product discovery analyst at FlowScale.
Load context from context/company.md before responding.

## Task
Analyze the provided interview transcripts and produce:

1. **Pain Point Clusters**: Theme name, affected users, frequency, severity (1-5), evidence (direct quotes)
2. **Jobs-to-be-Done**: Job statement (When/I need/so I can), which users, current solution, satisfaction score
3. **Opportunity Map**: Ranked by user impact, strategic alignment, and current solution gap

## Quality Rules
- Every claim must be backed by a direct quote
- Do not invent insights not present in the data
- Separate observed behavior from stated preference
- Flag contradictory evidence between interviews
Step 2 & 3

Run the synthesis and evaluate the output quality:

  1. Coverage: Did the AI capture all major themes? Verify every supporting quote exists in the raw data.
  2. Accuracy: Are JTBD statements grounded in actual quotes, or inferred beyond the data? Find 2 supporting quotes for each JTBD.
  3. Actionability: Can a designer act on these findings without asking "what exactly should we build?"
  4. Bias detection: Count how many quotes come from each interview. If 60%+ come from one person, the synthesis is biased.
Step 4

Create deliverables/W02-discovery-report.md with validated pain point clusters, JTBD statements, prioritised opportunity map, and a "gap note" for any insight you added that wasn't in the interviews.

Step 5 (Extension)

Find a colleague or friend who uses any software tool for work. Conduct a 15-minute interview using the Lesson 2.2 framework. Then run the same synthesis prompt on your own interview notes. Compare: How does the AI handle your raw, imperfect notes vs. the polished transcripts?

Deliverables

  • Discovery synthesis prompt (prompts/discovery-synthesis.md)
  • Raw AI output (full synthesis)
  • Quality evaluation (4 questions answered with specific examples)
  • Validated discovery report (deliverables/W02-discovery-report.md)

How to Verify Completion

  • Your synthesis identifies at least 3 distinct pain point clusters with quotes from multiple interviews
  • Each JTBD statement follows the When/I need/so I can format
  • Your quality evaluation specifically names which claim was inferred vs. grounded in data
  • Your bias check counted quotes per interview โ€” confirm no single interview provides more than 40% of the evidence
  • At least one item in your opportunity map is ranked by strategic alignment to FlowScale's activation goal
Done when: Your discovery report could be handed to a designer tomorrow and they would know what to research further, without needing to re-read the raw interview transcripts.
Quiz

Module 2 โ€” Knowledge Check

0 / 7 answered
Question 1 of 7
A user says: "Can you add a dark mode?" What is the correct discovery response?
A Add dark mode to the backlog immediately โ€” users know what they need
B Dismiss it โ€” feature requests from users are never reliable
C Ask what they're really trying to accomplish: "Tell me about when you find the current screen hard to use."
D Check if competitors have dark mode before deciding
Correct. Feature requests are the weakest form of evidence. The right move is to trace back to the underlying problem. "Dark mode" might really mean "I work late at night and my eyes hurt" โ€” which opens up different solutions beyond dark mode.
Question 2 of 7
What is the "Echo Probe" interview technique?
A Repeating a summary of everything the user said to confirm understanding
B Echoing the user's exact words back as a question to invite them to elaborate, without rephrasing
C Recording the interview so you can replay it later
D Asking the same question multiple times to confirm the answer
Correct. The Echo Probe uses the user's exact words (not a rephrased version) to signal active listening and invite depth. Rephrasing changes meaning. Exact echoing preserves meaning and makes the user feel truly heard.
Question 3 of 7
Which of these is the best JTBD statement format?
A "Users want a better onboarding experience"
B "When I hire a new team member, I need to onboard them to FlowScale without taking 45 minutes of my time, so I can focus on operations work"
C "Sarah is an Operations Manager at a 200-person company who struggles with onboarding"
D "Onboarding should be faster and easier"
Correct. A good JTBD follows the When/I need/so I can structure. It specifies the situation, the motivation, and the desired outcome. It's not a demographic description, not a vague wish, and not a feature request.
Question 4 of 7
During AI synthesis bias detection, you count the quotes per interview and find 65% come from Interview 1 (Sarah). What should you do?
A Accept it โ€” Sarah gave the best answers so it's logical to use her more
B Remove Sarah's interview from the synthesis
C Flag the synthesis as biased, re-run with a prompt that explicitly requires balance across all 5 interviews
D Run 4 more interviews to get more Sarah-like responses
Correct. When one interview dominates (60%+), the synthesis is biased toward that person's experience. The right fix is to re-run with an explicit balance constraint, not to remove the interview or accept the bias. AI tends to overweight articulate respondents.
Question 5 of 7
Why does "observed behavior always override self-reported behavior" in user research?
A Because users lie deliberately to protect their job security
B Because observing users is more expensive and therefore more credible
C Because the PM's observations are always correct
D Because users rationalize their actions after the fact โ€” what they do in the moment is more accurate than how they explain it later
Correct. This is a fundamental principle of behavioral research. People construct narratives about their behavior that feel accurate but often aren't. Observation bypasses the rationalization layer and shows what actually happens.
Question 6 of 7
What is the minimum number of customer interviews before you should draw discovery conclusions?
A 1 โ€” if the user is very articulate and their problems are clear
B 5 โ€” look for patterns, not outliers
C 20 โ€” for statistically significant results
D 3 โ€” if you interview different company sizes
Correct. 5 interviews is the practical minimum for qualitative discovery. Fewer than 5 risks over-indexing on an outlier. Patterns that appear in 4 of 5 interviews are meaningful signals; patterns in 1 of 5 are anecdotes.
Question 7 of 7
When evaluating AI discovery synthesis, what does "actionability" mean?
A The AI output was produced quickly and can be used immediately without review
B The output includes a list of recommended features to build
C A designer or engineer can act on the findings without asking "what exactly should we build?" โ€” each pain point specifies a behavior and a moment in the user journey
D The output has been approved by stakeholders
Correct. Actionable findings point to specific behaviors at specific moments. "Users are frustrated" is not actionable. "Users cannot connect data sources without IT help, causing 2-day delays during onboarding step 3" is actionable โ€” a designer knows exactly where to focus.
Module 2 Score