---

The Goal of This Stage: Innovation Accounting

After you’ve launched your MVP and started testing (Chapter 6), the next critical question is: How do you measure progress? Eric Ries introduces a revolutionary framework called Innovation Accounting – a new way to measure success that’s completely different from traditional accounting.

The Problem with Traditional Metrics

Most startups measure the wrong things:

• Total signups: Looks impressive but doesn’t tell you if people actually USE your product
• Page views: Means nothing if visitors don’t convert or come back
• Social media followers: Vanity metric – doesn’t equal revenue or engagement

Key insight: Traditional accounting metrics were designed for established businesses with predictable revenue. Startups need a NEW system!

☕ Hamed’s Analysis: The Vanity Metrics Trap

I see this mistake ALL THE TIME. Founders celebrate vanity metrics without realizing they’re heading for disaster!

Real example – Photo Editing App:

My client came to me excited:

• “Hamed, we have 50,000 downloads in 2 months!”
• “We’re trending on the App Store!”
• “Our Facebook page has 10,000 likes!”

My first question: “How many users are ACTIVE after 1 week?”

His answer: “Uh… I don’t know. Maybe 20%?”

Reality check: Only 8% were active after 1 week! And only 2% after 1 month!

Lesson: 50,000 downloads with 2% retention = You have a BROKEN product, not a successful one!

We stopped all marketing, fixed the core product, and increased 1-month retention to 35%. THEN we focused on growth.

---

The Intuit SnapTax Case Study

Eric Ries uses Intuit (maker of QuickBooks and TurboTax) as a perfect example of how even large companies can use Lean Startup principles. The story of SnapTax is particularly instructive.

The SnapTax Story

The Vision: Allow people to file their taxes (Form 1040EZ) in 15 minutes using just their smartphone camera for $14.99.

The Challenge:

• Intuit is a $3 billion company – they can’t afford public failures
• Tax filing is serious business – mistakes could damage their brand
• They had no idea if customers would trust a phone app for taxes

The Lean Approach:

• Launched MVP in California only (not nationwide)
• Team went to Apple Store in Palo Alto and tested with REAL customers in the store!
• Every Friday: Review metrics, decide what to test next week
• Released new version EVERY WEEK via iTunes App Store

The Results:
In ONE tax season (4 months), Intuit ran over 500 different experiments!

Key Learning: Initially, the app sent a paper invoice to customers’ homes for confirmation. Customers HATED this! “Why am I getting paper if I just filed on my phone?”

They pivoted based on this feedback and removed the paper invoice.

Intuit’s Three-Step Innovation Accounting Process

Eric Ries reveals that Intuit followed a rigorous three-step process:

Step 1: Establish the Baseline

• Launch MVP to small group (California only)
• Measure: How many people complete tax filing? How long does it take? What’s the error rate?
• This gives you a starting point

Step 2: Tune the Engine

• Make small improvements every week
• Test each change with real customers in the Apple Store
• Measure: Did the improvement move the metrics in the right direction?

Step 3: Pivot or Persevere

• After many iterations, decide: Is this working?
• If metrics are improving → Persevere and scale!
• If metrics stay flat → Pivot to a new approach

In Intuit’s case: Metrics improved dramatically, so they expanded SnapTax to more states!

☕ Hamed’s Analysis: Why Intuit’s Approach is Brilliant

Notice what Intuit did differently from most companies:

Traditional Approach (WRONG):

• Spend 12 months building the “perfect” product
• Launch nationwide with big marketing campaign
• Hope customers love it
• If it fails, lose millions and damage brand

Intuit’s Lean Approach (RIGHT):

• Build MVP in 6 months
• Test in ONE state with REAL customers
• Learn what works, iterate weekly
• Scale only after validation

Key Insight: Testing in the Apple Store was GENIUS! Why?

• Immediate feedback from real users
• Low cost (just send team to store)
• No risk to brand (small, controlled test)
• Fast iteration (test every Friday)

Real example from my work – Online Grocery Delivery:

My client wanted to launch in 5 cities simultaneously. I said: “Let’s do ONE neighborhood first!”

What we did:

• Week 1: Delivered to 20 customers manually
• Week 2: Asked them: “What would make you order again?”
• Week 3: Fixed the top 3 complaints
• Week 4: Delivered to same 20 customers again
• Result: 15 out of 20 became repeat customers!

Then we scaled to 2 more neighborhoods, then the whole city.

Lesson: Start small, learn fast, scale when validated!

---

What is Innovation Accounting?

Eric Ries formally introduces Innovation Accounting as a system to measure progress in conditions of extreme uncertainty. Here’s the framework:

The Three Stages of Innovation Accounting

Stage 1: Establish the Baseline (Use MVP to get REAL data)

You can’t improve what you don’t measure! The first step is to launch your MVP and get a baseline measurement of where you are RIGHT NOW.

What to measure:

• How many people signed up?
• How many completed the core action? (e.g., filed taxes, placed order, shared content)
• What’s the retention rate after 1 day, 7 days, 30 days?
• What’s the conversion rate?

Example – SnapTax Baseline:

• 100 people downloaded the app
• 60 completed tax filing (60% completion rate)
• Average time: 25 minutes (goal was 15 minutes)
• 15 customers complained about paper invoice

This baseline tells you: “Here’s where we are NOW.”

---

Stage 2: Tune the Engine (Optimize incrementally)

Once you have a baseline, make SMALL improvements and measure their impact. Don’t make 10 changes at once – test ONE thing at a time!

How to tune:

• Identify the biggest bottleneck (e.g., only 60% complete filing)
• Hypothesize: “If we simplify the questions, completion rate will increase”
• Test: Change the questions and measure
• Result: Completion rate increases to 75%!

Keep tuning until you hit diminishing returns!

---

Stage 3: Pivot or Persevere (Make the BIG decision)

After many rounds of tuning, you’ll reach a point where improvements plateau. Now you must decide:

• Persevere: If metrics are improving and heading toward your goal → Keep going and scale!
• Pivot: If metrics stay flat despite your best efforts → Your strategy is wrong, change direction!

For SnapTax: Metrics kept improving, so they PERSEVERED and expanded to more states!

☕ Hamed’s Analysis: The Pivot/Persevere Decision

This is the HARDEST decision for founders! Here’s my framework:

Signs you should PERSEVERE:

• Metrics are improving week over week
• Customers are giving positive feedback
• Retention rate is increasing
• You’re getting closer to Product-Market Fit

Signs you should PIVOT:

• Metrics are flat or declining for 4+ weeks
• You’ve tried 10+ improvements and nothing moves the needle
• Customers say “it’s nice but I don’t need it”
• Retention rate is below 20% after 1 month

Real example – Language Learning App:

My client built a language app targeting working professionals.

After 8 weeks of tuning:

• 7-day retention: 18% (started at 15%)
• 30-day retention: 5% (started at 4%)
• Despite adding gamification, social features, push notifications

My advice: “It’s time to pivot. Your product doesn’t solve a real pain for busy professionals.”

Their pivot: Target high school students preparing for language exams instead.

Result after pivot:

• 7-day retention: 55%!
• 30-day retention: 35%!
• Same product, different customer = SUCCESS!

Lesson: Don’t be afraid to pivot if the data says your strategy isn’t working!

---

End of Part 1
In Part 2, we’ll cover: Actionable vs. Vanity Metrics, Cohort Analysis, the Three A’s of Metrics, and how to avoid being misled by your data!

📊 Chapter 7: Measure – PART 2

---

Actionable Metrics vs. Vanity Metrics

One of the most important distinctions Eric Ries makes in this chapter is between Actionable Metrics (metrics that actually help you make decisions) and Vanity Metrics (metrics that look good but don’t guide action).

What Are Vanity Metrics?

Vanity metrics make you FEEL good but don’t help you make decisions!

Common vanity metrics:

• Total number of users: Doesn’t tell you if they’re active or paying
• Total page views: Doesn’t show if visitors are converting
• Total social media followers: Doesn’t equal engagement or sales
• Press mentions: Looks impressive but doesn’t drive growth

The problem: These numbers always go UP (they’re cumulative), so they make you feel like you’re succeeding even when you’re failing!

Example: Your app has 100,000 total users. Sounds great! But if only 500 are active this month, you have a DEAD product!

What Are Actionable Metrics?

Actionable metrics help you make CLEAR decisions and take action!

Examples of actionable metrics:

• Active users THIS week: Shows if your product is gaining or losing momentum
• Conversion rate (signups → paying customers): Tells you if your funnel is working
• Retention rate (% who return after 7 days): Shows if you have Product-Market Fit
• Customer Lifetime Value (LTV): Tells you how much you can spend on acquisition
• Revenue per customer: Shows if your monetization works

Why they’re actionable: If conversion rate drops from 10% to 5%, you KNOW you need to fix your onboarding!

☕ Hamed’s Analysis: The Vanity Metrics Disaster

I see SO many founders fooled by vanity metrics! Here’s a real horror story:

Client: Food Delivery App

What the founder showed me:

• “Hamed, we have 80,000 registered users!”
• “We’ve delivered 50,000 orders total!”
• “We’re featured on TechCrunch!”

My response: “That’s nice. Now show me your COHORT ANALYSIS.”

The REAL data:

• Only 3,000 users ordered in the last 30 days (96% churn!)
• Average customer placed 1.2 orders, then never came back
• Customer Acquisition Cost (CAC): $15
• Average Revenue per Customer: $8
• They were LOSING $7 per customer!

The Brutal Truth: “You don’t have a business. You have a money-burning machine!”

What we did:

• Stopped ALL marketing (no point acquiring customers who don’t return)
• Focused ONLY on retention: Why don’t customers come back?
• Found the issue: Delivery times were 60+ minutes (competitors were 30 minutes)
• Fixed logistics and reduced delivery time to 35 minutes
• Repeat order rate increased from 20% to 65%!

Lesson: Vanity metrics will LIE to you! Always look at retention and unit economics!

---

Cohort Analysis: The Most Powerful Tool

Eric Ries emphasizes that Cohort Analysis is one of the most important tools for Innovation Accounting. Instead of looking at aggregate data, you analyze groups of users who started using your product at the same time.

What is Cohort Analysis?

Definition: Group users by when they signed up, then track their behavior over time.

Why it matters: Cohort analysis reveals if your product is ACTUALLY getting better!

Example:

January Cohort: 1,000 users signed up

• Day 1: 800 active (80%)
• Day 7: 200 active (20%)
• Day 30: 50 active (5%)

February Cohort: 1,000 users signed up (after you made improvements)

• Day 1: 850 active (85%)
• Day 7: 400 active (40%)
• Day 30: 200 active (20%)

What this tells you: Your improvements WORKED! February cohort has 4X better retention at Day 30!

Without cohort analysis: You’d just see “total active users” and might miss this improvement!

☕ Hamed’s Analysis: How I Use Cohort Analysis

Cohort analysis SAVED one of my clients from disaster!

Client: Fitness App

The misleading aggregate data:

• “Total active users” was increasing every month
• Founder thought everything was great!

What cohort analysis revealed:

March Cohort: 5,000 new users

• Week 1: 3,000 active (60%)
• Week 4: 500 active (10%)

April Cohort: 8,000 new users

• Week 1: 4,800 active (60%)
• Week 4: 800 active (10%)

May Cohort: 10,000 new users

• Week 1: 6,000 active (60%)
• Week 4: 1,000 active (10%)

The SHOCKING truth: Retention was FLAT at 10% despite all their “improvements”! They were growing only because they were spending more on ads, NOT because the product was better!

My advice: “Stop ALL marketing spend until we fix retention!”

What we fixed:

• Onboarding was too complicated (reduced from 10 steps to 3)
• Push notifications were annoying (reduced from 5/day to 1/day)
• Added personalized workout plans

Result – June Cohort:

• Week 1: 70% active (up from 60%!)
• Week 4: 35% active (up from 10%!)

Lesson: Cohort analysis shows if you’re ACTUALLY improving or just throwing money at ads!

---

The Three A’s of Metrics

Eric Ries provides a simple framework to evaluate if a metric is truly actionable. A good metric must be:

1. Actionable

The metric must clearly demonstrate cause and effect, so you can take action based on it.

Bad metric: “Total page views increased by 50%”

• Why? You don’t know WHAT caused the increase!
• Was it a viral post? A bug? A bot attack?
• What action should you take? Unclear!

Good metric: “50% of users who watched the onboarding video completed signup (vs. 10% who didn’t)”

• Clear cause: Watching video → Higher conversion
• Clear action: Make MORE users watch the video!

---

2. Accessible

The metric must be easy to understand for everyone on your team, not just data scientists!

Bad metric: “Our Daily Active Users to Monthly Active Users ratio (DAU/MAU) is 0.23”

• Most people don’t understand what this means!
• Is 0.23 good or bad? Who knows!

Good metric: “23 out of every 100 users open our app daily”

• Everyone understands this!
• Easy to compare: “Last month it was 15 out of 100, so we improved!”

Eric’s advice: Use REAL numbers and percentages, not complex ratios or jargon!

---

3. Auditable

You must be able to verify the metric by checking the underlying data and talking to real customers!

Why this matters: Sometimes data lies! You need to verify with real people.

Example: Your data says “50% of users completed the checkout process”

• Go talk to 10 customers: “Did you find checkout easy?”
• If they all say “It was confusing!” → Your data might be wrong, or there’s a bug!

Eric’s story: IMVU once saw a spike in signups from a specific country. They celebrated! But when they investigated, they found it was a bot attack, not real users!

Lesson: Always verify your metrics with qualitative data (customer interviews)!

☕ Hamed’s Analysis: The Three A’s in Practice

I FORCE every client to follow the Three A’s! Here’s why:

Real example – SaaS Platform:

Their original dashboard:

• “Conversion funnel optimization coefficient: 1.47”
• “Engagement velocity index: 3.2”
• “Viral coefficient sigma: 0.89”

My response: “WHAT DOES ANY OF THIS MEAN?!”

Nobody on the team could explain it!

• Not actionable: What should we do differently?
• Not accessible: Only the data scientist understood it
• Not auditable: How do we verify this?

What we did – Rebuilt the dashboard:

New metrics (following the Three A’s):

• “15 out of 100 visitors sign up” (Accessible!)
• “Users who complete the tutorial are 3X more likely to subscribe” (Actionable!)
• “68% of users say onboarding is ‘easy’ in surveys” (Auditable!)

Result:

• Everyone on the team could now understand the metrics!
• Product team knew what to improve (focus on tutorial completion)
• We verified metrics by interviewing 20 users every week

Lesson: If your metrics need a PhD to understand, you’re doing it wrong!

---

The Three Engines of Growth

Eric Ries introduces a critical framework: Every startup grows through ONE of three engines. Understanding which engine drives YOUR growth is essential for measuring the right metrics!

Engine #1: The Sticky Engine of Growth

Definition: You grow by keeping customers coming back. High retention is key!

Who uses this: SaaS products, subscription services, social networks

Key metric to track: Retention Rate

The formula for growth:

• If your retention rate > churn rate → You grow!
• If new customers per month > customers who leave per month → You grow!

Example – Netflix:

• If Netflix keeps 95% of subscribers each month (5% churn)
• And adds 6% new subscribers each month
• They grow by 1% per month (6% – 5% = 1% net growth)

What to optimize:

• Reduce churn! Fix the reasons people leave
• Increase engagement (the more people use it, the less likely they’ll cancel)
• Don’t focus TOO much on new customer acquisition yet

Key insight: For sticky engine companies, retaining 1 customer is often more valuable than acquiring 2 new ones!

Engine #2: The Viral Engine of Growth

Definition: You grow because existing users bring in new users automatically!

Who uses this: Social networks, communication apps, collaborative tools

Key metric to track: Viral Coefficient

The formula:

• Viral Coefficient = (# of invites per user) × (% of invites that convert)
• If viral coefficient > 1.0 → EXPONENTIAL GROWTH!
• If viral coefficient < 1.0 → Growth will eventually plateau

Example – WhatsApp:

• Average user invites 5 friends to join
• 40% of those friends actually join
• Viral coefficient = 5 × 0.40 = 2.0
• Each user brings 2 new users → EXPONENTIAL GROWTH!

What to optimize:

• Make it EASY for users to invite friends (one-click invites)
• Give users a REASON to invite friends (the product is better with friends!)
• Improve the invite conversion rate (make signup frictionless)

Key insight: For viral products, even a small increase in viral coefficient (from 0.9 to 1.1) creates MASSIVE growth!

Engine #3: The Paid Engine of Growth

Definition: You grow by spending money on advertising to acquire customers!

Who uses this: E-commerce, marketplaces, most traditional businesses

Key metrics to track:

• Customer Acquisition Cost (CAC): How much you spend to acquire 1 customer
• Customer Lifetime Value (LTV): How much revenue 1 customer generates over their lifetime

The golden rule: LTV must be HIGHER than CAC!

Example – Online Store:

• You spend $30 on Facebook ads to acquire 1 customer
• That customer makes 3 purchases, spending $80 total
• LTV ($80) > CAC ($30) → You profit $50 per customer!
• You can reinvest that $50 to acquire MORE customers → GROWTH!

What to optimize:

• INCREASE LTV: Get customers to buy more often, spend more per order
• DECREASE CAC: Improve ad targeting, optimize landing pages, increase conversion rates

Key insight: For paid engine companies, unit economics is EVERYTHING! If LTV < CAC, you’re in trouble!

☕ Hamed’s Analysis: Choosing the Right Engine

Most founders make a CRITICAL mistake: They try to use all three engines at once!

Rule: Pick ONE engine and master it first!

Real example – Music Streaming App:

What the founder wanted:

• “Let’s run Facebook ads!” (Paid engine)
• “Let’s add referral bonuses!” (Viral engine)
• “Let’s focus on retention!” (Sticky engine)

My response: “You’re trying to do EVERYTHING and succeeding at NOTHING!”

What we did – Chose ONE engine:

• We picked the Sticky Engine because music streaming needs high retention
• Stopped ALL paid ads (saving $10,000/month)
• Removed referral program (it was distracting)
• Focused 100% on retention: Why do users stop listening?

Results after 3 months:

• 30-day retention increased from 25% to 60%!
• Once retention was solid, THEN we turned on paid ads
• Now ads were profitable because users stuck around!

Lesson: Master ONE engine before adding others!

How to choose YOUR engine:

• Sticky Engine: If your product has recurring value (SaaS, subscriptions)
• Viral Engine: If your product is better with friends (social, communication)
• Paid Engine: If you have high LTV and can afford ads (e-commerce, marketplaces)

---

🎯 Key Takeaways from Chapter 7: Measure

Essential Lessons:

1. Use Innovation Accounting, not traditional accounting

• Establish baseline with MVP
• Tune the engine incrementally
• Decide: Pivot or Persevere

2. Focus on Actionable Metrics, ignore Vanity Metrics

• Vanity: Total users, page views, social followers
• Actionable: Retention rate, conversion rate, LTV/CAC

3. Use Cohort Analysis to see if you’re REALLY improving

• Don’t be fooled by growing total users!
• Track each cohort’s retention separately

4. Apply the Three A’s to all your metrics:

• Actionable: Clear cause-and-effect
• Accessible: Everyone understands it
• Auditable: Can be verified with real customers

5. Choose ONE Engine of Growth and master it:

• Sticky: Optimize retention (SaaS, subscriptions)
• Viral: Optimize viral coefficient (social, communication)
• Paid: Optimize LTV/CAC ratio (e-commerce, ads)

The Ultimate Rule: Measure the metrics that will tell you if your leap-of-faith assumptions are TRUE!

---

🎉 End of Chapter 7: Measure 🎉

Next Chapter Preview:
Chapter 8: Pivot (or Persevere)
We’ll learn about the different types of pivots, how to know when it’s time to pivot, and real examples of successful (and unsuccessful) pivots!