Solo Founder Product Engineering Handbook / Chapter 42
Retention Analysis for Builders
Analyze retention by natural usage frequency, cohort, segment, and value event so repeated use becomes actionable product evidence.
Preparing audio…
Audio edition
Retention Analysis for Builders
Start With the Missed Return
A founder has built an inventory planner for small retailers. The first dashboard says that day-seven retention is poor. The obvious remedies arrive at once: send reminders, redesign the home screen, speed up import, add a forecasting feature.
None of those ideas can be judged yet. The shops do not plan inventory every seven days after signup. Most review stock on Monday or Tuesday before placing weekend orders, and several first imported data on a Friday. The metric has cut across the customer’s work instead of following it.
The founder asks a better question:
When the next ordering decision arrived, did the same shop review a reorder recommendation and use it to place an order?
Now retention can reveal something about the product. It follows a unit that receives value—the shop account—through a recurring job and looks for the behavior that completes that job again.
Early product evidence is easy to stage. Traffic can be bought. A demo can be polished. Onboarding can be carried by the founder. Even payment can follow personal persuasion or a generous pilot. A return to repeated value is harder to arrange from outside the product. It does not prove product-market fit by itself; price, distribution, margin, and support load can still fail. But without repeated value, those other signals are fragile.
Retention analysis begins by making one claim precise: the right unit repeated the right value behavior when the problem naturally returned.
Give Every Retention Claim Four Coordinates
“Retention is 24 percent” is incomplete. Before calculating a rate, name four things.
First, choose the retention unit. A consumer product may retain a person. A business product may retain an account, workspace, clinic, store, project, repository, or site. If one clinic employee leaves while another continues the monthly workflow, user retention and account retention tell different stories. The unit should be the smallest entity that receives the product’s promised value.
Second, choose the value event. A login proves access, not value. For the inventory planner, the first meaningful event is reviewing a reorder recommendation with current stock and supplier data. The repeated event is doing that again for the next ordering decision. For an API, it may be another successful production request; for a reporting product, another client-ready report sent in the next reporting cycle.
Third, choose the clock. Day-one, day-seven, and day-thirty retention are useful only when those windows correspond to the customer’s work. A daily planning tool may need D1 and D7. A weekly reporting product needs weekly cycles. A monthly close product needs month-over-month account retention. A deadline-driven or episodic product may need retention at the next case or deadline, with preparation events in between.
Finally, choose the cohort: the group whose history will be compared. Start period is the usual baseline, but segment, acquisition source, use case, product version, and assisted versus self-serve onboarding may explain more than the calendar.
Write the complete claim in ordinary language before writing the query:
Among specialty-food shops that first reviewed a reorder recommendation in the week of 6 July, what share reviewed another recommendation in each subsequent weekly ordering cycle, without founder assistance?
That sentence fixes the denominator, behavior, clock, segment, and service boundary. It also makes a silent metric redefinition harder.
Use the Customer’s Clock
Analytics tools often offer D1, D7, and D30 because they are easy to standardize. The product does not owe them a daily rhythm.
Map the problem before choosing a window. Ask how often the job recurs, what makes the next occurrence visible, and how long an account can be absent before the absence is meaningful. A monthly reporting customer who connects source data and saves a template may be preparing to return even though D7 is empty. A daily operations customer who appears once in a thirty-day active count may have missed most of the value cycles.
For slower products, preparation behavior can reveal whether the workflow is still alive. Uploading evidence before a compliance deadline, scheduling the next review, inviting the next operator, or saving state for a new case can be useful leading evidence. Do not rename those actions “retention” unless they deliver the promised value again. Keep preparation and repeated value separate so that hope does not enter the numerator.
Define the time convention as well. “D7 retention” sometimes means activity on day seven and sometimes means activity on or after day seven. Either definition can be useful; mixing them across reports cannot. Record whether the window is exact, rolling, or bounded by a work cycle.
The clock may change as the founder understands the product. When it does, preserve the old definition, date the new one, and avoid presenting the two as one continuous trend.
Keep the Account History Beneath the Curve
A cohort curve is a compressed account history. Before product-market fit, the history is often more valuable than the compression.
The inventory founder can begin with a spreadsheet. One row represents one account. Columns preserve the evidence needed to reconstruct the claim:
account_id | started_at | segment | source | activation_at | cycle_1
cycle_2 | cycle_3 | assistance_by_cycle | churn_note | revenue
Each cycle cell should hold a state, not an ambiguous yes or no:
not_eligiblewhen the next work cycle has not arrived;not_activatedwhen first value never happened;repeatedwhen the value event occurred without help;repeated_assistedwhen founder labor carried part of the promise;missedwhen an eligible cycle passed without the event;resurrectedwhen value repeated after one or more missed cycles.
These distinctions prevent three common accounting errors. Incomplete cohorts do not become churn merely because time has not passed. Accounts that never activated do not get mixed with accounts that reached value and failed to return. Founder-assisted use remains evidence of pain without masquerading as a self-sustaining product.
The sheet may be fed by product events, database queries, payment exports, and manual notes. It need not be elaborate, but it must be inspectable. Keep stable account identifiers, exclude test accounts, preserve event-definition versions, and record missing or reconstructed events. With twelve customers, the founder should be able to move from a percentage to the accounts that produced it.
Follow One Cohort Until It Resists the Easy Answer
Suppose eight shops first reviewed reorder recommendations during the same two-week launch period. At the next three ordering cycles, the sheet reads:
ACCOUNT SEGMENT ACTIVATION C1 C2 C3 ASSISTANCE
Juniper Foods specialty food supplier import repeated repeated repeated none
Harbor Pantry specialty food supplier import repeated repeated repeated import cleanup
Marlow Market specialty food manual entry repeated missed missed none
Sunrise Deli specialty food supplier import repeated repeated not_eligible none
Paper Finch gift shop manual entry missed missed missed none
North Star Gifts gift shop manual entry repeated missed missed reminder at C1
Willow Home home goods supplier import missed missed missed none
Field & Jar specialty food supplier import repeated repeated_assisted not_eligible export repair
A single launch-wide rate loses the useful shape. The specialty-food shops have a recurring ordering problem; the gift and home-goods shops do not show the same pull. Supplier import appears connected to stronger return, but two retained accounts needed founder work. One newer account is not yet eligible for cycle three and must not be counted as a loss.
The sheet suggests a narrower decision than “improve retention.” Keep the specialty-food segment, repair supplier import and export reliability, and test whether the next qualified accounts repeat the weekly recommendation review without help. The founder should not add reminders merely because one gift shop returned after a prompt. That account still missed the later cycle, and its problem may never have been frequent enough.
This is why segmentation belongs before averaging. A small retained pocket can be the most important result in the dataset when its members share an urgent job, a recognizable buyer, and a natural cadence. It can also be selection bias: founder-recruited accounts may retain because they were better qualified or repeatedly rescued. Compare source and assistance before calling the pocket market pull.
Read the Loss in Sequence
The path from signup to retention contains at least two different failures.
If many target accounts sign up but few complete the first value event, the evidence points toward qualification, promise, setup, trust, or onboarding. If activated accounts then disappear before the next natural cycle, first value may be shallow, episodic, badly timed, or disconnected from the continuing workflow. When most activated accounts retain but few accounts activate, widening the feature set may be the wrong response; the entry path deserves attention.
Always calculate both steps:
activation rate
= accounts reaching first value / eligible target accounts
cycle-N retention
= activated cohort accounts repeating value in cycle N
/ activated cohort accounts eligible for cycle N
Do not hide the first denominator inside the second. “Most activated users retain” can coexist with a severe setup failure. “Overall retention is poor” can conceal a product that works after a difficult import.
Assistance deserves its own cut. If founder-assisted accounts retain and self-serve accounts churn, the pain may be real while the founder remains part of the product. The intervention may be a better default, import tool, document, qualification rule, or explicitly priced service boundary. Counting those accounts without the assistance flag delays that decision.
Let Curves Point Back to Accounts
Once several cohorts have matured, a curve makes changes through time visible. An immediate drop before activation sends the founder back to qualification and setup. A strong first return followed by decay suggests that the first result was interesting but did not become recurring work. A small line that flattens deserves inspection: after novelty and casual trials have washed out, some accounts continue to return.
A flat line is not a verdict. With a small cohort, one account can make a curve look stable. Read the underlying histories. Do retained accounts share a segment, workflow, source, or activation path? Did the product carry the work, or did the founder? Has the cohort lived through enough natural cycles to support the claim?
External benchmarks can be useful when category, price, segment, acquisition channel, and usage frequency are genuinely comparable. Before product-market fit, they more often distract from the local diagnosis. The relevant question is not whether another product retains 30 percent. It is why this cohort returned, why that cohort did not, and which change should alter the next eligible cycle.
Choose the Level That Matches the Decision
User retention answers whether the same person returns. Account or logo retention answers whether the customer organization remains. Both may be needed when several people perform one workflow. A clinic can retain even as its operator changes; declining user participation inside retained clinics can still warn that the workflow is becoming fragile.
Feature retention asks whether people who adopt a capability continue to use that capability. It is diagnostic only when tied to a product question. Repeated use of an export button may explain a reporting workflow, but it should not replace the account’s core value event.
Revenue retention belongs beside behavioral retention, not in place of it. For the accounts present at the start of a period:
gross revenue retention
= (starting recurring revenue - churn - contraction)
/ starting recurring revenue
net revenue retention
= (starting recurring revenue - churn - contraction + expansion)
/ starting recurring revenue
Gross revenue retention cannot exceed 100 percent because it excludes expansion. Net revenue retention can. A rising net rate may still hide product weakness if one expanding account offsets several lost ones, so keep logo retention and account behavior visible. Early samples are usually more honest as account histories and exact revenue amounts than as a polished percentage.
Ask Churn What the Curve Cannot
The curve shows where to look; a lost customer may explain what happened there. Ask while the attempted workflow is still fresh:
- What were you trying to complete when you first used the product?
- What did you expect to happen the next time that work appeared?
- Where did you stop, and what did you use instead?
- Was the problem infrequent, the setup costly, the result weak, or the workflow awkward?
- What would have needed to be true for you to use it again?
Do not turn the conversation into a rescue call. Record the answer against the account and compare it with observed behavior. “No recurring owner” means something different from “the recommendation ignored supplier lead time,” even if both accounts are absent in cycle two.
Track resurrection separately from continuous retention. A customer who returns at the next true deadline may reveal that the original clock was too short. A customer who returns only after founder outreach may reveal relationship retention rather than product retention. A return after a product change can expose a missing workflow step, but one recovery does not erase the earlier missed cycles.
End the Analysis With One Intervention
Retention analysis has earned its place only when it changes what the founder does. The likely bottleneck should be specific enough to attack:
- activation, when target accounts do not reach first value;
- recurring utility, when they activate but do not repeat the value event;
- frequency, when the measurement window contradicts the customer’s work;
- segment fit, when one coherent group returns and others do not;
- productization, when retention depends on founder labor;
- packaging or buyer fit, when repeated use is strong but payment is weak.
Complete the spreadsheet with a short decision note:
RETENTION READ
Target segment:
Retention unit:
Natural cycle:
Activation event:
Repeated value event:
Cohorts compared:
Largest trustworthy drop:
Strongest retained pocket:
Founder assistance:
Churn evidence:
Likely cause:
Next intervention:
Expected change in the next eligible cohort:
Then test the instrument on the last four starting cohorts. Mark accounts that have not yet become eligible instead of forcing them into the rate. Separate accounts that never activated, repeated value unaided, repeated with help, missed a cycle, or returned after a gap. Write one sentence: “The retention problem is most likely ___ because ___.”
If that sentence remains vague, resist building. Narrow the segment, strengthen the value event, or correct the clock until the evidence can distinguish one intervention from another.
Repeated value is the behavioral heartbeat of product-market fit. The next question is whether that value can survive price, delivery cost, and the limits of one founder.
Continue reading
Full table of contents