Dot Plots: Visualizing Individual User Activity for Insight

Founders often make the mistake of relying solely on aggregate user metrics, such as Daily Active Users (DAUs) or Monthly Active Users (MAUs), which can obscure individual user behavior and product engagement. While cohort retention curves are valuable for tracking user groups over time, they don't reveal how users interact with the product, which features they use, or their frequency and pacing of use. To address this, a tool called the "dot plot" can provide a detailed view of individual user activity while also offering a broader perspective on overall product performance.

What is a Dot Plot?

A dot plot is a two-dimensional grid, similar to a spreadsheet, where:

• Each row represents an individual user. For example, if Dave is a user, he gets his own row.
• Each column represents a time period. Days are typically the most effective time unit, though this can vary depending on the product.

Within each cell (the intersection of a user's row and a specific day), a dot is placed if the user performed a chosen "value-representing" action on that day. This action should signify that the user is deriving value from the product.

Choosing the Right Event

The key to an effective dot plot is selecting an event that truly represents value for the user. Examples include:

• Photo app: Sharing a photo.
• Music app: Listening to a song.
• B2B invoice processing product: Processing an invoice.

Avoid generic actions like "opened the app" or "signed in," as these don't necessarily indicate value creation.

Enhancing the Dot Plot

To gain even more insights, dot plots can be enhanced:

• Onboarding Indicator: Mark the first day a user used the product (their onboarding day) with a special symbol, such as a ring around the dot.
• Feature Usage: Use different symbols or letters within the cells to indicate the use of specific features. For instance, an "S" for using search or a "P" for joining a playlist in a music app.
• User State/Demographics: Encode user attributes like device type (iOS, Android), geographic location (country), or demographic information (e.g., income bracket) by shading cells, using different symbols, or adding notes next to the user's row.
• Sorting: Sort rows based on user attributes (e.g., all iOS users first, or users who onboarded on a specific day) to identify patterns within specific segments.

Insights from Dot Plots

Dot plots allow founders to visualize individual user behavior over time, revealing patterns that are often invisible in aggregate data or raw logs.

Identifying Usage Patterns

• Weekday vs. Weekend Users: A dot plot can quickly show if certain users primarily engage with the product during weekdays, while others are weekend-only users. This insight can inform product design, marketing strategies, and user targeting.
• Retention Issues: A row with a single dot followed by many empty cells indicates a user who tried the product once and never returned. A prevalence of such rows might signal problems with onboarding or initial user experience.
• Feature Impact: By tracking feature usage, a dot plot can reveal if certain features correlate with sustained product engagement. For example, if users who join a public playlist tend to use the product for many consecutive days, it suggests the playlist feature is a strong driver of retention.

Real-World Examples

• PayPal's Fraud Detection: Max Levchin, a PayPal co-founder, used a similar visualization technique to detect fraud. By having humans stare at graphs of transactions, they could intuitively spot unusual patterns that indicated fraudulent activity, even without knowing the exact rules.
• B2B Customer Health: For B2B products, dot plots can reveal the health of a customer account. For instance, a company that purchased 10 seats but only had 3 active users with sporadic usage indicates a high risk of churn, even if the contract value is high. This allows proactive intervention.
• Google Photos at Scale: Even with billions of users, Google Photos utilized dot plots by sampling users. Teams would print out dot plots for specific user segments (e.g., "iOS users in France" or "web users in the US earning over $80,000/year") to understand their behavior.

Common Mistakes to Avoid

1. Charting the Wrong Event: Do not choose events that don't represent actual user value (e.g., "opened the app"). Focus on actions that indicate genuine engagement and benefit.
2. Picking Too Wide a Time Period: Using weeks instead of days can obscure important daily usage patterns. Daily or even sub-daily granularity is often necessary for meaningful insights.

Dot Plots vs. Cohort Retention Curves

• Cohort Retention Curves: Show whether groups of users stick with the product over time in aggregate.
• Dot Plots: Show how individual users are actually using the product, providing granular detail and "color" to the data.

Both tools are crucial for a comprehensive understanding of user behavior. Dot plots can be particularly powerful for early-stage founders with a small user base, as they can literally view every user's activity on a single screen. They are also scalable through user sampling for larger products.

Dot plots are essentially a visualization of logs, requiring no complex computations. Modern AI coding tools can generate them quickly. By combining dot plots with cohort retention curves, founders can ask better questions, build more effective features, and fix product issues that aggregate metrics alone would never reveal.