(Video and takeaways) Using metrics and analytics to supercharge your experimentation

Fri Sep 29 2023

Sid Kumar

Product Marketing, Statsig

This week we hosted a virtual meetup from our office in Bellevue.

I had the pleasure of chatting with our exceptional Software Engineers, Pierre Estephan and Alex Coleman. Our discussion revolved around metrics and analytics within the context of experimentation.

We delved into real-world examples showcasing how companies like Facebook, and some of our valued Statsig customers harnessed user insights to propel product-led growth. In light of our recent launch of Metrics Explorer, we wanted to discuss how having an integrated platform for experiments and analytics can empower organizations to unlock insights that drive growth. You can watch the recording of the event here:

5 key takeaways on how to supercharge your growth:

Break down high-level KPIs

It's challenging to directly impact high-level KPIs like retention or engagement. Therefore, it's crucial to understand the key drivers that lead to these goals. In all the examples we covered, including the famous Slack example where "messages sent" was the key driver of retention, companies identified what mattered most to their users and worked toward that, ultimately driving growth.

Look at long-term retention

We discussed the concept of novelty effects, using notification fatigue as an example to emphasize the importance of going beyond instant gratification. It's not just about improving DAU in the short-term; it's about observing the long-term impact with metrics like 28-day retention.

Discover the 'aha' moment for your users

Correlation doesn't imply causation, so it's not as simple as blindly pursuing a metric that appears to be correlated with retention. Instead, it's about understanding how users realize value. We emphasized the importance of understanding the qualitative aspects behind a metric, like how Facebook's famous "7 friends in 10 days" wouldn't have worked with automatically added friends for new users; it required relevant suggestions, for example.

Have a single source of truth and democratized access to metrics

Leading PLG companies avoid the biggest operational challenges of running experiments at scale (such as having too many tools in their stack, siloed data, and disagreements between teams on feature results) by maintaining a single platform for consistency. Everyone across the company, including non-technical users, has visibility into metrics. This approach keeps engineering and product teams agile, free from cumbersome processes, and able to build, measure, and learn rapidly.

Identifying drop-off points in a funnel can give you big wins

We discussed examples where companies were able to achieve double-digit growth in core metrics by identifying drop-off points in the customer journey, such as the login or checkout funnel. They used these insights to capture low-hanging fruit by testing features to close these gaps. For more stories about our own customers who achieved remarkable growth, you can visit our customer stories page.

Read our customer stories

Dive into our customer stories to learn how leading companies are winning with Statsig.
a pencil writing on a notepad with a quotation mark
Feel free to reach out to us if you have any pending questions or would like to learn more about Statsig. Statsig customers can take advantage of Metrics Explorer right away, allowing them to start gaining actionable intelligence immediately.

Join the Slack community

Connect with our data scientists and engineers, and ask questions or just hang out with other cool folks that believe in an experimentation culture!
join slack community cta image

Build fast?

Subscribe to Scaling Down: Our newsletter on building at startup-speed.

Try Statsig Today

Get started for free. Add your whole team!
We use cookies to ensure you get the best experience on our website.
Privacy Policy