Abstract

Confidence (spotify-confidence on PyPi) is an open-source Python library that has been used to analyze experiments at Spotify for more than four years. It is now also an integrated part of Spotify's internal experimentation platform, where it's used to automatically analyze thousands of experiments every year. In this talk, we will discuss its benefits, demonstrate how to use it, and talk about what lies ahead.

Erik Stenberg

Data scientist @ Spotify

Erik Stenberg is a Data Scientist working on the Experimentation Platform team at Spotify in Stockholm, but with roots in Lerum outside Göteborg. He got his master's in statistics from Uppsala university in 2019 and wrote his thesis on variance reduction methods in sequential A/B testing at Spotify.