Confidence by Spotify Reviews & Product Details

I find that Confidence provides a really strong user interface and a great depth of features that make experimenting highly accessible. It does an excellent job of accommodating a wide variety of workflows by packaging everything—from feature toggling and rollouts to A/B testing, segments, analytics, and educational modules—into one seamless experience. Review collected by and hosted on G2.com.

I have not found anything to dislike yet. Review collected by and hosted on G2.com.

Clean UI that’s easy to understand, and the people in the Slack channel are genuinely helpful when you need support. Review collected by and hosted on G2.com.

The documentation is missing a few examples. It would be much easier to understand and follow if there were one clear, consistent example used throughout the docs. Review collected by and hosted on G2.com.

Two main things :

1. You feel that it was built with deep scientific rigor, making you trust the process

2. Confidence manages to bring together into one space all the parties involved in experimentation. Developer for feature flagging ; PMs & UX designer to build the experimentation ; Data Analysts to provide KPIs and help interpret results. This reduces friction over a usually painful endeavor Review collected by and hosted on G2.com.

A/B testing is by nature very technical, Confidence reduces a lot the complexity of this process, but I am sure it can and will still grow in that direction. Review collected by and hosted on G2.com.

Great tech support from the Confidence team which helps us move fast.

Easy to use for engineers & PMs alike.

Useful integrations like the MCP which makes it easy to use in other workflows that we have. Review collected by and hosted on G2.com.

Not that often but sometimes when test don't work, it takes time to investigate what is wrong. Review collected by and hosted on G2.com.

For me it's the responsiveness of the team at Spotify. Whenever we miss something, we basically say the word and then we have a solution that works for us right away. Review collected by and hosted on G2.com.

I've been using it since very early days though so of course there has been some quirks here and there along the way, but overall everything is moving in the right direction. Review collected by and hosted on G2.com.

Confidence is easy to set up, and simply works without requiring frequent workarounds. Furthermore, the Confidence team is extremely fast when acting on feedback. Reported bugs are usually fixed within a couple days (sometimes within hours), and many of our feature recommendations have been implemented. They also have solid web training and documentation. Review collected by and hosted on G2.com.

Because the product is improving quickly, sometimes when I pop back in after a long break or vacation, it takes a moment to adjust. But this is me stretching for something for them to improve on. Review collected by and hosted on G2.com.

1. Easy-to-use UI with lots of helpful features

2. Ease of integration via OpenFeature

3. APIs for programmatic access

4. (last but not least) Confidence team is very responsive and constantly iterating. Review collected by and hosted on G2.com.

Not sure it's a "disadvantage" but I don't know what the experience would be like working with Confidence as a very small entity with minimal funding, e.g. if I was a one-person team bootstrapping a small startup. Review collected by and hosted on G2.com.

Having a common ground for testing (UI, methods, metrics, ...). I also really appreciate the reactivity of the team when needed. Review collected by and hosted on G2.com.

Metrics can be a struggle to adapt, recompute. Also identifying duplicated computations would be a great feature. Review collected by and hosted on G2.com.

Clear results and an easy-to-use UI, even for non-tech people. Review collected by and hosted on G2.com.

The lack of deep technical documentation on certain topics like flags, clients, or exposure calculators. The need to have a previous flag to determine the sample size, which is not always the case when you start an experiment for a new feature. Review collected by and hosted on G2.com.

It's an easy way to get control over rollouts, experiments and see their actual outcome. Review collected by and hosted on G2.com.

Flag rules can sometimes be a bit tedious to set up. It would be nice if the system to add rule templates that can be reused on flag creation. Review collected by and hosted on G2.com.