Datadog Experiments Reviews & Product Details

I like that it makes running experiments easier, particularly from a data pipeline + data analysis perspective Review collected by and hosted on G2.com.

I wish that it were easier to group experiment results by certain user properties and/or product types Review collected by and hosted on G2.com.

Eppo has an excellent interface for showcasing experiment progress and results. Visually clean and easy to understand.

Also love their plug-and-play integration with Snowflake. We finished POC in 2 weeks!

They also have one of the best support teams. Always ready to answer questions and educate various team members from experimentation basics to advanced statistical methods.

Their tool supports companies just starting out with experimentation as well as more advanced methodologies. Review collected by and hosted on G2.com.

Nothing yet! We are lucky that we have a solid Data Engineering and BI Engineering team to help setup the metrics and database tables, otherwise, this could have taken longer. Review collected by and hosted on G2.com.

- Strong product: best in class stats engine

- Growth-minded and helpful team: providing timely support for questions and constantly incorporating customer feedback into the product

- Great documentation: good learning materials for both experimentation practitioners and anyone new to ab tests

- Easy to grasp information architecture on the platform Review collected by and hosted on G2.com.

Nitpicks alert: Would love to

- Get adoption metrics for free with count metrics

- Have deep link into explore charts with slice and dice

- Be able to do pairwise comparison between variants more easily on the fly Review collected by and hosted on G2.com.

Makes complicated analysis simple and understandable, which uplevels our entire organization. Review collected by and hosted on G2.com.

Not all product work can be an experiment, so there's still additional work I need to do outside the product. Review collected by and hosted on G2.com.

Dedicated customer support team, responsive team, always be customer oriented and address customer needs. Review collected by and hosted on G2.com.

immature software development tool, reliable engineering support. Review collected by and hosted on G2.com.

We use Eppo at Delivery Hero for warehouse-native experiment evaluations (in tandem with our own feature flag management tool and SDK). With some analytics engineering investment in setting up a reliable metrics catalog, we have been able to dramatically reduce the overhead in experiment evaluations for our large product organization. Eppo offers an intuitive experiment setup and summary experience that has saved Product Analysts a lot of time and mundane overhead. An additional benefit is that it comes with all the latest statistical evaluations (and corrections, e.g. - when the randomization and evaluation units do not match in an experiment) that allow us to move past fixed-horizon testing when it makes sense.

In addition, the team, starting right with the leadership, have a strong customer success mindset and are highly responsive on Slack to all operational concerns. Review collected by and hosted on G2.com.

I don't have a whole lot to complain about, given we were very clear with what we looked Eppo to solve. So there has been no misaligned expectations. Review collected by and hosted on G2.com.

Eppo provides us with robust statistical analysis of A/B tests using modern methods that allow us to learn as fast as possible given the effect size. It was easy to integrate. We were up and going in about 3 days Review collected by and hosted on G2.com.

Because it's warehouse native, it makes assumptions about the underlying data models in your warehouse. If they don't match those assumptions, then you need to do work to make everything play nicely together. Fortunately, they are reasonable assumptions and not hard to match if you don't already. Review collected by and hosted on G2.com.

Easy to add metrics and experiment.

Centralized management.

Support CUPED. Review collected by and hosted on G2.com.

Some functions not available.

For example, not able to compare between variants (can only compare variant with control).

Not able to run difference in difference. Review collected by and hosted on G2.com.

It's great to have the daily reporting as a result of Eppo - it has led to finding problems faster and getting more buy-in from stakeholders. The advanced analytics is also critical to making better decisions across our business. Review collected by and hosted on G2.com.

The updates are only daily, rather than real-time, given computing cost constraints, which limits some of the value. Also the fact that CUPED analysis isn't available (due to compute costs) on the explore graphs means that we sometimes present inconsistent data. Finally, three-way experiments could be better visualized (a vs. b vs. c, rather than a vs. b and a vs. c). Review collected by and hosted on G2.com.

Eppo has the ability to act as both as a data visualization of our test results but also as a record of truth of historical wins and losses Review collected by and hosted on G2.com.

Being able to only update results once a day, though that might be more of a limitation on our company's database's end Review collected by and hosted on G2.com.