Amplitude Feature Experimentation Reviews & Product Details

What I like best about Amplitude Feature Experimentation is its flexibility. It allows us to define experiments around the metrics that matter most to our business, whether that's activation, engagement, retention, or conversion. The ability to target specific user segments, control feature rollouts, and analyze results within the same platform makes experimentation much more efficient.

I also appreciate the seamless integration with Amplitude Analytics, which enables us to move quickly from identifying an opportunity to measuring its impact. The experiment summary reporting feature is another valuable addition, as it helps communicate results and key learnings to stakeholders in a clear and concise way. Review collected by and hosted on G2.com.

One area that could be improved is the experiment summary reporting feature. While it's very useful for communicating results and key learnings to stakeholders, currently the summary cannot be regenerated once it's created. As experiments evolve or additional insights emerge, it would be helpful to have the ability to recreate or refresh the summary report without having to manually compile the findings again.

Additionally, some advanced reporting workflows could be more flexible for teams managing a large number of experiments simultaneously. Review collected by and hosted on G2.com.

As someone who worked at a web experimentation agency for many years and has seen a host of different A/B testing software, I can confidently say that Amplitude experimentation is one of the better options. The fact that it’s deeply integrated into Amplitude as a whole is probably the best part of the overall feature set. That integration also makes it easy to quickly run follow-up analyses to better understand user behavior. Review collected by and hosted on G2.com.

There are a few small areas I think could be improved, especially around reporting—mainly how the metrics and statistics are presented. Since test results are often shared with other team members, including leadership, it would be helpful to have a way to make those metrics easier for them to understand at a glance. Review collected by and hosted on G2.com.

I like Amplitude Feature Experimentation for its versatility, especially the ability to also use Web Experimentation even without coding experience, thanks to the drag and drop feature. The Feature experimentation module istelf is well-structured, allowing us to build and manage experimentation schemas efficiently across different teams. This structure supports our workflow since many teams work on the same website, enabling us to set tags and divide experiments securely and clearly. It really helps me and our team get an overall view of where we are working and identify what is driving value. Review collected by and hosted on G2.com.

We had a hard time setting it up just because we didn't have the technical know-how on how the background engine actually works. It was quite techie for non-technical people, and also for technical people, it was quite product-oriented. They didn't know why we use that code and why it is needed. So, this combination of the product part and the experimentation part was tricky. Review collected by and hosted on G2.com.

It provide us single ecosystem for analytics + experimentation since we already use Amplitude analytics. The UI is very intuitive. The AI Agent seems to be quite good in explaining the numbers or confusing point Review collected by and hosted on G2.com.

The pricing is relatively high for us, especially given the seasonal nature of our product. While we occasionally require implementation support, the quality of assistance has been inconsistent and largely depends on the technical expertise of the support representative. In some cases, the guidance provided has been fairly generic - similar to what I could already obtain from an AI assistant - which has limited its value. Review collected by and hosted on G2.com.

I like the experimentation, AI side chat and the charts it generates. Those are pretty neat. Also, related to the school, their dashboards are fine, as they track the data and do the job. Review collected by and hosted on G2.com.

The AI might not be fully reliable, and at least it did not inspire confidence for me when I looked at the AI side chat. You know, it changed its mind after I pushed back. That's something about the AI side chat. And then also, not related to AI side chat, but in general, whether or not the users had cookies would affect the signal significantly. That would have been nice to know before because what was happening is that I started an experiment and then realized it needed to run for a few months instead of just one month that I expected it to. Any estimate or guidance there would have been nice. Review collected by and hosted on G2.com.

I really like that Amplitude Feature Experimentation helps us conduct A/B testing for our website updates and features. It's really helpful in understanding what changes make sense for our users and what doesn't. I appreciate the ability to compare treatment versus control groups because it's pretty clear in terms of the metric uplift. For example, it clearly shows if there's an impact on conversion, which helps us take key takeaways and see how it's going to impact our top-line numbers. Review collected by and hosted on G2.com.

The AI is pretty terrible, to be honest. Also, the ability to quickly pull data is lacking. For example, if I want to cross-reference against other tools where we have additional customer data, it's hard to do so and very painful. Review collected by and hosted on G2.com.

Very accessible and easy to use UI for setting up experiments, including metrics setup, duration estimation, monitoring, and significance. Review collected by and hosted on G2.com.

We've had some challenges integrating with our Flutter app and tracking assignment as early in the app process as possible, but with the native Flutter support now in early beta I have high hopes that all of our needs will be met soon. Review collected by and hosted on G2.com.

I like Amplitude Feature Experimentation's ability to conduct A/B testing and try out different features to see what works best for our users. What I find most valuable is its depth and wide consideration of user needs, like defining the hypothesis and background, and setting primary and secondary success metrics. I also appreciate how it helps navigate to the users whom the experiment has been assigned. Additionally, creating multiple variants within the experiment cohort based on multiple logics is a feature I really enjoy. Review collected by and hosted on G2.com.

One thing I find difficult is triangulating the number of users to whom the experiment is assigned. For example, if the experiment is rolled out to 50% of the users, then we should have a clear definition of the base cohort from which the 50% users are rolled out. Also, I wish we had the option to directly download the cohort users for different variants from the experiment only. In the beginning, it was a little overwhelming, and we were afraid that one thing wrong could impact users, but now the team is used to it and we find it easy. Review collected by and hosted on G2.com.

I find Amplitude Feature Experimentation really easy to use, especially when it comes to connecting tests with metrics, which makes it very accessible for non-technical people to test ideas without the complexity of connecting data. It's also great that I only need one platform to perform tests and instrumentations. The initial setup was very easy, with just a few steps to get started. Review collected by and hosted on G2.com.

The steps to create the Experiment, an UI refine will be great Review collected by and hosted on G2.com.

What I like most about Amplitude Feature Experimentation is how easy it is to run A/B tests and make UI changes directly on the frontend. Review collected by and hosted on G2.com.

What I dislike about Amplitude Experimentation is that the UI editor doesn’t let us create new HTML elements and attach event listeners to them. Review collected by and hosted on G2.com.