Optimizely Feature Experimentation Pros and Cons

Optimizely Feature Experimentation Pros and Cons: Top Advantages and Disadvantages

Quick AI Summary Based on G2 Reviews

Generated from real user reviews

Users find Optimizely Feature Experimentation to have great ease of use once familiar with its interface and terminology. (12 mentions)

Users find A/B testing easy and effective with Optimizely, enabling seamless feature rollouts and diverse experiments. (11 mentions)

Users value the flexibility of personalized UX in Optimizely Feature Experimentation, enhancing targeting and customer insights. (11 mentions)

Users value the flexible and granular UX personalization capabilities of Optimizely Feature Experimentation for effective targeting. (10 mentions)

Users find it relatively easy to implement Optimizely Feature Experimentation, enhancing their ability to conduct experiments effectively. (8 mentions)

Users value the ease of managing feature flags for testing and activating new features effectively within Optimizely. (5 mentions)

Users find the difficulty of use in Optimizely, particularly with complex experiments and initial setup, quite challenging. (5 mentions)

Users find the learning curve steep, making initial registration and feature experimentation challenging for beginners. (5 mentions)

Users find the complexity of Optimizely Feature Experimentation challenging, especially during onboarding and integration with legacy systems. (4 mentions)

Users find Optimizely Feature Experimentation too expensive, especially for solopreneurs and tight budgets. (4 mentions)

Users struggle with feature flag management issues, desiring better tools and navigation for effective usage. (3 mentions)

Users find the steep learning curve of Optimizely Feature Experimentation challenging for newcomers, hindering initial usage. (3 mentions)

Users find the complex features of Optimizely challenging, particularly with navigation and understanding significance computation. (2 mentions)

Users find usage complexity and cost to be issues, particularly with setting up multiple experiments effectively. (1 mentions)

Top Pros or Advantages of Optimizely Feature Experimentation

1. Ease of Use

Users find Optimizely Feature Experimentation to have great ease of use once familiar with its interface and terminology.

See 12 mentions

See Related User Reviews

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you like about Optimizely Feature Experimentation?

Optimizely is relevatively easy once set up to be able to rollout features, as well as perform experiments in a number of ways including multi-variant

Verified User

Mid-Market (51-1000 emp.)

5.0/5

"Expensive, but very intuitive and stable A/B testing tool"

What do you like about Optimizely Feature Experimentation?

What I like most about Optimizely’s feature experimentation is how easy it is to run all kinds of experiments and simultaneously integrate it in our b

2. A/B Testing

Users find A/B testing easy and effective with Optimizely, enabling seamless feature rollouts and diverse experiments.

See 11 mentions

See Related User Reviews

Mayank P.

Enterprise (> 1000 emp.)

4.5/5

"Optimizely Feature Flag Review"

What do you like about Optimizely Feature Experimentation?

Optimizely feature flag provides a best solution for experimentation in your project(app/web/backend) Through Optimizely you control the rollout of y

Verified User

Enterprise (> 1000 emp.)

5.0/5

"Fairly simple feature flagging"

What do you like about Optimizely Feature Experimentation?

Once you get the hang of the terminology and interface, it is fairly simple to manage feature flags and audiences for feature experimenting.

3. Experimentation

Users value the flexibility of personalized UX in Optimizely Feature Experimentation, enhancing targeting and customer insights.

See 11 mentions

See Related User Reviews

Mayank P.

Enterprise (> 1000 emp.)

4.5/5

"Optimizely Feature Flag Review"

What do you like about Optimizely Feature Experimentation?

Optimizely feature flag provides a best solution for experimentation in your project(app/web/backend) Through Optimizely you control the rollout of y

Verified User

Enterprise (> 1000 emp.)

5.0/5

"Fairly simple feature flagging"

What do you like about Optimizely Feature Experimentation?

Once you get the hang of the terminology and interface, it is fairly simple to manage feature flags and audiences for feature experimenting.

4. Features

Users value the flexible and granular UX personalization capabilities of Optimizely Feature Experimentation for effective targeting.

See 10 mentions

See Related User Reviews

Mayank P.

Enterprise (> 1000 emp.)

4.5/5

"Optimizely Feature Flag Review"

What do you like about Optimizely Feature Experimentation?

Optimizely feature flag provides a best solution for experimentation in your project(app/web/backend) Through Optimizely you control the rollout of y

Verified User

Enterprise (> 1000 emp.)

5.0/5

"Fairly simple feature flagging"

What do you like about Optimizely Feature Experimentation?

Once you get the hang of the terminology and interface, it is fairly simple to manage feature flags and audiences for feature experimenting.

5. Implementation Ease

Users find it relatively easy to implement Optimizely Feature Experimentation, enhancing their ability to conduct experiments effectively.

See 8 mentions

See Related User Reviews

Verified User

Enterprise (> 1000 emp.)

4.0/5

"Great Tool with Room for Improvement"

What do you like about Optimizely Feature Experimentation?

Optimizely Feature Experimentation is a well-balanced platform that caters to both business and developer needs. The developer documentation is highly

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you like about Optimizely Feature Experimentation?

Optimizely is relevatively easy once set up to be able to rollout features, as well as perform experiments in a number of ways including multi-variant

6. Feature Flags

Users value the ease of managing feature flags for testing and activating new features effectively within Optimizely.

See 5 mentions

See Related User Reviews

Mayank P.

Enterprise (> 1000 emp.)

4.5/5

"Optimizely Feature Flag Review"

What do you like about Optimizely Feature Experimentation?

Optimizely feature flag provides a best solution for experimentation in your project(app/web/backend) Through Optimizely you control the rollout of y

Verified User

Enterprise (> 1000 emp.)

5.0/5

"Fairly simple feature flagging"

What do you like about Optimizely Feature Experimentation?

Once you get the hang of the terminology and interface, it is fairly simple to manage feature flags and audiences for feature experimenting.

Top Cons or Disadvantages of Optimizely Feature Experimentation

1. Difficulty of Use

Users find the difficulty of use in Optimizely, particularly with complex experiments and initial setup, quite challenging.

See 5 mentions

See Related User Reviews

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you dislike about Optimizely Feature Experimentation?

I do believe the drill down and analysis capabilities could be better, as well as making it easier to handle complex experiments that includes differe

Verified User

Mid-Market (51-1000 emp.)

4.0/5

"A powerful toll that can help a lot"

What do you dislike about Optimizely Feature Experimentation?

Bucketing, this software offers bucketing when you want to run A/B tests however combining it with additional audience that you want to enable/disable

2. Learning Curve

Users find the learning curve steep, making initial registration and feature experimentation challenging for beginners.

See 5 mentions

See Related User Reviews

Verified User

Small-Business (50 or fewer emp.)

4.5/5

"A great product"

What do you dislike about Optimizely Feature Experimentation?

It's a little too expensive for a solopreneur such as myself. It's also a little too technical for me.

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you dislike about Optimizely Feature Experimentation?

I do believe the drill down and analysis capabilities could be better, as well as making it easier to handle complex experiments that includes differe

3. Complexity

Users find the complexity of Optimizely Feature Experimentation challenging, especially during onboarding and integration with legacy systems.

See 4 mentions

See Related User Reviews

Verified User

Small-Business (50 or fewer emp.)

4.5/5

"A great product"

What do you dislike about Optimizely Feature Experimentation?

It's a little too expensive for a solopreneur such as myself. It's also a little too technical for me.

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you dislike about Optimizely Feature Experimentation?

I do believe the drill down and analysis capabilities could be better, as well as making it easier to handle complex experiments that includes differe

4. Expensive

Users find Optimizely Feature Experimentation too expensive, especially for solopreneurs and tight budgets.

See 4 mentions

See Related User Reviews

Verified User

Small-Business (50 or fewer emp.)

4.5/5

"A great product"

What do you dislike about Optimizely Feature Experimentation?

It's a little too expensive for a solopreneur such as myself. It's also a little too technical for me.

Verified User

Mid-Market (51-1000 emp.)

5.0/5

"Expensive, but very intuitive and stable A/B testing tool"

What do you dislike about Optimizely Feature Experimentation?

Not that much apart from the fact that (in all honesty) in pricey

5. Feature Flags Issues

Users struggle with feature flag management issues, desiring better tools and navigation for effective usage.

See 3 mentions

See Related User Reviews

Verified User

Enterprise (> 1000 emp.)

4.0/5

"Great Tool with Room for Improvement"

What do you dislike about Optimizely Feature Experimentation?

While Optimizely is a great tool, it lacks some essential management features. I’d love to see better tools for flag management, such as an overview o

Edward P.

Mid-Market (51-1000 emp.)

4.5/5

"Feature Experimentation empowers teams to experiment with a hyper focus and data-driven decisions"

What do you dislike about Optimizely Feature Experimentation?

I would love to be able to apply multiple feature flags at once as a condition - for example, only apply to audience at 5% if they also have this addi

6. Steep Learning Curve

Users find the steep learning curve of Optimizely Feature Experimentation challenging for newcomers, hindering initial usage.

See 3 mentions

See Related User Reviews

Verified User

Small-Business (50 or fewer emp.)

4.5/5

"A great product"

What do you dislike about Optimizely Feature Experimentation?

It's a little too expensive for a solopreneur such as myself. It's also a little too technical for me.

Matheus S.

Mid-Market (51-1000 emp.)

5.0/5

"Very good to control roles and permission"

What do you dislike about Optimizely Feature Experimentation?

At the first time, we found a little hard to understand how to register and enable the feature experimentation in our product. But past that, we didn'

7. Complex Features

Users find the complex features of Optimizely challenging, particularly with navigation and understanding significance computation.

See 2 mentions

See Related User Reviews

Edward P.

Mid-Market (51-1000 emp.)

4.5/5

"Feature Experimentation empowers teams to experiment with a hyper focus and data-driven decisions"

What do you dislike about Optimizely Feature Experimentation?

I would love to be able to apply multiple feature flags at once as a condition - for example, only apply to audience at 5% if they also have this addi

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you dislike about Optimizely Feature Experimentation?

I do believe the drill down and analysis capabilities could be better, as well as making it easier to handle complex experiments that includes differe

8. Limitations

Users find usage complexity and cost to be issues, particularly with setting up multiple experiments effectively.

See 1 mentions

See Related User Reviews

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you dislike about Optimizely Feature Experimentation?

I do believe the drill down and analysis capabilities could be better, as well as making it easier to handle complex experiments that includes differe

Top-Rated Alternatives

View All Alternatives

Optimizely Feature Experimentation Reviews (116)

G2 reviews are authentic and verified.

Here's how.

William H.

Software Engineer

Mid-Market (51-1000 emp.)

8/12/2021

"Love the analytics"

4/5

What do you like best about Optimizely Feature Experimentation?

I really enjoyed my experience as it provided very in-depth analytics on my feature and the respective environments. In this way, I was able to make inferences from the traffic and relay important information to my team Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

I did think that the time for changes to propagate in the envs was a bit longer than I liked Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi William,

Thanks for your review! We highly value your feedback and are happy to hear that you're enjoying your experience with Full Stack. If you're ever experiencing any issues with the platform or have any questions please contact your customer success manager or message at revies@optimizely.com.

Verified User in Automotive

Mid-Market (51-1000 emp.)

8/10/2021

"Making A/B testing and feature rollouts extremely convenient"

5/5

What do you like best about Optimizely Feature Experimentation?

It's straightforward to do feature tests and A/B tests. There is excellent documentation for developers, and the results page is detailed and valuable. The history page makes it easy to track changes to experiments. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

The website can sometimes be slow to load. It might be clearer to include "Variations" and "Traffic Allocation" so it's easier to understand how much traffic is going precisely to each variation. Review collected by and hosted on G2.com.

Recommendations to others considering Optimizely Feature Experimentation:

Make sure you understand the statistics and fundamentals of A/B testing before using Optimizely, or else it may be difficult to understand how the tools work. Review collected by and hosted on G2.com.

What problems is Optimizely Feature Experimentation solving and how is that benefiting you?

We can determine whether a new feature is safe to roll out without affecting baseline conversion performance. Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi There,

Thanks for leaving us a review! We are happy you are finding success with Full Stack. If you ever have any questions or concerns please reach out to your customer success manager or contact us at reviews@optimizely.com.

Verified User in Business Supplies and Equipment

Enterprise (> 1000 emp.)

8/11/2021

"Easy-to-use software that integrates well with contentful"

4/5

What do you like best about Optimizely Feature Experimentation?

I always use Optimizely full-stack for my AB tests on contentful. It integrates well and setting up an experiment doesn't take much time. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

AB test results overview could be better visually with more customization options. It's not as intuitive as it could be for people who are not used to it. Review collected by and hosted on G2.com.

Recommendations to others considering Optimizely Feature Experimentation:

Make sure to spend time understanding the software, there is a learning curve. Review collected by and hosted on G2.com.

What problems is Optimizely Feature Experimentation solving and how is that benefiting you?

We want to be able to launch and analyze A/B tests on a regular basis on our website. Using Optimizely we do not need the help of developers. We are more agile, and we therefore gain time. Independence is important. Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi,

Thanks for your review! We highly value your feedback as it is key in improving user experience. If you ever have questions or would like to speak further about your concerns surrounding the product, please reach out to your customer success manager or message us at reviews@optimizely.com.

Verified User in Information Technology and Services

Mid-Market (51-1000 emp.)

8/10/2021

"Simple, easy to use and great UI"

5/5

What do you like best about Optimizely Feature Experimentation?

I use the flag feature a lot as a QA. I like how simple the UI is to use e.g., to know which environments have which flags on which is super helpful to see at a glance and make comparisons in our products to ensure certain features are working correctly. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

I dislike that we only use some features in my workplace, so I'm not utilizing the full tool! Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi,

Thanks for your response! It's important to us that you get the most out of our product and your customer success manager is always available to provide you with some guidance. You can also message us at reviews@optimizely.com so we can connect you with the right people.

Verified User in Retail

Mid-Market (51-1000 emp.)

8/10/2021

"Optimizely Full Stack helps us roll out experiments quickly with minimal friction"

4/5

What do you like best about Optimizely Feature Experimentation?

Optimizely Full Stack has an intuitive UI, and it's easy to set up and test experiments. Forcing variants is easy, and it's simple to control traffic.

Experiment code is created for many programming languages, so a simple copy/paste will be enough to get your experiment up and running. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

I occasionally receive notifications that we've reached our traffic quota, but it would be helpful if these were broken down by experiment. I find it challenging to track down which experiments are causing us to exceed our quota. Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi There,

We are happy to hear that you are successfully experimenting with Full Stack. Your customer success manager is always available to answer any of your questions or you can message us at reviews@optimizely.com and we will connect you with the right people.

Thanks!

Verified User in Commercial Real Estate

Enterprise (> 1000 emp.)

8/11/2021

"good for online ab test"

4/5

What do you like best about Optimizely Feature Experimentation?

easy to use SDK, slack community, stat engine is good on average, sticky user profile to keep treatment the same.not a lot to like Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

bad customer support, not flexible pricing strategy, not good for offline event, no product analytics support, not sure how multiple comparison is adjusted when you have more than 2 variant, snowflake data doesn't match result UI number and couldn't get tech support to debug. not sure what's the consequences of using different randomization id Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi There,

Thank you for leaving us a review. We're sorry to hear that you've been experiencing issues with Full Stack, as quality user experience is very important to us. Please reach out to your customer success manager or message us reviews@optimizely.com so we can find the solutions that are right for you.

Verified User in Computer Software

Small-Business (50 or fewer emp.)

8/23/2021

"I'm using Optimizely Full Stack as our tool for quickly setting &analyzing A/B testing in our webapp"

4.5/5

What do you like best about Optimizely Feature Experimentation?

The ability to remotely control experiments and changing them from experiments to running features easily (so that also product managers can use them). Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

The lack of support for exclusion groups with setting forced variations (we currently use our own "hack" for it, but I wish this was an out of the box solution). Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi There,

We're so happy that Full Stack is providing you with effective business solutions. If you ever have any feedback, please feel free to share it with your customer success manager or message us at reviews@optimizely.com so we can continue on improving user experience.

Thanks!

Verified User in Internet

Mid-Market (51-1000 emp.)

8/18/2021

"Optimizely is enabling the Growth Engineering team to run more web experiments"

4.5/5

What do you like best about Optimizely Feature Experimentation?

The level of granularity and flexibility to bucket visitors into experiments is beneficial. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

There's no notification or email to the owner of the experiment (or "watchers") to get notified when the experiment reached 100% stat sig. Review collected by and hosted on G2.com.

What problems is Optimizely Feature Experimentation solving and how is that benefiting you?

Before using Optimizely, we were using a homegrown solution that presented some limitations and challenges:

- Running multiple experiments at the same time was challenging due to data pollution;

- Limitations to creating audiences for the experiment;

- Time required to setup the experiments and future analysis was impacting the learning velocity; Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi There,

Thank you so much for review! We love to hear customer feedback, because it helps us continuously improve user experience. It would be great if you could share your insights or any questions with your customer success manager or message us at reviews@optimizely.com.

Ronne V.

Frontend Developer

Mid-Market (51-1000 emp.)

8/11/2021

"Unlimited A/B testing freedom"

5/5

What do you like best about Optimizely Feature Experimentation?

The React SDK of Optimizely Full Stack comes with easy-to-use hooks which we use to run experiments on both the server and client side. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

There are no downsides known to me at this point. Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi Ronne,

We are glad to hear that you're finding success with our Full Stack product. If any questions or concerns ever arise in the future, please don't hesitate to contact your customer success manager or message us at reviews@optimizely.com.

Thanks!

Verified User in Health, Wellness and Fitness

Mid-Market (51-1000 emp.)

8/10/2021

"Solid option for experimentation, feature flags, and A/B testing"

4.5/5

What do you like best about Optimizely Feature Experimentation?

As a developer, I found their documentation to be comprehensive, straightforward, and up-to-date. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

There was one small detail that was missing from the developer documentation where it never says that event logs are temporarily stored in local storage in case the request to submit errors in the case of a time-out or page refresh. Review collected by and hosted on G2.com.

Recommendations to others considering Optimizely Feature Experimentation:

Optimizely is a great choice for implementing A/B testing, feature experimentation and/or flags. Review collected by and hosted on G2.com.

What problems is Optimizely Feature Experimentation solving and how is that benefiting you?

We are working on A/B testing with regards to enabling/disabling certain features or making slight text or style changes. Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi,

Thank you so much for your feedback! We are happy to hear that you're having success with Full Stack. Please reach out to your customer success manager or message us at reviews@optimizely.com with any questions or recommendations so we can improve your user experience.