Optimizely Feature Experimentation Pros and Cons

Optimizely Feature Experimentation Pros and Cons: Top Advantages and Disadvantages

Quick AI Summary Based on G2 Reviews

Generated from real user reviews

Users find the ease of use of Optimizely's feature experimentation makes managing experiments straightforward and efficient. (12 mentions)

Users appreciate the ease of use and clarity in tracking metrics with Optimizely Feature Experimentation, enhancing their testing experience. (11 mentions)

Users appreciate the clarity and ease of use in managing feature experimentation, achieving conclusive results effortlessly. (11 mentions)

Users appreciate the clarity in tracking metrics and the ability to achieve statistical significance with ease. (10 mentions)

Users find the implementation ease of Optimizely Feature Experimentation beneficial, simplifying the setup and management of experiments. (8 mentions)

Users value the ease of managing feature flags for testing and activating new features effectively within Optimizely. (5 mentions)

Users find the implementation process difficult, making it challenging to effectively use the feature experimentation tools. (5 mentions)

Users find the learning curve steep, especially with technical aspects and lack of tutorials for new features. (5 mentions)

Users find the complexity of Optimizely's platform challenging, especially during onboarding and integration with legacy systems. (4 mentions)

Users find Optimizely Feature Experimentation to be too expensive, especially for solopreneurs and small budgets. (4 mentions)

Users face feature flag management issues due to a lack of essential tools and difficult navigation in Optimizely. (3 mentions)

Users find the steep learning curve of Optimizely Feature Experimentation challenging for newcomers, hindering initial usage. (3 mentions)

Users find the complex features of Optimizely challenging, particularly with navigation and understanding significance computation. (2 mentions)

Users find usage complexity and cost to be issues, particularly with setting up multiple experiments effectively. (1 mentions)

Top Pros or Advantages of Optimizely Feature Experimentation

1. Ease of Use

Users find the ease of use of Optimizely's feature experimentation makes managing experiments straightforward and efficient.

See 12 mentions

See Related User Reviews

Verified User

Enterprise (> 1000 emp.)

5.0/5

"Fairly simple feature flagging"

What do you like about Optimizely Feature Experimentation?

Once you get the hang of the terminology and interface, it is fairly simple to manage feature flags and audiences for feature experimenting.

Matheus S.

Mid-Market (51-1000 emp.)

5.0/5

"Very good to control roles and permission"

What do you like about Optimizely Feature Experimentation?

I am using optimizely to control which roles on my SaaS can see each feature. Its very easy to control experimentation and feature flag. Its very simp

2. A/B Testing

Users appreciate the ease of use and clarity in tracking metrics with Optimizely Feature Experimentation, enhancing their testing experience.

See 11 mentions

See Related User Reviews

Verified User

Mid-Market (51-1000 emp.)

4.0/5

"Early days but starting to make data-backed decisions via experimentation"

What do you like about Optimizely Feature Experimentation?

I like the clarity of tracking different metrics, the tools to explain/achieve statistical significance, and the potential to connect to our data ware

Giovanni L.

Mid-Market (51-1000 emp.)

4.0/5

"Easy to use, complicated to implement"

What do you like about Optimizely Feature Experimentation?

It is quite easy to use once it is implemented, and above all the multiple options without having to modify much of the implemented code, being able t

3. Experimentation

Users appreciate the clarity and ease of use in managing feature experimentation, achieving conclusive results effortlessly.

See 11 mentions

See Related User Reviews

Verified User

Mid-Market (51-1000 emp.)

4.0/5

"Early days but starting to make data-backed decisions via experimentation"

What do you like about Optimizely Feature Experimentation?

I like the clarity of tracking different metrics, the tools to explain/achieve statistical significance, and the potential to connect to our data ware

Verified User

Enterprise (> 1000 emp.)

5.0/5

"Fairly simple feature flagging"

What do you like about Optimizely Feature Experimentation?

Once you get the hang of the terminology and interface, it is fairly simple to manage feature flags and audiences for feature experimenting.

4. Features

Users appreciate the clarity in tracking metrics and the ability to achieve statistical significance with ease.

See 10 mentions

See Related User Reviews

Verified User

Mid-Market (51-1000 emp.)

4.0/5

"A powerful toll that can help a lot"

What do you like about Optimizely Feature Experimentation?

The most helpful ones are easy audience setup, feature enablement and setup

Verified User

Mid-Market (51-1000 emp.)

4.0/5

"Early days but starting to make data-backed decisions via experimentation"

What do you like about Optimizely Feature Experimentation?

I like the clarity of tracking different metrics, the tools to explain/achieve statistical significance, and the potential to connect to our data ware

5. Implementation Ease

Users find the implementation ease of Optimizely Feature Experimentation beneficial, simplifying the setup and management of experiments.

See 8 mentions

See Related User Reviews

Verified User

Mid-Market (51-1000 emp.)

4.0/5

"Early days but starting to make data-backed decisions via experimentation"

What do you like about Optimizely Feature Experimentation?

I like the clarity of tracking different metrics, the tools to explain/achieve statistical significance, and the potential to connect to our data ware

Giovanni L.

Mid-Market (51-1000 emp.)

4.0/5

"Easy to use, complicated to implement"

What do you like about Optimizely Feature Experimentation?

It is quite easy to use once it is implemented, and above all the multiple options without having to modify much of the implemented code, being able t

6. Feature Flags

Users value the ease of managing feature flags for testing and activating new features effectively within Optimizely.

See 5 mentions

See Related User Reviews

Chniber B.

Small-Business (50 or fewer emp.)

4.5/5

"Newly in feature experimentation but excited toward the future"

What do you like about Optimizely Feature Experimentation?

Being able to test and activate fully the feature in live via backends and apps

Verified User

Enterprise (> 1000 emp.)

5.0/5

"Fairly simple feature flagging"

What do you like about Optimizely Feature Experimentation?

Once you get the hang of the terminology and interface, it is fairly simple to manage feature flags and audiences for feature experimenting.

Top Cons or Disadvantages of Optimizely Feature Experimentation

1. Difficulty of Use

Users find the implementation process difficult, making it challenging to effectively use the feature experimentation tools.

See 5 mentions

See Related User Reviews

Verified User

Mid-Market (51-1000 emp.)

4.0/5

"A powerful toll that can help a lot"

What do you dislike about Optimizely Feature Experimentation?

Bucketing, this software offers bucketing when you want to run A/B tests however combining it with additional audience that you want to enable/disable

Giovanni L.

Mid-Market (51-1000 emp.)

4.0/5

"Easy to use, complicated to implement"

What do you dislike about Optimizely Feature Experimentation?

The only thing I didn't like was the implementation, it's true that the team was helping us a lot, but it took us a long time to implement it, first o

2. Learning Curve

Users find the learning curve steep, especially with technical aspects and lack of tutorials for new features.

See 5 mentions

See Related User Reviews

Verified User

Small-Business (50 or fewer emp.)

4.5/5

"A great product"

What do you dislike about Optimizely Feature Experimentation?

It's a little too expensive for a solopreneur such as myself. It's also a little too technical for me.

Matheus S.

Mid-Market (51-1000 emp.)

5.0/5

"Very good to control roles and permission"

What do you dislike about Optimizely Feature Experimentation?

At the first time, we found a little hard to understand how to register and enable the feature experimentation in our product. But past that, we didn'

3. Complexity

Users find the complexity of Optimizely's platform challenging, especially during onboarding and integration with legacy systems.

See 4 mentions

See Related User Reviews

Jasper C.

Small-Business (50 or fewer emp.)

5.0/5

"Optimizely for A/B testing of our web sites"

What do you dislike about Optimizely Feature Experimentation?

The only thing I came to hate is the overload and how difficult it is to navigate.

Verified User

Small-Business (50 or fewer emp.)

4.5/5

"A great product"

What do you dislike about Optimizely Feature Experimentation?

It's a little too expensive for a solopreneur such as myself. It's also a little too technical for me.

4. Expensive

Users find Optimizely Feature Experimentation to be too expensive, especially for solopreneurs and small budgets.

See 4 mentions

See Related User Reviews

Verified User

Small-Business (50 or fewer emp.)

4.5/5

"A great product"

What do you dislike about Optimizely Feature Experimentation?

It's a little too expensive for a solopreneur such as myself. It's also a little too technical for me.

Mayank P.

Enterprise (> 1000 emp.)

4.5/5

"Optimizely Feature Flag Review"

What do you dislike about Optimizely Feature Experimentation?

Found the product to be but on a expensive side compared to other similar software available.

5. Feature Flags Issues

Users face feature flag management issues due to a lack of essential tools and difficult navigation in Optimizely.

See 3 mentions

See Related User Reviews

Edward P.

Mid-Market (51-1000 emp.)

4.5/5

"Feature Experimentation empowers teams to experiment with a hyper focus and data-driven decisions"

What do you dislike about Optimizely Feature Experimentation?

I would love to be able to apply multiple feature flags at once as a condition - for example, only apply to audience at 5% if they also have this addi

Verified User

Enterprise (> 1000 emp.)

4.0/5

"Great Tool with Room for Improvement"

What do you dislike about Optimizely Feature Experimentation?

While Optimizely is a great tool, it lacks some essential management features. I’d love to see better tools for flag management, such as an overview o

6. Steep Learning Curve

Users find the steep learning curve of Optimizely Feature Experimentation challenging for newcomers, hindering initial usage.

See 3 mentions

See Related User Reviews

Giovanni L.

Mid-Market (51-1000 emp.)

4.0/5

"Easy to use, complicated to implement"

What do you dislike about Optimizely Feature Experimentation?

The only thing I didn't like was the implementation, it's true that the team was helping us a lot, but it took us a long time to implement it, first o

Verified User

Small-Business (50 or fewer emp.)

4.5/5

"A great product"

What do you dislike about Optimizely Feature Experimentation?

It's a little too expensive for a solopreneur such as myself. It's also a little too technical for me.

7. Complex Features

Users find the complex features of Optimizely challenging, particularly with navigation and understanding significance computation.

See 2 mentions

See Related User Reviews

Edward P.

Mid-Market (51-1000 emp.)

4.5/5

"Feature Experimentation empowers teams to experiment with a hyper focus and data-driven decisions"

What do you dislike about Optimizely Feature Experimentation?

I would love to be able to apply multiple feature flags at once as a condition - for example, only apply to audience at 5% if they also have this addi

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you dislike about Optimizely Feature Experimentation?

I do believe the drill down and analysis capabilities could be better, as well as making it easier to handle complex experiments that includes differe

8. Limitations

Users find usage complexity and cost to be issues, particularly with setting up multiple experiments effectively.

See 1 mentions

See Related User Reviews

Verified User

Enterprise (> 1000 emp.)

4.0/5

"A Powerful tool for Feature flag management and Experimentation"

What do you dislike about Optimizely Feature Experimentation?

I do believe the drill down and analysis capabilities could be better, as well as making it easier to handle complex experiments that includes differe

Top-Rated Alternatives

View All Alternatives

G2 reviews are authentic and verified.

Here's how.

Verified User in Computer Software

Mid-Market (51-1000 emp.)

8/12/2021

"Reliable, easy-to-use experimentation platform"

4.5/5

What do you like best about Optimizely Feature Experimentation?

Optimizely FS empowers our team to:

1. Wrap features into flags and spin-off n-number of experiments

2. Accurately report on experiments

3. Create unique targeting/audience attributes based on our business segments Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

Optimizely FS has a tendency to have outages that limit our ability to view up-to-date experiment results and reports. Review collected by and hosted on G2.com.

Adam H.

Head of Digital

Enterprise (> 1000 emp.)

8/12/2021

"Full stack enables deeper experiences to be delivered easily"

5/5

What do you like best about Optimizely Feature Experimentation?

How well it integrates into our development practices Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

It took some time to get our development teams onboard and comfortable that it wasn't a significant overhead Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi Adam,

Thanks so much for leaving us a review! We're happy to hear that you're finding success with Full Stack. If you ever have any feedback or questions, please don't hesitate to contact your customer success manager or message us at reviews@optimizely.conm.

Jarel F.

Software Engineer

Small-Business (50 or fewer emp.)

8/12/2021

"Does the Job"

4.5/5

What do you like best about Optimizely Feature Experimentation?

I like how simple and easy it is to implement the feature flags with the SDK. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

It's not clear how to use the audience feature. Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi Jarel,

Thanks for leaving us a review! We're happy to hear that you're having success with Full Stack. Please reach out to your customer success manager or contact us at reviews@optimizely.com so we can assist you with any questions you have surrounding the audience feature.

Verified User in Real Estate

Mid-Market (51-1000 emp.)

8/10/2021

"Used Optimizely Full Stack for more than 3 years"

5/5

What do you like best about Optimizely Feature Experimentation?

- It helps to build A/B testing much more straightforward.

- Helps to reduce developers' time to write their custom A/B tests.

- You can see the performance of tests; how they are doing. Better analytics.

- Helps to foster business decisions. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

- I don't have anything that I dislike as of now. Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi There,

We love to hear that our product is working well for you and your business. If any questions or issues ever do arise, please don't hesitate to reach out to your customer success manager or reviews@optimizely.com.

Thank you!

Verified User in Internet

Mid-Market (51-1000 emp.)

8/11/2021

"Use to set up A/B test"

4.5/5

What do you like best about Optimizely Feature Experimentation?

Help product engineers to install experiments easily. My previous company set up tests without Optimizely and I found my current companies use this platform a lot Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

I hope we can more easily get the experiment data from Optimizely to our internal database.

It would be helpful if we can also set up an exclusion group and experiment group in Optimizely.

My current version does not come with analytical tools Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi,

Thank you for your review! We highly value customer insight when improving our products. If you ever have any questions or feedback please contact your customer success manager or message us at reviews@optimizely.com and we'll connect you with the right people.

Verified User in Insurance

Mid-Market (51-1000 emp.)

8/11/2021

"Such an advanced tool"

5/5

What do you like best about Optimizely Feature Experimentation?

You can run much more complicated and detailed tests - so not just changing visual elements like images and copy, but also testing functional elements on your website. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

The need for advanced developers is much greater on Full Stack than it is on the Web version, so as a marketing department we struggle to implement a test on our own Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi There,

Thanks you leaving us a review! We really appreciate hearing your feedback about our Full Stack product. If you are ever in need of support or have any concerns, please contact your customer success manager or contact us at reviews@optimizely.com.

Verified User in Real Estate

Mid-Market (51-1000 emp.)

8/10/2021

"Fully featured, great statistical analysis"

4.5/5

What do you like best about Optimizely Feature Experimentation?

Optimizely has an easy to use SDK that allows all types clients to configure exactly how they want to experiment with their product. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

There could be more documentation regarding experimentation on native apps that requires bucketing on start up or in app. Figuring out how to bundle the data json file into the app and the trade-offs associated was not well documented anywhere. Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi,

Thank you for providing us with this valuable response! We are glad to hear that our product is benefitting your business. If you ever have any questions or feedback please don't hesitate to contact your customer success manager or message us at reviews@optimizely.com.

Mauro M.

Product Design Manager

Small-Business (50 or fewer emp.)

8/13/2021

"Solid choice"

4/5

What do you like best about Optimizely Feature Experimentation?

With the feature flag it's easy to roll out and easy to rollback. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

No personalization available for the full stack Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi Mauro,

Thanks for leaving us a review! Please reach out to your customer success manager or message us at reviews@optimizely.com so we can find the solution that's right for you.

Verified User in Financial Services

Enterprise (> 1000 emp.)

8/26/2021

"Easy to manage and very flexible solution!"

5/5

What do you like best about Optimizely Feature Experimentation?

I used it as a feature flag config and allowed me to enroll new functionality on production gradually. Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

Maybe the UI is not that intuative in the begining Review collected by and hosted on G2.com.

Recommendations to others considering Optimizely Feature Experimentation:

Easy to use, flexible, allows to experiment Review collected by and hosted on G2.com.

What problems is Optimizely Feature Experimentation solving and how is that benefiting you?

- It helped me have a slow and targeted release instead of a "big bang" one

- No need to build a new config for every new feature Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi,

We're so happy that you're finding success with Full Stack! If you ever have any questions or feedback please contact your customer success manager or message us at reviews@optimizely.com and we'll connect you with right people.

Thank you.

Verified User in Public Relations and Communications

Mid-Market (51-1000 emp.)

8/17/2021

"Interesting tool but not for our use case"

3/5

What do you like best about Optimizely Feature Experimentation?

- pretty good API and interesting way of connecting UI with local API

- good for running experiments

- nice UI Review collected by and hosted on G2.com.

What do you dislike about Optimizely Feature Experimentation?

- lacking of more granular permission (we wanted to assign permission per individual flag or groups or flags)

- limited way of adding meta-data to flags

- not performing well if lot of data inserted into the tool

- not possible to auto-provision new users

- we wanted more customization around flag values (wanted to use some custom values per tenants in our SaaS product) Review collected by and hosted on G2.com.

Response from Emma Davis of Optimizely Feature Experimentation

edit

Hi There,

Thank you for taking the time to leave us a review. This kind of feedback helps us in continuously improving user experience. Please don't hesitate to discuss these matters with your customer success manager or message us at reviews@optimizely.com and we will connect you with the right people.

Thanks!