The upsides are that you can easily put experiments live. I do not have CRO experience and putting these experiments live was very straightforward. The tracking of results and the statistical significance is also very clear. We like how we can also test into different pages on site not just as a whole which a different competitor we used to use did which limited us Review collected by and hosted on G2.com.

One thing I’ve found is that I can’t check revenue per visitor in the dashboard only revenue per session which limits our reporting and need to go to GA for this. Review collected by and hosted on G2.com.

- Ease of use

- Strong enablement for wide variety of practicioners specifically via the Visual Editor

- Fantastic response time from support

- Supersped our CRO program

- Easy onboarding across wide range of projects from an implementation POV

- Easy to verify and read metrics to present to range of stakeholders. Enables decisioning process from a much speedier POV Review collected by and hosted on G2.com.

- Some challenges with cross-domain tracking of EndUserId but that's quite a specific use case and isn't representative of overall ease of implementation Review collected by and hosted on G2.com.

There are a wide range of tests that I can run using the platform: A/B, A/B/n, multivariate, multi-arm bandit and 'stats accelerators'.

The trigger options allow me to quite easily target discreet customer segments by device type, or browser type, or by another specific behaviour. I've also done tests using custom JavaScript to suppress tests for more sensitive customer segments.

I like the reporting dashboard, which is good for conducting dip checks on how specific tests are performing across different browser and device types - and for seeing how a test is performing over time.

I also like the fact I can set a test to roll out to 5% of traffic, conduct a few post-live checks and then quickly duplicate the test and roll it out to 100% of eligible traffic.

Customer support tickets are via email and I usually receive a response within a few hours, which is good. Review collected by and hosted on G2.com.

The visual page building tool is quite basic and could do with a refresh. It means that you more or less have to know HTML and CSS to build your own simple tests, and JavaScript for anything more complicated.

Many CRO practitioners will use Bayesian probability alongside Frequentist statistics if traffic volumes are smaller for specific tests. The reporting dashboard defaults to statistical significance - so Bayesian needs inclusion. Review collected by and hosted on G2.com.

There are plenty of configuration options, which helps ensure we're running experiments under the right circumstances, or for the correct user groups. Review collected by and hosted on G2.com.

It was difficult to implement, and it's rather sensitive to different technical environments. This won't be immediately apparent. It could result in extended deployment times and many calls with various Optimizely teams. Review collected by and hosted on G2.com.

Optimizely keeps growing and maturing the feature functionality. Integrations with my backend, code snipits to go in GTM and willingless to leave behind a plan for people to follow inside the org is helpful. Review collected by and hosted on G2.com.

The hardest part is going cold pre testing and personalization into a culture where folks self serve. That is the stage my organization is at right now and while I am confident there is support to help us get there, the challenge to explain the value of testing remains. Review collected by and hosted on G2.com.

Optimizely provides a lot of options for creating AB tests. Implementation with relatively easy. Review collected by and hosted on G2.com.

I would like more templates so we could do less coding, as a marketer and note a coder it makes for more difficult tests to have to go to development to get done which takes longer. Review collected by and hosted on G2.com.

I like that the user interface is easy to use and it's relatively easy to set up and experiment depending on the experiment type. Review collected by and hosted on G2.com.

The setup experience was really poor. Optimizely doesn't offer support in setting up their platform and instead recommends 3rd party agencies to do this.

We paid a small fortune to an agency only to later learn that the implementation was not done correctly. This cost us countless hours of troubleshooting and support calls, a huge cost that could have been avoided if Optimizely had supported the integration of their own software. Review collected by and hosted on G2.com.

I most appreciate the interface of the results within Web Experimentation. As someone that has been working in experimentation for 4+ years, I find the interface extremely easy to use, but more importantly ease to teach to colleagues that are completely new to experimentation.

The key concepts of experimentation (statistical significance, confidence intervals, impact) are well laid out and visually easy to comprehend. It makes normally difficult concepts easy to understand and interact with. Review collected by and hosted on G2.com.

While I appreciate the in-program editor where you can build metrics inside the application, I find it does not load well within the web version and requires popping out the window more often than not. Review collected by and hosted on G2.com.

Incredibly easy to plan, rollout, and track tests. And much faster and cheaper than running it though your dedicated dev team. The onboarding team was very knowledgeable and flexible. Great partner to have on your side. Review collected by and hosted on G2.com.

There's a bit of learning curve, but not too difficult. Overall, worth the effort. Review collected by and hosted on G2.com.

Optimizely stands out when it comes to meeting regional and industry specific regulatory requirements while maintaining all functions that make an extraordinary experimentation tool. Review collected by and hosted on G2.com.

Tests that are insignificant are always challenging to deal with. The root cause however is not Optimizely. Review collected by and hosted on G2.com.