It's been two months since this profile received a new review

Vince V.

UX Designer

Mid-Market (51-1000 emp.)

8/17/2022

"Excellent tool for getting valuable insights"

5/5

What do you like best about ABsmartly?

A/B Smartly is easy to configure;

It has a great dashboard that offers valuable insights at a glance. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

Not a dislike, but it would be nice if the platform offered even more articles/training. Review collected by and hosted on G2.com.

ABsmartly Reviews & Product Details

Unlimited seats, metrics and experiments so you A/B test confidently and scale experimentation. ABsmartly is a leading experimentation platform designed for trustworthy A/B testing on web,email, app environments and more, both server-side, edge and client-side. The platform caters to various testing scenarios, including feature flags, split testing, multi-variant, multi-page, multi-platform, SEO tests, cross-device testing, among others to accelerate product growth. The ABsmartly platform is designed for product teams and experimentation teams outgrowing more mainstream tools and want the features, seats and real-time insights to scale experimentation and build better products. They might be considering building their own tool but don’t want the hassle, cost and maintenance of an in-house tool. Only GST engine on the market: Our Group Sequential Testing engine runs A/B tests 80% faster than any other A/B testing tool on the market. We also offer Fixed Horizon testing for those situations. Unlimited Everything: Run infinite experiments, add users, set goals, and more without limitations. Flexible, events-based pricing. Scale Experimentation: share, collaborate and democratise experimentation across the organisation Seamless Full-Stack Integration: API-first gets you up and running in 2 hours. Our lightweight SDKs simplify the integration process. Maintenance-Free Solution: A tool as powerful and flexible as in-house, we handle the upkeep so you can focus on your core business. Real-time Reports: Revolutionise product development with access to insistent insights and with live, up-to-the-minute reporting. Interaction Detection: Comprehensive detection across all tests, offering full factorial insights, surpassing typical multivariate methods. Powerful Data Analysis: Harness robust analytical tools to make trustworthy, strategic decisions. Data Deep Dives: Segment without restrictions. Dive deep into your data for granular insights. Private Cloud Hosting: Ensure top-notch security and performance with on-prem, dedicated cloud infrastructure.

Seller

AB Smartly

Discussions

ABsmartly Community

Languages Supported

English

Product Description

AB Smartly is a complete, end-to-end experimentation solution that allows teams, across the organization, to test with velocity at scale.

Overview by

Jonas Alves (Co-Founder & CEO at ABsmartly - ex Experimentation at Booking.com)

Pricing

Pricing provided by ABsmartly.

ABsmartly platform

Starting at €60,000.00

Per Year

View More Pricing Information

Top-Rated Alternatives

Optimizely Web Experimentation

4.2/5

(398)

View All Alternatives

ABsmartly Media

ABsmartly Demo - ABsmartly Group Sequential Testing engine time savings

We are the only ones in the market to offer a Group Sequential Testing (GST) engine, allowing experimenters to stop or ship an A/B test early - up to 80% faster - when there is a large effect, while also retaining the ability to detect smaller effects within a reasonable timeframe.

ABsmartly Demo - ABsmartly experimentation health checks

The health checks section allows you to see the status of the various checks that ABsmartly runs on your experiments to generate the alerts mentioned above. When an experiment has reached a point where a decision can be made, a recommended action will pop up, telling you what the best action t...

ABsmartly Demo - ABsmartly Feature Flag creation

Feature flags allow you to easily turn features on and off within the ABsmartly platform, without having to go through the entire experiment creation process. This is useful for testing new or error-prone features.

ABsmartly Demo - ABsmartly experiment template

Templates are indispensable for frequent experiments, streamlining setup and reducing errors, especially with complex audiences. They save time by pre-filling fields with predefined parameters, ensuring standardisation across teams and experiments. This boosts consistency, crucial for hig...

ABsmartly Demo - ABsmartly Interaction Detection

ABsmartly's unique interaction detection feature for A/B testing identifies interactions between variables that could impact experiment outcomes. By automatically detecting these interactions, it ensures more accurate results, allowing teams to uncover hidden dependencies between elements and opt...

ABsmartly Demo - ABsmartly experiment list

Dashboard of active experiments in ABsmartly's platform. Each experiment displays key details like name, status (running or stopped), analysis type, impact, confidence level, progress towards sample size, and participant count. The layout highlights progress tracking, with visual indicators for s...

G2 reviews are authentic and verified.

Here's how.

Karol W.

Product Operations Manager

Mid-Market (51-1000 emp.)

10/29/2024

"Great tool driving your experimentation culture!"

5/5

What do you like best about ABsmartly?

- Translating advanced statistics into easy to read results

- Very reliable engine, without any impact on your product performance

- Quick and Easy platform

- Growing collaboration space

- Quickly developing new features

- Great Customer Service

- We were able to grow experimentation without high Data Analysts involvement

- Easy to implement and integrate with your products

- We have tenths of people logging into the platform every day Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

- Lack of advanced program reporting (however that's coming soon - super excited!)

- Collaboration and integration with Slack/Email could be improved Review collected by and hosted on G2.com.

David R.

Software Engineer

Mid-Market (51-1000 emp.)

8/31/2022

"Great scalable source-code oriented tool for A/B Testing"

4/5

What do you like best about ABsmartly?

It scales for many experiments and goals/metrics, in isolated environments. The SDK is easy to work with (frontend and backend), and the Full-on mode saves time for winning experiments. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

Missing tools to export data. But the A/B Smartly guys are always present to assist us with the business requirements. Review collected by and hosted on G2.com.

Peter C.

Sr. Director of Engineering

Mid-Market (51-1000 emp.)

1/11/2022

"Comprehensive experimentation"

4.5/5

What do you like best about ABsmartly?

There's a lot to like about AB smartly; if I had to name it, it is optimized for high throughput: many experiments, many goals, multi-variant. The product covers everything I need to do currently without needing to solve anything myself or find ways of getting around it. It doesn't take a lot to get going and the team is extremely helpful. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

Not sure what you're supposed to write here when you like a product and haven't had issues with it. We experienced a minor bug around restarts that got fixed in under 24 hours, and the bug itself had a low impact. Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

Optimizing our website's customer experience resulting in greater conversions and margin. We have realized that whatever we thought we knew about customers and customer behavior wasn't always the case. Experiments that we thought would be a sure win haven't gone that way, whereas 50/50 bets have become significant winners. Essentially using an objective experimentation framework is the only way I could recommend putting time and resources into optimizing a website's customer experience. "Common sense" is no competitor to objective data comparing customer behavior when presented with features. Similarly, we have also learned to test everything. New hardware? Experiment. A big refactor? Experiment. New affiliate pixel partner? Experiment. Any change to the website is valuable to experiment upon as there is no way of knowing slow burn negative effects outside of experimentation. Review collected by and hosted on G2.com.

Verified User in Automotive

Enterprise (> 1000 emp.)

8/16/2022

"A great platform for A/B testing our product features"

5/5

What do you like best about ABsmartly?

The interface is awesome. We can see our results in real-time. They provide a great way to test in lower environments. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

I don't think there is anything to dislike. Review collected by and hosted on G2.com.

Verified User in Automotive

Enterprise (> 1000 emp.)

8/16/2022

"Great Enterprise AB Testing Platform"

4.5/5

What do you like best about ABsmartly?

You own your data with A/B Smartly and it gives the flexibility to integrate tests at any layer of the stack we choose. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

The platform is still maturing but I would take that trade-off as their immediate support makes up for any issues. Review collected by and hosted on G2.com.

Verified User in Automotive

Mid-Market (51-1000 emp.)

9/6/2022

"Easy to use and the folks at ab smartly are very proactive when it comes to answering any questions"

4.5/5

What do you like best about ABsmartly?

The fact that we can track multiple metrics and define primary and secondary metrics we care about the most that's specific to that test Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

It sometimes is hard to read and distinguish between each field in the metric table. Review collected by and hosted on G2.com.

Verified User in Automotive

Enterprise (> 1000 emp.)

12/16/2021

"We love ABSmartly !"

5/5

What do you like best about ABsmartly?

The team at ABSmartly was super helpful and engaging to help us to onboard and teach us how to use their platform to its full potential. Any issues we raise, they immediately jump in to help us resolve the issue no matter what the issue is, could be on our integration side, configuration, or bug on their side. They even helped us with custom development work to enable us to run some custom AB tests. Speaking to the platform itself, it is very intuitive and easy to use out the box. Once the initial setup is complete, running AB tests is as simple as 1,2,3 and all the metrics we setup initially is all plug and play. Currently, it is satisfying our needs and helping us to iterate and optimize our features quickly. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

For a small company, they are doing all they can do ! Nothing to highlight at this point but I'm sure as they pick up more customers, they'll have to build out more support to help other companies in various industries. Keep up the good work ! Review collected by and hosted on G2.com.

What problems is ABsmartly solving and how is that benefiting you?

We were using Google Optimize initially and while it did satisfy our initial goals of starting to AB test, it was lacking some features to better help us assess our AB tests and decide winners to roll out. This is where we started talking to AB Smartly to help us with some of our asks. One great benefit to call out immediately is how all the metrics we setup gets visualized out the box which provides us with more data to make better informed decisions regarding our AB tests. Review collected by and hosted on G2.com.

Kyle P.

Senior Software Engineer

Mid-Market (51-1000 emp.)

12/16/2021

"A great platform for streamlined AB testing"

4.5/5

What do you like best about ABsmartly?

A/B Smartly helped clean up our AB testing process in many ways. It reduced the number of tools we used and gave us a simple SDK to consume within our applications. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

The UI could use a few improvements. Sometimes updates don't automatically show, and metrics can initially look weird. I have heard they are working on a redesign, so I'm happy to hear they are making improvements. Review collected by and hosted on G2.com.

Verified User in Accounting

Enterprise (> 1000 emp.)

12/17/2021

"Great Ideas and Team: still needs execution"

3/5

What do you like best about ABsmartly?

I like getting to work with the team at ABSmartly. They are responsive and helpful in answering both technical and statistical questions. There is also tremendous potential for growth in what ABSmartly can offer, which is not the case with larger A/B Testing Platforms. Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

The UI is very confusing, especially to new users. Some numbers (like time to convert metrics) are misreported. We also had some trouble integrating ABSmartly fully into our codebase (especially getting which user was in which variant). Other features are still not implemented, so we cannot fully use ABSmartly to meet our experimentation needs. Review collected by and hosted on G2.com.

Sander O.

Head of Marketing & Technology

Mid-Market (51-1000 emp.)

12/20/2021

"The perfect mix between Google Optimize and Optimizely. Best of both worlds combined really"

5/5

What do you like best about ABsmartly?

Very versityle tool to setup and use. It combines all the needed A/B testing features you need and allows for enough freedom to make the tool an integral part of the team Review collected by and hosted on G2.com.

What do you dislike about ABsmartly?

You need to be willing to invest a bit of time to run A/B Smartly on you own cloud instance. In that regard turnkey solutions like Google Optimize are quicker to setup. However, that additional effort is worth it considering why it's smarter to set it up like that. Review collected by and hosted on G2.com.