Arize AI Reviews & Product Details

I really like the evaluation aspect of Arize AI. It excels in running offline and online based evaluations, which is something I find valuable. I appreciate its ability to test against different prompts and LLM models by conducting various experiments. This feature is definitely a strength of the Arize AI platform. Review collected by and hosted on G2.com.

I think a couple of things I've already shared with the Arize support team. One is we would love to get more of the prompt management features or capabilities. It has got to do with categorizing these prompts by, you know, let’s say, by a BU or maybe by different verticals within the organization. Whether the prompt management capabilities have integration with data sources, external data sources. We definitely had challenges because we were, I think, one of the first guinea pigs in terms of integrating with the Arize platform. Arize, as a platform, didn't have out-of-the-box capability to support the integration at that point in time. So there was quite a bit of, you know, a few tweaks here and there in the core base that was done to get it up and running. Review collected by and hosted on G2.com.

I like how accessible it is to view traces, spans, and sessions, along with the evaluation methods. It’s also helpful that I can access them either through the UI or even offline. The filtering of data also makes it very easy to view the required spans, traces and sessions. Also the trace tree feature is very helpful to view the kind of each span. Review collected by and hosted on G2.com.

There’s really nothing to dislike. The only thing I’d change is making the filtration a bit simpler, because it took me a while to understand. Once I got how the filtration works, though, I was able to connect without any issues. Review collected by and hosted on G2.com.

I appreciate Arize AI for its ability to bridge the gap between development and production. I find the field level observability feature really useful as it allows me to compare, debug, and optimize models instead of only relying on high-level performance metrics. I also like that the initial setup is quick and intuitive, which makes it easy to get started. Review collected by and hosted on G2.com.

I dislike that the output isn't showing the dashboard correctly. Review collected by and hosted on G2.com.

Custom Code Evaluator and Live tracing projects. Review collected by and hosted on G2.com.

when you choose to run 10/20 rows in the playground by selecting the dataset.

Instead of first 10 rows it randomly runs any 10 examples.

Which doesn't helps with the consistency in running the evals Review collected by and hosted on G2.com.

It provides the metrics readily and allows for easy integration. Review collected by and hosted on G2.com.

Latency and custom instrumentation in most cases Review collected by and hosted on G2.com.

Arize AI offers a comprehensive platform for monitoring machine learning models in real-time. The platform's ability to provide actionable insights into model drift, data issues, and performance degradation is particularly impressive. The user interface is intuitive, making it easy to track and understand the health of deployed models. The integration capabilities with various ML frameworks are also a significant upside, streamlining the process of setting up and monitoring models. Review collected by and hosted on G2.com.

While Arize AI offers a robust set of features, there can be a learning curve for those new to ML operations. Some advanced features might require a deeper understanding of the platform, and the documentation, while extensive, could be overwhelming for beginners. It would be beneficial if there were more beginner-friendly tutorials or guided walkthroughs. Review collected by and hosted on G2.com.

The product is crisp and I understood how it operates through courses.

It has almost got everything for model monitoring and other important features. It helps in all the for ML operations. Review collected by and hosted on G2.com.

Arize AI, if I am not wrong is like a dashboard. It would have been better if there was an API sort of thing where we can leverage the features through a package. Review collected by and hosted on G2.com.

Their search and retrieval functionality is excellent, with a diverse set of tools for various issues that can come up. The langchain integration is also immensly helpful. Review collected by and hosted on G2.com.

They have not released their prompt improvement tool kit yet which could add significant value to the platform as a whole. Improving propmt flow is very relevant to most LLM related work today. Review collected by and hosted on G2.com.

Optimising MLOps framework

Feedback analysis

Clustering approach to data analysis

Documentation for quick implementation Review collected by and hosted on G2.com.

Software navigation bit complicated to understand at first

Only cloud instance of the software, and need to share all the data in cloud . Review collected by and hosted on G2.com.

We like that it shows visualizations of feature values, model scores, and prediction volume; it also lets users configure alerts on drift conditions. These features serve our ML monitoring needs well.

Arize's engineering/support team is very responsive. Our installation had to be on a private cloud on premises, and the Arize team provided excellent guidance and support in getting it set up. We are able to work directly with subject matter experts within hours of requesting assistance. The Arize team holds regularly check-ins to collect feedback. They continuously create enhancements and new features based on our feedback. From what I can tell, the engineering team works in a truely agile environment. Review collected by and hosted on G2.com.

The UMAP that visualizes embeddings could run faster. That said, rendering performance seems to be a common issue for many charting tools plotting huge datasets on the front end. Review collected by and hosted on G2.com.