We use Neptune consistently to track hundreds of different experiments and it is very easy to take advantage of the features in place to corral those results into information that is digestible for other stakeholders, including those that are not in technical roles. It provides a consistent structure that ensures all our data is reliably and intuitively organized. Additionally, Neptune allows us to self-host the application which keeps our data secure and they have provided great support to keep us as up to date as possible.

Easy to set up, plenty of integration, useful collaboration tool. The team was quick to catch up and start tracking experiments, despite a bit of reservation before the integration. Currently, all experiments need to be in Neptune if they want to go production, allowing us to track and enforce quality. A definite win for the team, and for the company!

I’ve found Neptune pretty easy to integrate. Although I don’t use it in the traditional way, I rely on it to track experiment evaluations and monitor the performance of our LLM-based applications. The tool is flexible and adapts to most of all types of tracking needs. Recently, I've had the need to map API call statuses, including error codes, and the process was seamless and fast. Another super positive aspect is the incredible customer support. We have regular meetings, and the team is always willing to listen to our requests and translate them into practical solutions. They consistently share valuable resources and try to meet our needs.