
Honestly the cost model. We were running a multi tenant RAG setup where most of our namespaces sit idle the majority of the day (customer knowledge bases, support docs, etc.). With our previous vector DB we were still paying for the full capacity even when nothing was being queried. Switching to Turbopuffer felt almost too good to be true at first. Data lives on object storage so idle namespaces cost almost nothing and the hot ones stay fast once they are cached. The first real oh shit this actually works moment was when we onboarded a big new customer over a weekend. We dumped a few hundred thousand docs into a fresh namespace and the bill barely moved. Same workload on the old system would have made me open a spreadsheet and start sweating. Hybrid search (vector + BM25) in the same API is also really nice. We do not have to run a separate keyword engine anymore. But the cost savings and the fact that it just scales without me having to think about clusters is what I like best. Review collected by and hosted on G2.com.
Nothing major, but the cold start latency can be noticeable if a namespace has not been queried for a while. In our case most of the important namespaces stay warm because they get regular traffic, so it rarely shows up. The first time we hit a completely cold one during testing though the response took a few hundred milliseconds longer than we expected. Once it is cached everything is fine again. It is a fair tradeoff for the cost savings and the way the architecture works, and it has not been a problem in production for us. Still, if your workload has a lot of rarely accessed namespaces and you need consistently low latency every single time, it is something to keep in mind. Review collected by and hosted on G2.com.