AG

Allabakash G.

AI developer

Small-Business (50 or fewer emp.)

10/23/2024

"Bentoml helps in building efficient model for inference, Dockerization, Deploying in Any Cloud"

5/5

What do you like best about BentoML?

I really like how bentoml's framework is built for handling incoming traffic's, i really like its feature of workers as an ai developer running nlpmodels on scalable is crucial bentoml helps me to easily of building a service which can accept multiple request using the help of workers, i also like its feature of bento building and dockerization, in traditional method to dockerize we create a flask or django or gradio... service and then write a dockerfile initialize a nvidia support in docker, this all is the work of devops engineer but bentoml come to rescue here just write a bentofile.yaml where you specify you service cuda version libraries to install, system packages to install and just bentoml build and then bentoml containerize boom bentoml just containerized for you it did write a dockerfile for you and saved the time for write dockerfile and building it, i really like this about bentoml, it has good customer support as well it has a slack environment where the developers of bentoml are deeply engaged with the solving of bentoml users issues which they are facing Review collected by and hosted on G2.com.

What do you dislike about BentoML?

The one thing about bentoml is it doest have support for aws sagemaker recently i was deploying my models in aws sagemaker but bentoml didnt have methods ofdockerizing for aws sagemaker well it had one library called bentoctl but it was deprecated Review collected by and hosted on G2.com.

What problems is BentoML solving and how is that benefiting you?

i have been mainly working on real time products, real time require low latency inference and working for multiple concurrent request, bentoml helped me achieve the fast, scalable model serving

for our compnies product, also has been fo really great help for dockerizing and deploying the dockers in services like AWS EC2, AWS EKS.. etc Review collected by and hosted on G2.com.

Show More

Current UserValidated ReviewerSource: Organic

See what 2 reviewers think of BentoML

5.0 out of 5 · Verified reviews from real users

[
Read all reviews
](https://www.g2.com/products/bentoml/reviews)