BentoML
by BentoML
Inference platform for deploying and scaling any model, with autoscaling, observability and bring-your-own-cloud options.
About
Inference platform for deploying and scaling any model, with autoscaling, observability and bring-your-own-cloud options.
BentoML is an inference platform built for speed and control. Teams package models of any architecture, framework or modality with the open source serving framework, or launch popular open models from a catalog, then deploy them with CI/CD automation, access control and resource tracking.
The Bento Compute Engine adds elastic autoscaling, scale-to-zero, cold-start acceleration and multi-cloud orchestration. It supports engines such as vLLM, TRT-LLM, SGLang and PyTorch, and offers serving patterns for interactive apps, async tasks and batch inference. Deployments run on Bento Cloud GPUs or in your own cloud, on-prem or Kubernetes.
Key features
Product details
Vendor
BentoML
Category
MLOps Platforms
Starting price
Contact for pricing
Free trial
No
Deployment
Bento Cloud, bring your own cloud, on-premises, Kubernetes
Company size
Startups to enterprises
Pricing
Similar software
Amazon SageMaker
by Amazon Web Services
Amazon SageMaker is AWS's unified platform for data, analytics and AI, covering model building, training, deployment and governance.
Anyscale
by Anyscale
Managed Ray platform for scaling AI training, batch processing and model serving with usage-based compute pricing.
Apache Airflow
by Apache Software Foundation
Open-source platform to author, schedule and monitor data and ML workflows as Python code.
Aporia
by Coralogix
AI guardrails and observability for LLM and ML systems. Now part of Coralogix (formerly Aporia).
Azure Machine Learning
by Microsoft
Enterprise Azure service for the end-to-end machine learning lifecycle, from data preparation to managed deployment and MLOps.
ClearML
by ClearML
Open source end-to-end MLOps platform for experiment tracking, pipelines, dataset versioning, model serving and GPU orchestration.