BentoML

// about BentoML

BentoML is an open-source framework for packaging and deploying machine learning models at production scale. ML engineers wrap any model from any framework into a standardized service, then ship it as a Docker container or push it to cloud platforms. Batching, async serving, and multi-model pipelines are handled out of the box.