StackFollow on WhatAreYouBuilding.AI

Ray Serve

Scalable model-serving library built on the Ray distributed compute framework.

https://www.ray.io