Serve AI models using TorchServe in Kubernetes at scale
In a tipical MLOps pratice, among the various things, we need to serve our AI models to users exposing inference APIs.
I tried a production ready framework (TorchServe) installing it on Azure Kubernetes Service and tested its power to the maximum.
