serverless-inference

Running machine learning models used to start with a hardware question: which GPU, where, and who keeps it alive? Serverless GPU inference inverts that. You send a request; somewhere, a GPU spins up,