activeai infrastructure
Multi-Tenant LLM Inference Platform
Build, test, and operate a platform that serves a language model to multiple tenants while keeping shared GPU capacity fair, observable, and reliable.
Functional progress2 / 8
These projects explain what I built, the choices I made, and what I learned.
Build, test, and operate a platform that serves a language model to multiple tenants while keeping shared GPU capacity fair, observable, and reliable.