LLMariner: Open-Source LLM Hosting on Kubernetes with OpenAI-Compatible APIs

Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs. - llmariner/llmariner

Read more here: External Link