LLMKube logo

LLMKube

266 stars Apache-2.0 license Go

Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.

Category

Developer

Last Update

November 2026

Related Developer Apps