Pinned Loading

1. sgl-project/ome sgl-project/ome Public

   Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

   Go 399 65

2. lightseekorg/smg lightseekorg/smg Public

   Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, SGLang, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat histor…

   Rust 108 22

3. sgl-project/genai-bench sgl-project/genai-bench Public

   A Rust reimplementation of genai-bench for benchmarking LLM serving systems at high concurrency with accurate timing and industry-standard metrics

   Python 280 50

4. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 24.7k 4.9k