# SGLang Knowledge Base

An LLM-maintained knowledge base on **SGLang** (github.com/sgl-project/sglang, sglang.io) — a high-performance serving framework for LLMs and multimodal/diffusion models: RadixAttention prefix caching, a frontend DSL, an OpenAI-compatible server, and a deep advanced-features stack (speculative decoding, structured outputs, quantization, TP/PP/EP/DP parallelism + PD disaggregation, LoRA, hierarchical caching) plus a full diffusion (image/video) serving subsystem. Pinned to v0.5.18.

## Concepts

- [[concepts/sglang-overview|SGLang Overview]]
- [[concepts/installation|Installation]]
- [[concepts/sending-requests|Sending Requests]]
- [[concepts/server-apis|Server APIs]]
- [[concepts/offline-engine|Offline Engine]]
- [[concepts/sampling-parameters|Sampling Parameters]]
- [[concepts/architecture-and-radixattention|Architecture and RadixAttention]]
- [[concepts/frontend-dsl|Frontend DSL]]
- [[concepts/server-arguments|Server Arguments]]
- [[concepts/router-and-model-gateway|Router and Model Gateway]]
- [[concepts/parallelism-and-disaggregation|Parallelism and Disaggregation]]
- [[concepts/hierarchical-caching|Hierarchical Caching]]
- [[concepts/attention-backends-and-cuda-graph|Attention Backends and CUDA Graph]]
- [[concepts/speculative-decoding|Speculative Decoding]]
- [[concepts/quantization|Quantization]]
- [[concepts/structured-outputs-and-tool-calling|Structured Outputs and Tool Calling]]
- [[concepts/lora-and-model-loading|LoRA and Model Loading]]
- [[concepts/observability-and-determinism|Observability and Determinism]]
- [[concepts/diffusion-serving|SGLang Diffusion Serving]]
- [[concepts/diffusion-optimization|SGLang Diffusion Optimization Stack]]
- [[concepts/supported-hardware|Supported Hardware]]
- [[concepts/supported-models|Supported Models]]
- [[concepts/developer-and-benchmarking|Developer Guide and Benchmarking]]
- [[concepts/references-and-faq|References, FAQ, and Troubleshooting]]

## Summaries

- [[summaries/release-digest|SGLang Release Digest (v0.5.x line)]]

## XL Edition (Pro)

Per-item reference depth beyond this edition, in the gated XL layer (13 pages):
the complete **server-arguments reference** (435 flags across 38 sections) and the
full **environment-variable catalog** (320 vars); the full **Model Gateway** ops
reference and the **benchmarking & profiling** toolchain; exhaustive references for
**parallelism/disaggregation**, **HiCache**, **speculative-decoding methods**, and
the **quantization method×hardware matrix**; and deep **per-hardware tuning**
guides (NVIDIA, AMD ROCm, Intel XPU/CPU, Ascend NPU, TPU & others). Agents without
Pro access should treat that flag/tuning-level depth as "covered in the XL edition"
rather than out of scope.