Skip to content
@vllm-project

vLLM

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 64.7k 11.8k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2.3k 306

  3. recipes recipes Public

    Common recipes to run vLLM

    Jupyter Notebook 262 98

Repositories

Showing 10 of 28 repositories
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 64,734 Apache-2.0 11,771 1,879 (35 issues need help) 1,263 Updated Dec 6, 2025
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,422 Apache-2.0 629 799 (8 issues need help) 279 Updated Dec 6, 2025
  • vllm-omni Public

    A framework for efficient model inference with omni-modality models

    vllm-project/vllm-omni’s past year of commit activity
    Python 677 Apache-2.0 79 41 (14 issues need help) 26 Updated Dec 6, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,452 Apache-2.0 493 257 (19 issues need help) 24 Updated Dec 6, 2025
  • tpu-inference Public

    TPU inference for vLLM, with unified JAX and PyTorch support.

    vllm-project/tpu-inference’s past year of commit activity
    Python 178 Apache-2.0 53 17 (1 issue needs help) 68 Updated Dec 6, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 27 Apache-2.0 48 0 26 Updated Dec 6, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 732 Apache-2.0 105 43 (3 issues need help) 19 Updated Dec 5, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 2,344 Apache-2.0 306 76 (16 issues need help) 46 Updated Dec 6, 2025
  • vllm-neuron Public

    Community maintained hardware plugin for vLLM on AWS Neuron

    vllm-project/vllm-neuron’s past year of commit activity
    Python 13 1 0 0 Updated Dec 6, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 37 Apache-2.0 30 4 15 Updated Dec 6, 2025
View all repositories

Sponsors

  • @Existein
  • @byStander9
  • @nwthomas
  • @hippoley
  • @kXborg
  • @G-Research-OSS
  • @kevATin
  • @yankay
  • @brickfrog
  • @GabrielBianconi
  • @imkero
  • @comet-ml
  • @terrytangyuan
View all