Skip to content
@vllm-project

vLLM

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 59.8k 10.6k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2.1k 252

  3. recipes recipes Public

    Common recipes to run vLLM

    Jupyter Notebook 154 55

Repositories

Showing 10 of 24 repositories
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 59,769 Apache-2.0 10,602 1,819 (32 issues need help) 1,155 Updated Oct 10, 2025
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 12 Apache-2.0 51 1 56 Updated Oct 10, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 617 Apache-2.0 88 84 (5 issues need help) 27 Updated Oct 10, 2025
  • semantic-router Public

    Intelligent Mixture-of-Models Router for Efficient LLM Inference

    vllm-project/semantic-router’s past year of commit activity
    Python 1,664 Apache-2.0 188 84 (15 issues need help) 19 Updated Oct 10, 2025
  • vllm-project.github.io Public
    vllm-project/vllm-project.github.io’s past year of commit activity
    HTML 20 29 0 0 Updated Oct 10, 2025
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,191 Apache-2.0 471 542 (6 issues need help) 171 Updated Oct 10, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 35 Apache-2.0 26 5 17 Updated Oct 10, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 2,067 Apache-2.0 251 62 (12 issues need help) 40 Updated Oct 10, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,290 Apache-2.0 469 221 (20 issues need help) 24 Updated Oct 10, 2025
  • speculators Public

    A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

    vllm-project/speculators’s past year of commit activity
    Python 57 Apache-2.0 10 3 (2 issues need help) 17 Updated Oct 10, 2025
View all repositories

Sponsors

  • @DeeveshBeegun
  • @kevATin
  • @yankay
  • @brickfrog
  • @GabrielBianconi
  • @imkero
  • @comet-ml
  • @thomas-hiddenpeak
  • @terrytangyuan
  • @dvlpjrs
  • @vincentkoc
  • @robertgshaw2-redhat
  • Private Sponsor

Most used topics

Loading…