Skip to content
@llm-d

llm-d

llm-d is a Kubernetes-native high-performance distributed LLM inference framework

Pinned Loading

  1. llm-d.github.io llm-d.github.io Public

    Website for llm-d: This repository builds the website seen at llm-d.ai

    JavaScript 7 9

Repositories

Showing 10 of 10 repositories
  • llm-d-benchmark Public

    llm-d benchmark scripts and tooling

    llm-d/llm-d-benchmark’s past year of commit activity
    Shell 12 Apache-2.0 4 1 0 Updated May 29, 2025
  • llm-d-deployer Public

    Helm charts for llm-d

    llm-d/llm-d-deployer’s past year of commit activity
    Shell 33 Apache-2.0 18 17 5 Updated May 28, 2025
  • llm-d-model-service Public

    Simplified model deployment on llm-d

    llm-d/llm-d-model-service’s past year of commit activity
    Go 18 Apache-2.0 5 26 2 Updated May 28, 2025
  • llm-d Public

    llm-d is a Kubernetes-native high-performance distributed LLM inference framework

    llm-d/llm-d’s past year of commit activity
    Makefile 931 Apache-2.0 50 15 12 Updated May 28, 2025
  • llm-d-inference-sim Public

    A light weight vLLM simulator, for mocking out replicas.

    llm-d/llm-d-inference-sim’s past year of commit activity
    Go 18 7 3 1 Updated May 28, 2025
  • llm-d.github.io Public

    Website for llm-d: This repository builds the website seen at llm-d.ai

    llm-d/llm-d.github.io’s past year of commit activity
    JavaScript 7 9 2 1 Updated May 28, 2025
  • llm-d-inference-scheduler Public

    Inference scheduler for llm-d

    llm-d/llm-d-inference-scheduler’s past year of commit activity
    Go 43 Apache-2.0 18 40 (2 issues need help) 4 Updated May 27, 2025
  • llm-d-kv-cache-manager Public

    Distributed KV cache coordinator

    llm-d/llm-d-kv-cache-manager’s past year of commit activity
    Go 31 3 9 (2 issues need help) 0 Updated May 21, 2025
  • llm-d-pd-utils Public
    llm-d/llm-d-pd-utils’s past year of commit activity
    Makefile 3 3 0 0 Updated May 21, 2025
  • llm-d-routing-sidecar Public

    Incubating P/D sidecar for llm-d

    llm-d/llm-d-routing-sidecar’s past year of commit activity
    Go 9 Apache-2.0 2 5 (1 issue needs help) 0 Updated May 22, 2025

Most used topics

incubating ai