Pinned Loading

1. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

   C++ 10.4k 1.4k

2. PaddlePaddle/Paddle PaddlePaddle/Paddle Public

   PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

   C++ 22.7k 5.7k

3. PaddlePaddle/Anakin PaddlePaddle/Anakin Public archive

   High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.

   C++ 533 133