Repositories list

• neuronx-distributed-inference

  Public
  Python

  •

  Apache License 2.0

  •11•19•4•2•Updated Aug 5, 2025Aug 5, 2025

• aws-neuron-samples

  Public
  Example code for AWS Neuron SDK developers building inference and training applications

  machine-learningdeep-learningtensorflow+ 1pytorch

  Jupyter Notebook

  •

  Other

  •45•148•13•11•Updated Aug 4, 2025Aug 4, 2025

• aws-neuron-sdk

  Public
  Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services

  Python

  •

  Other

  •170•533•181•26•Updated Aug 4, 2025Aug 4, 2025

• upstreaming-to-vllm

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •9.1k•19•0•1•Updated Aug 1, 2025Aug 1, 2025

• neuronx-distributed-training

  Public
  Python

  •

  Apache License 2.0

  •1•12•0•4•Updated Aug 1, 2025Aug 1, 2025

• neuronx-distributed

  Public
  Python

  •

  MIT No Attribution

  •16•60•11•13•Updated Aug 1, 2025Aug 1, 2025

• deep-learning-containers

  Public
  AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia instances using AWS Neuron SDK.

  Python

  •

  Apache License 2.0

  •13•11•0•3•Updated Aug 1, 2025Aug 1, 2025

• neuron-workshops

  Public
  Notebooks and sample code for Build On Trainium

  Jupyter Notebook

  •

  Apache License 2.0

  •6•20•7•2•Updated Jul 30, 2025Jul 30, 2025

• nki-samples

  Public
  Python

  •

  MIT No Attribution

  •24•40•13•5•Updated Jul 22, 2025Jul 22, 2025

• neuron-helm-charts

  Public
  AWS Neuron Helm Chart repository

  Smarty

  •

  Apache License 2.0

  •1•7•2•1•Updated Jun 27, 2025Jun 27, 2025

• aws-neuron-eks-samples

  Public
  Python

  •

  MIT No Attribution

  •7•24•1•2•Updated Jun 3, 2025Jun 3, 2025

• nki-llama

  Public
  Project showing how to develop NKI kernels for Llama 3.2 1B inference

  Python

  •

  Apache License 2.0

  •17•19•1•3•Updated May 29, 2025May 29, 2025

• nki-synthesizer

  Public
  Python

  •

  MIT No Attribution

  •0•0•0•0•Updated Apr 18, 2025Apr 18, 2025

• torch2nki

  Public
  Project to scale NKI kernels within PyTorch

  Python

  •

  Apache License 2.0

  •2•3•0•2•Updated Mar 28, 2025Mar 28, 2025

• transformers-neuronx

  Public
  Python

  •

  Apache License 2.0

  •32•112•13•9•Updated Jan 16, 2025Jan 16, 2025

• neuronx-nemo-megatron

  Public
  Python

  •13•39•1•7•Updated Dec 19, 2024Dec 19, 2024

• .github

  Public
  403•0•0•0•Updated Oct 18, 2024Oct 18, 2024

• aws-neuron-sagemaker-samples

  Public
  Jupyter Notebook

  •

  MIT No Attribution

  •5•13•1•4•Updated Jul 1, 2024Jul 1, 2024

• aws-neuron-parallelcluster-samples

  Public
  Shell

  •

  Other

  •6•23•3•2•Updated Apr 9, 2024Apr 9, 2024

• aws-neuron-reference-for-megatron-lm

  Public
  Python

  •

  Other

  •4•14•0•1•Updated Aug 29, 2023Aug 29, 2023

• aws-neuron-tensorflow

  Public
  Python

  •

  Apache License 2.0

  •4•5•0•0•Updated Jun 22, 2023Jun 22, 2023

• aws-neuron-runtime-proto

  Public
  Apache License 2.0

  •2•6•0•0•Updated Nov 30, 2022Nov 30, 2022

• aws-neuron-driver

  Public
  Linux kernel device driver supporting AWS Neuron SDK

  C

  •

  GNU General Public License v2.0

  •5•10•1•0•Updated Oct 26, 2020Oct 26, 2020