Repositories list

• oat

  Public
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.

  thompson-samplingalignmentreasoning+ 13distributed-trainingppodueling-banditsdpodistributed-rlllmonline-rl+ 6

  Python

  •

  Apache License 2.0

  •32•425•1•2•Updated Jul 28, 2025Jul 28, 2025

• SkyLadder

  Public
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling

  Python

  •

  Apache License 2.0

  •560•33•0•0•Updated Jul 27, 2025Jul 27, 2025

• understand-r1-zero

  Public
  Understanding R1-Zero-Like Training: A Critical Perspective

  rlreasoningllm+ 1r1-zero

  Python

  •

  MIT License

  •50•1.1k•6•0•Updated Jul 24, 2025Jul 24, 2025

• jrystal

  Public
  A JAX-based Differentiable Density Functional Theory Framework for Materials

  density-functional-theoryquantum-chemistrymaterial-science+ 4solid-statejaxdifferentiable-programmingelectron-structure

  Python

  •

  Apache License 2.0

  •2•30•7•3•Updated Jul 24, 2025Jul 24, 2025

• AnytimeReasoner

  Public
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization

  Python

  •

  Apache License 2.0

  •2•43•0•0•Updated Jul 15, 2025Jul 15, 2025

• LongSpec

  Public
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification

  Python

  •

  MIT License

  •3•61•0•0•Updated Jul 14, 2025Jul 14, 2025

• Attention-Sink

  Public
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)

  language-modelattention-mechanismlarge-language-models+ 1attention-sink

  Python

  •

  MIT License

  •4•104•1•0•Updated Jul 8, 2025Jul 8, 2025

• LifelongSafetyAlignment

  Public
  Python

  •0•8•1•0•Updated Jul 5, 2025Jul 5, 2025

• VeriFree

  Public
  Reinforcing General Reasoning without Verifiers

  Python

  •6•78•6•0•Updated Jun 24, 2025Jun 24, 2025

• d4ft

  Public
  A JAX library for Density Functional Theory.

  Python

  •

  Apache License 2.0

  •5•54•16•0•Updated Jun 18, 2025Jun 18, 2025

• Adan

  Public
  Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

  deep-learningoptimizerpytorch+ 17artificial-intelligencemoeresnetvitdiffusionmaefairseq+ 10

  Python

  •

  Apache License 2.0

  •69•797•3•0•Updated Jun 8, 2025Jun 8, 2025

• Video-Next-Event-Prediction

  Public
  Python

  •

  MIT License

  •1•15•2•0•Updated May 29, 2025May 29, 2025

• TreeMeshGPT

  Public
  [CVPR 2025] TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencing

  Python

  •

  MIT License

  •7•157•2•0•Updated May 22, 2025May 22, 2025

• ContinualBench

  Public
  Python

  •

  MIT License

  •0•9•1•0•Updated May 20, 2025May 20, 2025

• zero-bubble-pipeline-parallelism

  Public
  Zero Bubble Pipeline Parallelism

  Python

  •

  Other

  •3k•411•28•0•Updated May 7, 2025May 7, 2025

• FlowReasoner

  Public
  Python

  •7•128•0•0•Updated May 6, 2025May 6, 2025

• Meta-Unlearning

  Public
  Python

  •1•27•1•0•Updated Apr 22, 2025Apr 22, 2025

• LightTrans

  Public
  The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"

  Python

  •0•20•0•0•Updated Apr 22, 2025Apr 22, 2025

• ActivePRM

  Public
  Jupyter Notebook

  •0•17•0•0•Updated Apr 16, 2025Apr 16, 2025

• dice

  Public
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards

  alignmentpreference-learninglarge-language-models+ 1rlhf

  Python

  •

  MIT License

  •3•44•0•0•Updated Apr 15, 2025Apr 15, 2025

• oat-zero

  Public
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.

  Python

  •

  MIT License

  •10•245•0•0•Updated Apr 15, 2025Apr 15, 2025

• jax_xc

  Public
  Exchange correlation functionals translated from libxc to jax

  pythondensity-functional-theorylibxc+ 1jax

  Python

  •

  Mozilla Public License 2.0

  •2•45•5•0•Updated Mar 24, 2025Mar 24, 2025

• autofd

  Public
  Automatic Functional Differentiation in JAX

  automatic-differentiationjaxneural-operator+ 1variational-calculus

  Python

  •

  Apache License 2.0

  •1•74•6•0•Updated Mar 24, 2025Mar 24, 2025

• CPO

  Public
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.

  Python

  •7•126•0•0•Updated Mar 21, 2025Mar 21, 2025

• sailor2

  Public
  🔱 Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs

  vietnameseindonesiathai+ 14tamiltagalogcebuanolanguage-modelburmesekhmerlao+ 7

  3•66•0•0•Updated Mar 21, 2025Mar 21, 2025

• Megatron-Sailor2

  Public
  Megatron for Sailor2/Qwen2.5

  Python

  •2•4•0•0•Updated Mar 21, 2025Mar 21, 2025

• AR-Video-Diffusion

  Public
  JavaScript

  •0•0•0•0•Updated Mar 17, 2025Mar 17, 2025

• Meta-ARVDM

  Public
  Official Implementation of "Error Analyses of Auto-Regressive Video Diffusion Models: A Unified Framework"

  0•5•1•0•Updated Mar 12, 2025Mar 12, 2025

• VocabularyParallelism

  Public
  Vocabulary Parallelism

  Python

  •

  Other

  •3k•19•2•0•Updated Mar 10, 2025Mar 10, 2025

• SEA-WildBench

  Public
  Multilingual WildBench for south-east Asian languages.

  Python

  •

  Apache License 2.0

  •0•2•0•0•Updated Mar 3, 2025Mar 3, 2025