Search results

BF16 stochastic rounding does not work distributed (FSDP)

bugSomething isn't workingSomething isn't working

optimizer

Status: Open.

#2296 In pytorch/ao;

· nathan-az opened on Jun 4, 2025

newer torchao breaks sglang?

bugSomething isn't workingSomething isn't working

high priority

triage review

Status: Open.

#2226 In pytorch/ao;

· jerryzh168 opened on May 19, 2025

Dynamo error with large mesh + AdamWFp8 + bf16 stochastic rounding

bugSomething isn't workingSomething isn't working

distributed

high priority

optimizer

triage review

triaged

Status: Open.

#2074 In pytorch/ao;

· cassanof opened on Apr 18, 2025

[Needs more investigation] <code>int8_weight_only</code> via <code>quantize_()</code> API on <code>torch.float16</code> models results in NaN values across multiple CPU architectures

bugSomething isn't workingSomething isn't working

quantize

Status: Open.

#1662 In pytorch/ao;

· vmpuri opened on Feb 4, 2025

The internal torchao tensor subclasses cause errors with torch.compile

bugSomething isn't workingSomething isn't working

Status: Open.

#1463 In pytorch/ao;

· JohnnyRacer opened on Dec 28, 2024

<code>unhashable type: non-nested SymInt</code>

autoquant

bugSomething isn't workingSomething isn't working

Status: Open.

#1381 In pytorch/ao;

· bhack opened on Dec 4, 2024

[AQT] Failed to move compiled module with AQT to a different device

bugSomething isn't workingSomething isn't working

Status: Open.

#1309 In pytorch/ao;

· gau-nernst opened on Nov 19, 2024

pip install torchao cannot get latest versions (only 0.1 and 2 other version in the same level)

bugSomething isn't workingSomething isn't working

Status: Open.

#1300 In pytorch/ao;

· moreAImore opened on Nov 17, 2024

CPUoffloadOptimizer issues

bugSomething isn't workingSomething isn't working

optimizer

Status: Open.

#1209 In pytorch/ao;

· felipemello1 opened on Nov 1, 2024

Shape mismatch error for int8_weight_only quantization when input is of shape (N, 1)

bugSomething isn't workingSomething isn't working

inference

Status: Open.

#761 In pytorch/ao;

· jbschlosser opened on Aug 27, 2024

Outdated gpt-fast codebase

autoquant

bugSomething isn't workingSomething isn't working

Status: Open.

#751 In pytorch/ao;

· YJYJLee opened on Aug 27, 2024

Tutorial "run_vit_b_quant.py" cannot run

bugSomething isn't workingSomething isn't working

Status: Open.

#675 In pytorch/ao;

· relaxtheo opened on Aug 14, 2024