Skip to content

Deprecation for Float8DynamicActivationFloat8WeightConfig and Float8WeightOnlyConfig and the models #2649

@jerryzh168

Description

@jerryzh168

This issue is tracking the deprecation of the (1) configs (2) model checkpoints quantized with these configs.

What is deprecated:

  1. We added VERSION 2 config in Add Float8Tensor #2463, and switched the default version to 2 in TBD, the VERSION 1 config is now deprecated, please use VERSION 2 config to quantize the model
  2. the quantized checkpoints quantized with VERSION 1 config previously is deprecated as well, and we plan to remove the ability to load these checkpoints in March 2026 (9 months from now)

Timeline:
0.13.0: annouce deprecation
0.14.0: remove support

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions