Skip to content

AI2 Olmo 7B does not support Flash-Attention 2.0. ValueError: OLMoForCausalLM does not support Flash Attention 2.0 yet. #29145

Closed
KaifAhmad1/transformers
#1
@KaifAhmad1

Description

@KaifAhmad1

Model description

Model Name: allenai/OLMo-7B

Open source status

  • The model implementation is available
  • The model weights are available

Provide useful links for the implementation

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions