Skip to content

Provide clear guidance on required QNN versions and SoC serials #8654

Open
@guangy10

Description

@guangy10
Contributor

📚 The doc issue

The potential doc improvement is from this GitHub Issue: #8640.

Today in our tutorial for QNN (https://pytorch.org/executorch/main/build-run-qualcomm-ai-engine-direct-backend.html), it doesn't provide a clear guidance on how each SoC number and supported QNN versions should be used given a specific model.

@winskuo-quic wdyt?

Suggest a potential alternative/fix

No response

cc @mergennachin @byjlw

Activity

added
enhancementNot as big of a feature, but technically not a bug. Should be easy to fix
module: docIssues related to documentation, both in docs/ and inlined in code
on Feb 24, 2025
guangy10

guangy10 commented on Feb 24, 2025

@guangy10
ContributorAuthor

cc: @GregoryComer as you are also working on documentation for better UX

added
triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
on Feb 24, 2025
cccclai

cccclai commented on Feb 24, 2025

@cccclai
Contributor

QNN version is unrelated to SoCs. I think we should just use qnn 2.28, as described in https://pytorch.org/executorch/main/build-run-qualcomm-ai-engine-direct-backend.html

guangy10

guangy10 commented on Feb 25, 2025

@guangy10
ContributorAuthor

QNN version is unrelated to SoCs. I think we should just use qnn 2.28, as described in https://pytorch.org/executorch/main/build-run-qualcomm-ai-engine-direct-backend.html

Do we expect all models can work on all listed SoCs? If yes, that's good, otherwise, let's be explicit about it. I recall I was having hard time to figure it out in the past.

cccclai

cccclai commented on Feb 25, 2025

@cccclai
Contributor

QNN version is unrelated to SoCs. I think we should just use qnn 2.28, as described in https://pytorch.org/executorch/main/build-run-qualcomm-ai-engine-direct-backend.html

Do we expect all models can work on all listed SoCs? If yes, that's good, otherwise, let's be explicit about it. I recall I was having hard time to figure it out in the past.

Hmm, what does all models mean? I think many PyTorch models are supported by the QNN delegates, but not all models (I wish)

guangy10

guangy10 commented on Feb 25, 2025

@guangy10
ContributorAuthor

QNN version is unrelated to SoCs. I think we should just use qnn 2.28, as described in https://pytorch.org/executorch/main/build-run-qualcomm-ai-engine-direct-backend.html

Do we expect all models can work on all listed SoCs? If yes, that's good, otherwise, let's be explicit about it. I recall I was having hard time to figure it out in the past.

Hmm, what does all models mean? I think many PyTorch models are supported by the QNN delegates, but not all models (I wish)

For any model supported by QNN, do we expect it can work on any of the listed SoCs?

winskuo-quic

winskuo-quic commented on Feb 26, 2025

@winskuo-quic
Collaborator

QNN version is unrelated to SoCs. I think we should just use qnn 2.28, as described in https://pytorch.org/executorch/main/build-run-qualcomm-ai-engine-direct-backend.html

Do we expect all models can work on all listed SoCs? If yes, that's good, otherwise, let's be explicit about it. I recall I was having hard time to figure it out in the past.

Hmm, what does all models mean? I think many PyTorch models are supported by the QNN delegates, but not all models (I wish)

For any model supported by QNN, do we expect it can work on any of the listed SoCs?

@guangy10,
Yes, I believe that any model supported by QNN should work on any SoCs list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

enhancementNot as big of a feature, but technically not a bug. Should be easy to fixmodule: docIssues related to documentation, both in docs/ and inlined in codetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

    Development

    No branches or pull requests

      Participants

      @cccclai@guangy10@winskuo-quic

      Issue actions

        Provide clear guidance on required QNN versions and SoC serials · Issue #8654 · pytorch/executorch