Skip to content

ggml-qnn: add Qualcomm QNN(Qualcomm Neural Network,aka Qualcomm AI Engine Direct) backend #6869

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 17 commits into from
Closed

ggml-qnn: add Qualcomm QNN(Qualcomm Neural Network,aka Qualcomm AI Engine Direct) backend #6869

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
b0c3013
ggml: add Qualcomm QNN(Qualcomm Neural Network,aka Qualcomm AI Engine…
jeffzhou2000 Apr 24, 2024
d325088
ggml: add Qualcomm QNN(Qualcomm Neural Network,aka Qualcomm AI Engine…
jeffzhou2000 Apr 24, 2024
c75817b
rebase
jeffzhou2000 Jun 5, 2024
9c872cb
refine ggml-qnn-ut program and script to make reviewers happy
jeffzhou2000 Jun 5, 2024
926a866
review: replace external declaration with NDK header file
jeffzhou2000 Jun 5, 2024
dd29834
add supportive of quantize data type Q8_0
jeffzhou2000 Jun 6, 2024
f4c5303
review: remove unused QNN helper functions
jeffzhou2000 Jun 6, 2024
2fab33d
ggml-qnn: remove static global vars to support multi-instance simulta…
jeffzhou2000 Jun 7, 2024
94ee775
review: remove static global vars to support multi-instance simultane…
jeffzhou2000 Jun 7, 2024
5d691c6
review: put qnn's internal log inside preprocessor diretive
jeffzhou2000 Jun 8, 2024
fdf0272
review: code format using clang-format + manually modification accord…
jeffzhou2000 Jun 8, 2024
3e8b61f
review: fix a memory leak introduced by review modification which exp…
jeffzhou2000 Jun 9, 2024
d38d4a6
npu: probe htp info and capacity of rpc ion memory
jeffzhou2000 Jun 9, 2024
5f8cfe4
ggml-qnn: refine source code of ggml-qnn.cpp to make reviewer more happy
jeffzhou2000 Jun 10, 2024
5269e08
ggml-qnn: refine ggml inference using QNN NPU
jeffzhou2000 Jun 11, 2024
faaa86b
ggml-qnn: refine ggml inference using QNN NPU
jeffzhou2000 Jun 12, 2024
5598fbd
review: make a MVP(Minimum Viable PR) style PR in upstream
jeffzhou2000 Jun 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading