Skip to content

Conversation

n1ck-guo
Copy link
Contributor

Type of Change

feature

Description

Refact gptq to support runing on gaudi

Expected Behavior & Potential Risk

None

How has this PR been tested?

local test pass

Dependency Change?

habana_frameworks

Signed-off-by: n1ck-guo <[email protected]>
@n1ck-guo n1ck-guo requested review from xin3he and wenhuach21 March 28, 2024 07:35
Copy link

github-actions bot commented Mar 28, 2024

⚡ Required checks status: All passing 🟢

Groups summary

🟢 Code Scan Tests workflow
Check ID Status Error details
Code-Scan success
Code-Scan (Bandit Code Scan Bandit) success
Code-Scan (DocStyle Code Scan DocStyle) success
Code-Scan (Pylint Code Scan Pylint) success

These checks are required after the changes to neural_compressor/torch/algorithms/weight_only/gptq.py, neural_compressor/torch/utils/auto_accelerator.py.

🟢 Model Tests 3x workflow
Check ID Status Error details
Model-Test-3x success
Model-Test-3x (Generate Report GenerateReport) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4_dq_bnb) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4_dq_ggml) success

These checks are required after the changes to neural_compressor/torch/algorithms/weight_only/gptq.py, neural_compressor/torch/utils/auto_accelerator.py.

🟢 Unit Tests 3x-PyTorch workflow
Check ID Status Error details
UT-3x-Torch success
UT-3x-Torch (Coverage Compare CollectDatafiles) success
UT-3x-Torch (Unit Test 3x Torch Unit Test 3x Torch) success
UT-3x-Torch (Unit Test 3x Torch baseline Unit Test 3x Torch baseline) success

These checks are required after the changes to neural_compressor/torch/algorithms/weight_only/gptq.py, neural_compressor/torch/utils/auto_accelerator.py.


Thank you for your contribution! 💜

Note
This comment is automatically generated and will be updates every 180 seconds within the next 6 hours. If you have any other questions, contact chensuyue or XuehaoSun for help.

@n1ck-guo n1ck-guo requested a review from yiliu30 March 28, 2024 07:35
@n1ck-guo n1ck-guo merged commit 14868c0 into master Apr 2, 2024
@n1ck-guo n1ck-guo deleted the hengguo/gptq_gaudi branch April 2, 2024 06:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants