This project will no longer be maintained by Intel.
Intel has ceased development and contributions including, but not limited to, maintenance, bug fixes, new releases, or updates, to this project.
Intel no longer accepts patches to this project.
If you have an ongoing need to use this project, are interested in independently developing it, or would like to maintain patches for the open source software community, please create your own fork of this project.
Contact: [email protected]
Intel® AI Inference Samples provide example code for deploying optimized inference in Intel platforms.
- Serving optimized BERT models with Intel® Extension for PyTorch (IPEX), Intel® Distribution of OpenVINO™ toolkit and Triton Inference Server framework
- Optimized Large Language Model (LLM) GPT-j with Intel® Extension for PyTorch (IPEX)
- Serving optimized DenseNet model with Intel® Extension for PyTorch (IPEX) and Triton Inference Server framework
- Deploy optimized LLM model with Intel® Extension for PyTorch (IPEX) and Torchserve on AWS Sagemaker
Please submit your questions, feature requests, and bug reports on the GitHub issues page.
Intel® AI Inference Samples is licensed under Apache License Version 2.0. Refer to the LICENSE file for the full license text and copyright notice.
This distribution includes third party software governed by separate license terms.
This third party software, even if included with the distribution of the Intel software, may be governed by separate license terms, including without limitation, third party license terms, other Intel software license terms, and open source software license terms. These separate license terms govern your use of the third party programs as set forth in the THIRD-PARTY-PROGRAMS file.
Intel, the Intel logo, OpenVINO, the OpenVINO logo and Intel Xeon are trademarks of Intel Corporation or its subsidiaries.
- Other names and brands may be claimed as the property of others.
©Intel Corporation