Bug about native compilation on NVIDIA Jetson AGX

[chiehpower]

🐛 Bug

After I installed the bazel from scratch on AGX device, I directly build it by bazel. However, I got the error like below.

$ bazel build //:libtrtorch --distdir third_party/distdir/aarch64-linux-gnu         

Starting local Bazel server and connecting to it...
INFO: Repository trtorch_py_deps instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule pip_import defined at:
  /home/nvidia/.cache/bazel/_bazel_nvidia/d7326de2ca76e35cc08b88f9bba7ab43/external/rules_python/python/pip.bzl:51:29: in <toplevel>
ERROR: An error occurred during the fetch of repository 'trtorch_py_deps':
   pip_import failed: Collecting torch==1.5.0 (from -r /home/nvidia/ssd256/github/TRTorch/py/requirements.txt (line 1))
 (  Could not find a version that satisfies the requirement torch==1.5.0 (from -r /home/nvidia/ssd256/github/TRTorch/py/requirements.txt (line 1)) (from versions: 0.1.2, 0.1.2.post1, 0.1.2.post2)
No matching distribution found for torch==1.5.0 (from -r /home/nvidia/ssd256/github/TRTorch/py/requirements.txt (line 1))
)
ERROR: no such package '@trtorch_py_deps//': pip_import failed: Collecting torch==1.5.0 (from -r /home/nvidia/ssd256/github/TRTorch/py/requirements.txt (line 1))
 (  Could not find a version that satisfies the requirement torch==1.5.0 (from -r /home/nvidia/ssd256/github/TRTorch/py/requirements.txt (line 1)) (from versions: 0.1.2, 0.1.2.post1, 0.1.2.post2)
No matching distribution found for torch==1.5.0 (from -r /home/nvidia/ssd256/github/TRTorch/py/requirements.txt (line 1))
)
INFO: Elapsed time: 8.428s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded)

If I used python3 setup.py install, I got the error below:

running install
building libtrtorch
INFO: Build options --compilation_mode, --cxxopt, --define, and 1 more have changed, discarding analysis cache.
INFO: Repository tensorrt instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule http_archive defined at:
  /home/nvidia/.cache/bazel/_bazel_nvidia/d7326de2ca76e35cc08b88f9bba7ab43/external/bazel_tools/tools/build_defs/repo/http.bzl:336:31: in <toplevel>
WARNING: Download from https://developer.nvidia.com/compute/machine-learning/tensorrt/secure/7.1/tars/TensorRT-7.1.3.4.Ubuntu-18.04.x86_64-gnu.cuda-10.2.cudnn8.0.tar.gz failed: class java.io.IOException GET returned 403 Forbidden
ERROR: An error occurred during the fetch of repository 'tensorrt':
   java.io.IOException: Error downloading [https://developer.nvidia.com/compute/machine-learning/tensorrt/secure/7.1/tars/TensorRT-7.1.3.4.Ubuntu-18.04.x86_64-gnu.cuda-10.2.cudnn8.0.tar.gz] to /home/nvidia/.cache/bazel/_bazel_nvidia/d7326de2ca76e35cc08b88f9bba7ab43/external/tensorrt/TensorRT-7.1.3.4.Ubuntu-18.04.x86_64-gnu.cuda-10.2.cudnn8.0.tar.gz: GET returned 403 Forbidden
INFO: Repository libtorch_pre_cxx11_abi instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule http_archive defined at:
  /home/nvidia/.cache/bazel/_bazel_nvidia/d7326de2ca76e35cc08b88f9bba7ab43/external/bazel_tools/tools/build_defs/repo/http.bzl:336:31: in <toplevel>
ERROR: /home/nvidia/ssd256/github/TRTorch/core/BUILD:10:11: //core:core depends on @tensorrt//:nvinfer in repository @tensorrt which failed to fetch. no such package '@tensorrt//': java.io.IOException: Error downloading [https://developer.nvidia.com/compute/machine-learning/tensorrt/secure/7.1/tars/TensorRT-7.1.3.4.Ubuntu-18.04.x86_64-gnu.cuda-10.2.cudnn8.0.tar.gz] to /home/nvidia/.cache/bazel/_bazel_nvidia/d7326de2ca76e35cc08b88f9bba7ab43/external/tensorrt/TensorRT-7.1.3.4.Ubuntu-18.04.x86_64-gnu.cuda-10.2.cudnn8.0.tar.gz: GET returned 403 Forbidden
ERROR: Analysis of target '//cpp/api/lib:libtrtorch.so' failed; build aborted: Analysis failed
INFO: Elapsed time: 18.044s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded, 62 targets configured)

Is there any idea about this?

To Reproduce

Steps to reproduce the behavior:

1. Install bazel from here
2. Use this command:

bazel build //:libtrtorch --distdir third_party/distdir/aarch64-linux-gnu         

Environment

Build information about the TRTorch compiler can be found by turning on debug messages

• PyTorch Version: 1.15.0
• JetPack Version: 4.4
• How you installed PyTorch: from here
• Python version: 3.6
• CUDA version: 10.2
• GPU models and configuration: AGX jetson device
• TRT version default is 7.1.0.16 on JetPack 4.4
• bazel version: 3.4.0

Thank you

BR,
Chieh

[chiehpower]

After I modified the workspace content, comment out somethings and uncomment and I got the new error messages.

Here is my WORKSPACE

workspace(name = "TRTorch")

load("@bazel_tools//tools/build_defs/repo:http.bzl", "http_archive")
load("@bazel_tools//tools/build_defs/repo:git.bzl", "git_repository")

git_repository(
    name = "rules_python",
    remote = "https://github.com/bazelbuild/rules_python.git",
    commit = "4fcc24fd8a850bdab2ef2e078b1de337eea751a6",
    shallow_since = "1589292086 -0400"
)

load("@rules_python//python:repositories.bzl", "py_repositories")
py_repositories()

load("@rules_python//python:pip.bzl", "pip_repositories", "pip3_import")
pip_repositories()

http_archive(
    name = "rules_pkg",
    url = "https://github.com/bazelbuild/rules_pkg/releases/download/0.2.4/rules_pkg-0.2.4.tar.gz",
    sha256 = "4ba8f4ab0ff85f2484287ab06c0d871dcb31cc54d439457d28fd4ae14b18450a",
)

load("@rules_pkg//:deps.bzl", "rules_pkg_dependencies")
rules_pkg_dependencies()

git_repository(
    name = "googletest",
    remote = "https://github.com/google/googletest",
    commit = "703bd9caab50b139428cea1aaff9974ebee5742e",
    shallow_since = "1570114335 -0400"
)

# CUDA should be installed on the system locally
new_local_repository(
    name = "cuda",
    path = "/usr/local/cuda-10.2/",
    build_file = "@//third_party/cuda:BUILD",
)

new_local_repository(
    name = "cublas",
    path = "/usr",
    build_file = "@//third_party/cublas:BUILD",
)

#############################################################################################################
# Tarballs and fetched dependencies (default - use in cases when building from precompiled bin and tarballs)
#############################################################################################################

http_archive(
    name = "libtorch",
    build_file = "@//third_party/libtorch:BUILD",
    strip_prefix = "libtorch",
    urls = ["https://download.pytorch.org/libtorch/cu102/libtorch-cxx11-abi-shared-with-deps-1.5.1.zip"],
    sha256 = "cf0691493d05062fe3239cf76773bae4c5124f4b039050dbdd291c652af3ab2a"
)

http_archive(
    name = "libtorch_pre_cxx11_abi",
    build_file = "@//third_party/libtorch:BUILD",
    strip_prefix = "libtorch",
    sha256 = "818977576572eadaf62c80434a25afe44dbaa32ebda3a0919e389dcbe74f8656",
    urls = ["https://download.pytorch.org/libtorch/cu102/libtorch-shared-with-deps-1.5.1.zip"],
)

# Download these tarballs manually from the NVIDIA website
# Either place them in the distdir directory in third_party and use the --distdir flag
# or modify the urls to "file:///<PATH TO TARBALL>/<TARBALL NAME>.tar.gz

#http_archive(
#    name = "cudnn",
#    urls = ["https://developer.nvidia.com/compute/machine-learning/cudnn/secure/8.0.1.13/10.2_20200626/cudnn-10.2-linux-x64-v8.0.1.13.tgz"],
#    build_file = "@//third_party/cudnn/archive:BUILD",
#    sha256 = "0c106ec84f199a0fbcf1199010166986da732f9b0907768c9ac5ea5b120772db",
#    strip_prefix = "cuda"
#)

#http_archive(
#    name = "tensorrt",
#    urls = ["https://developer.nvidia.com/compute/machine-learning/tensorrt/secure/7.1/tars/TensorRT-7.1.3.4.Ubuntu-18.04.x86_64-gnu.cuda-10.2.cudnn8.0.tar.gz"],
#    build_file = "@//third_party/tensorrt/archive:BUILD",
#    sha256 = "9205bed204e2ae7aafd2e01cce0f21309e281e18d5bfd7172ef8541771539d41",
#    strip_prefix = "TensorRT-7.1.3.4"
#)

####################################################################################
# Locally installed dependencies (use in cases of custom dependencies or aarch64)
####################################################################################

# NOTE: In the case you are using just the pre-cxx11-abi path or just the cxx11 abi path
# with your local libtorch, just point deps at the same path to satisfy bazel.

# NOTE: NVIDIA's aarch64 PyTorch (python) wheel file uses the CXX11 ABI unlike PyTorch's standard
# x86_64 python distribution. If using NVIDIA's version just point to the root of the package
# for both versions here and do not use --config=pre-cxx11-abi

#new_local_repository(
#    name = "libtorch",
#    path = "/usr/local/lib/python3.6/dist-packages/torch",
#    build_file = "third_party/libtorch/BUILD"
#)

#new_local_repository(
#    name = "libtorch_pre_cxx11_abi",
#    path = "/usr/local/lib/python3.6/dist-packages/torch",
#    build_file = "third_party/libtorch/BUILD"
#)

new_local_repository(
    name = "cudnn",
    path = "/usr/",
    build_file = "@//third_party/cudnn/local:BUILD"
)

new_local_repository(
   name = "tensorrt",
   path = "/usr/",
   build_file = "@//third_party/tensorrt/local:BUILD"
)

#########################################################################
# Testing Dependencies (optional - comment out on aarch64)
#########################################################################
#pip3_import(
#    name = "trtorch_py_deps",
#    requirements = "//py:requirements.txt"
#)

#load("@trtorch_py_deps//:requirements.bzl", "pip_install")
#pip_install()

#pip3_import(
#   name = "py_test_deps",
#   requirements = "//tests/py:requirements.txt"
#)

#load("@py_test_deps//:requirements.bzl", "pip_install")
#pip_install()

Output:

/home/nvidia/ssd256/github/TRTorch/py $ python3 setup.py install   
                                                                             
running install
building libtrtorch
INFO: Analyzed target //cpp/api/lib:libtrtorch.so (32 packages loaded, 1947 targets configured).
INFO: Found 1 target...
ERROR: /home/nvidia/ssd256/github/TRTorch/cpp/api/lib/BUILD:3:10: Linking of rule '//cpp/api/lib:libtrtorch.so' failed (Exit 1) gcc failed: error executing command /usr/bin/gcc @bazel-out/aarch64-opt/bin/cpp/api/lib/libtrtorch.so-2.params

Use --sandbox_debug to see verbose messages from the sandbox
/usr/bin/ld.gold: warning: skipping incompatible bazel-out/aarch64-opt/bin/_solib_aarch64/_U@libtorch_Upre_Ucxx11_Uabi_S_S_Ctorch___Uexternal_Slibtorch_Upre_Ucxx11_Uabi_Slib/libtorch.so while searching for torch
/usr/bin/ld.gold: error: cannot find -ltorch
/usr/bin/ld.gold: warning: skipping incompatible bazel-out/aarch64-opt/bin/_solib_aarch64/_U@libtorch_Upre_Ucxx11_Uabi_S_S_Ctorch___Uexternal_Slibtorch_Upre_Ucxx11_Uabi_Slib/libtorch_cuda.so while searching for torch_cuda
/usr/bin/ld.gold: error: cannot find -ltorch_cuda
/usr/bin/ld.gold: warning: skipping incompatible bazel-out/aarch64-opt/bin/_solib_aarch64/_U@libtorch_Upre_Ucxx11_Uabi_S_S_Ctorch___Uexternal_Slibtorch_Upre_Ucxx11_Uabi_Slib/libtorch_cpu.so while searching for torch_cpu
/usr/bin/ld.gold: error: cannot find -ltorch_cpu
/usr/bin/ld.gold: warning: skipping incompatible bazel-out/aarch64-opt/bin/_solib_aarch64/_U@libtorch_Upre_Ucxx11_Uabi_S_S_Ctorch___Uexternal_Slibtorch_Upre_Ucxx11_Uabi_Slib/libtorch_global_deps.so while searching for torch_global_deps
/usr/bin/ld.gold: error: cannot find -ltorch_global_deps
/usr/bin/ld.gold: warning: skipping incompatible bazel-out/aarch64-opt/bin/_solib_aarch64/_U@libtorch_Upre_Ucxx11_Uabi_S_S_Cc10_Ucuda___Uexternal_Slibtorch_Upre_Ucxx11_Uabi_Slib/libc10_cuda.so while searching for c10_cuda
/usr/bin/ld.gold: error: cannot find -lc10_cuda
/usr/bin/ld.gold: warning: skipping incompatible bazel-out/aarch64-opt/bin/_solib_aarch64/_U@libtorch_Upre_Ucxx11_Uabi_S_S_Cc10___Uexternal_Slibtorch_Upre_Ucxx11_Uabi_Slib/libc10.so while searching for c10
/usr/bin/ld.gold: error: cannot find -lc10
collect2: error: ld returned 1 exit status
Target //cpp/api/lib:libtrtorch.so failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 285.202s, Critical Path: 55.46s
INFO: 51 processes: 51 linux-sandbox.
FAILED: Build did NOT complete successfully

[narendasan]

Sorry about this, we are still in the process of writing the documentation on how to build on aarch64. You should use all local repository sources for dependencies. Right now you are trying to pull x86_64 libraries from pytorch.org. Comment out all http_archive sources as well as the test deps like you did and use all new_local_repository sources with PyTorch 1.5.0 python package for Jetson installed (https://forums.developer.nvidia.com/t/pytorch-for-jetson-nano-version-1-5-0-now-available/72048) and configure the paths for both libtorch and libtorch_pre_cxx11_abi to point to the root of the python package directory. The default should work if you install pytorch with sudo pip install.

[chiehpower]

Sorry about this, we are still in the process of writing the documentation on how to build on aarch64. You should use all local repository sources for dependencies. Right now you are trying to pull x86_64 libraries from pytorch.org. Comment out all http_archive sources as well as the test deps like you did and use all new_local_repository sources with PyTorch 1.5.0 python package for Jetson installed (https://forums.developer.nvidia.com/t/pytorch-for-jetson-nano-version-1-5-0-now-available/72048) and configure the paths for both libtorch and libtorch_pre_cxx11_abi to point to the root of the python package directory. The default should work if you install pytorch with sudo pip install.

Hi @narendasan ,

Thanks for your reply!

First test

As I followed your advice to comment out all of http_archive including rules_pkg, it got error.

http_archive(
    name = "rules_pkg",
    url = "https://github.com/bazelbuild/rules_pkg/releases/download/0.2.4/rules_pkg-0.2.4.tar.gz",
    sha256 = "4ba8f4ab0ff85f2484287ab06c0d871dcb31cc54d439457d28fd4ae14b18450a",
)

Error message:

$ python3 setup.py install                                        
running install
building libtrtorch
Starting local Bazel server and connecting to it...
ERROR: Failed to load Starlark extension '@rules_pkg//:deps.bzl'.
Cycle in the workspace file detected. This indicates that a repository is used prior to being defined.
The following chain of repository dependencies lead to the missing definition.
 - @rules_pkg
This could either mean you have to add the '@rules_pkg' repository with a statement like `http_archive` in your WORKSPACE file (note that transitive dependencies are not added automatically), or move an existing definition earlier in your WORKSPACE file.
ERROR: cycles detected during target parsing
INFO: Elapsed time: 4.307s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded)

Second test

I remove the old repository and git clone again in order to confirm my repository which is the latest version.
In the WORKSPACE, comment out all of http_archive except rules_pkg part, and uncommnet all of new_local_repository.
I enclosed my WORKSPACE file if you can check.
WORKSPACE

Commnad:

sudo bazel build //:libtrtorch --distdir third_party/distdir/aarch64-linux-gnu

Output:

Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: non-existent distdir /home/nvidia/ssd256/github/TRTorch/third_party/distdir/aarch64-linux-gnu
INFO: non-existent distdir /home/nvidia/ssd256/github/TRTorch/third_party/distdir/aarch64-linux-gnu
INFO: non-existent distdir /home/nvidia/ssd256/github/TRTorch/third_party/distdir/aarch64-linux-gnu
INFO: Analyzed target //:libtrtorch (39 packages loaded, 2472 targets configured).
INFO: Found 1 target...
ERROR: /home/nvidia/ssd256/github/TRTorch/cpp/trtorchc/BUILD:10:10: C++ compilation of rule '//cpp/trtorchc:trtorchc' failed (Exit 1) gcc failed: error executing command /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer '-std=c++0x' -MD -MF ... (remaining 63 argument(s) skipped)

Use --sandbox_debug to see verbose messages from the sandbox
cpp/trtorchc/main.cpp: In function 'bool checkRtol(const at::Tensor&, std::vector<at::Tensor>, float)':
cpp/trtorchc/main.cpp:23:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kDEBUG, std::string("Max Difference: ") + std::to_string(diff.abs().max().item<float>()));
              ^~~~~~~
cpp/trtorchc/main.cpp:23:36: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kDEBUG, std::string("Max Difference: ") + std::to_string(diff.abs().max().item<float>()));
                                    ^~~~~~~
cpp/trtorchc/main.cpp:24:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kDEBUG, std::string("Acceptable Threshold: ") + std::to_string(threshold));
              ^~~~~~~
cpp/trtorchc/main.cpp:24:36: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kDEBUG, std::string("Acceptable Threshold: ") + std::to_string(threshold));
                                    ^~~~~~~
cpp/trtorchc/main.cpp: In function 'std::vector<long int> parseSingleDim(std::__cxx11::string)':
cpp/trtorchc/main.cpp:54:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kERROR, "Shapes need dimensions delimited by comma in parentheses, \"(N,..,C,H,W)\"\n e.g \"(3,3,200,200)\"");
              ^~~~~~~
cpp/trtorchc/main.cpp:54:36: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kERROR, "Shapes need dimensions delimited by comma in parentheses, \"(N,..,C,H,W)\"\n e.g \"(3,3,200,200)\"");
                                    ^~~~~~~
cpp/trtorchc/main.cpp: In function 'trtorch::ExtraInfo::InputRange parseDynamicDim(std::__cxx11::string)':
cpp/trtorchc/main.cpp:78:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Dynamic shapes need three sets of dimensions delimited by semi-colons, \"[(MIN_N,..,MIN_C,MIN_H,MIN_W);(OPT_N,..,OPT_C,OPT_H,OPT_W);(MAX_N,..,MAX_C,MAX_H,MAX_W)]\"\n e.g \"[(3,3,100,100);(3,3,200,200);(3,3,300,300)]\"");
                  ^~~~~~~
cpp/trtorchc/main.cpp:78:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Dynamic shapes need three sets of dimensions delimited by semi-colons, \"[(MIN_N,..,MIN_C,MIN_H,MIN_W);(OPT_N,..,OPT_C,OPT_H,OPT_W);(MAX_N,..,MAX_C,MAX_H,MAX_W)]\"\n e.g \"[(3,3,100,100);(3,3,200,200);(3,3,300,300)]\"");
                                        ^~~~~~~
cpp/trtorchc/main.cpp: In function 'std::__cxx11::string get_cwd()':
cpp/trtorchc/main.cpp:91:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Unable to get current directory");
                  ^~~~~~~
cpp/trtorchc/main.cpp:91:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Unable to get current directory");
                                        ^~~~~~~
cpp/trtorchc/main.cpp: In function 'std::__cxx11::string real_path(std::__cxx11::string)':
cpp/trtorchc/main.cpp:103:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, std::string("Unable to find file ") + abs_path);
                  ^~~~~~~
cpp/trtorchc/main.cpp:103:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, std::string("Unable to find file ") + abs_path);
                                        ^~~~~~~
cpp/trtorchc/main.cpp: In function 'int main(int, char**)':
cpp/trtorchc/main.cpp:117:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::set_is_colored_output_on(true);
              ^~~~~~~
cpp/trtorchc/main.cpp:118:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kWARNING);
              ^~~~~~~
cpp/trtorchc/main.cpp:118:57: error: 'trtorch::logging' has not been declared
     trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kWARNING);
                                                         ^~~~~~~
cpp/trtorchc/main.cpp:119:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::set_logging_prefix("");
              ^~~~~~~
cpp/trtorchc/main.cpp:175:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kDEBUG);
                  ^~~~~~~
cpp/trtorchc/main.cpp:175:61: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kDEBUG);
                                                             ^~~~~~~
cpp/trtorchc/main.cpp:177:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kINFO);
                  ^~~~~~~
cpp/trtorchc/main.cpp:177:61: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kINFO);
                                                             ^~~~~~~
cpp/trtorchc/main.cpp:179:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kERROR);
                  ^~~~~~~
cpp/trtorchc/main.cpp:179:61: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kERROR);
                                                             ^~~~~~~
cpp/trtorchc/main.cpp:190:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Dimensions should be specified in one of these types \"(N,..,C,H,W)\" \"[(MIN_N,..,MIN_C,MIN_H,MIN_W);(OPT_N,..,OPT_C,OPT_H,OPT_W);(MAX_N,..,MAX_C,MAX_H,MAX_W)]\"\n e.g \"(3,3,300,300)\" \"[(3,3,100,100);(3,3,200,200);(3,3,300,300)]\"");
                      ^~~~~~~
cpp/trtorchc/main.cpp:190:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Dimensions should be specified in one of these types \"(N,..,C,H,W)\" \"[(MIN_N,..,MIN_C,MIN_H,MIN_W);(OPT_N,..,OPT_C,OPT_H,OPT_W);(MAX_N,..,MAX_C,MAX_H,MAX_W)]\"\n e.g \"(3,3,300,300)\" \"[(3,3,100,100);(3,3,200,200);(3,3,300,300)]\"");
                                            ^~~~~~~
cpp/trtorchc/main.cpp:215:32: error: 'trtorch::ptq' has not been declared
     auto calibrator = trtorch::ptq::make_int8_cache_calibrator(calibration_cache_file_path);
                                ^~~
cpp/trtorchc/main.cpp:229:26: error: 'trtorch::logging' has not been declared
                 trtorch::logging::log(trtorch::logging::Level::kERROR, "If targeting INT8 default operating precision with trtorchc, a calibration cache file must be provided");
                          ^~~~~~~
cpp/trtorchc/main.cpp:229:48: error: 'trtorch::logging' has not been declared
                 trtorch::logging::log(trtorch::logging::Level::kERROR, "If targeting INT8 default operating precision with trtorchc, a calibration cache file must be provided");
                                                ^~~~~~~
cpp/trtorchc/main.cpp:234:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid default operating precision, options are [ float | float32 | f32 | half | float16 | f16 | int8 | i8 ]");
                      ^~~~~~~
cpp/trtorchc/main.cpp:234:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid default operating precision, options are [ float | float32 | f32 | half | float16 | f16 | int8 | i8 ]");
                                            ^~~~~~~
cpp/trtorchc/main.cpp:248:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid device type, options are [ gpu | dla ]");
                      ^~~~~~~
cpp/trtorchc/main.cpp:248:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid device type, options are [ gpu | dla ]");
                                            ^~~~~~~
cpp/trtorchc/main.cpp:264:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid engine capability, options are [ default | safe_gpu | safe_dla ]");
                      ^~~~~~~
cpp/trtorchc/main.cpp:264:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid engine capability, options are [ default | safe_gpu | safe_dla ]");
                                            ^~~~~~~
cpp/trtorchc/main.cpp:295:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Error loading the model (path may be incorrect)");
                  ^~~~~~~
cpp/trtorchc/main.cpp:295:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Error loading the model (path may be incorrect)");
                                        ^~~~~~~
cpp/trtorchc/main.cpp:301:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Module is not currently supported by TRTorch");
                  ^~~~~~~
cpp/trtorchc/main.cpp:301:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Module is not currently supported by TRTorch");
                                        ^~~~~~~
cpp/trtorchc/main.cpp:355:30: error: 'trtorch::logging' has not been declared
                     trtorch::logging::log(trtorch::logging::Level::kWARNING, std::string("Maximum numerical deviation for output exceeds set threshold (") + threshold_ss.str() + std::string(")"));
                              ^~~~~~~
cpp/trtorchc/main.cpp:355:52: error: 'trtorch::logging' has not been declared
                     trtorch::logging::log(trtorch::logging::Level::kWARNING, std::string("Maximum numerical deviation for output exceeds set threshold (") + threshold_ss.str() + std::string(")"));
                                                    ^~~~~~~
cpp/trtorchc/main.cpp:359:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kWARNING, "Due to change in operating data type, numerical precision is not checked");
                      ^~~~~~~
cpp/trtorchc/main.cpp:359:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kWARNING, "Due to change in operating data type, numerical precision is not checked");
                                            ^~~~~~~
Target //:libtrtorch failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 190.913s, Critical Path: 39.86s
INFO: 68 processes: 68 processwrapper-sandbox.
FAILED: Build did NOT complete successfully

Obviously the actions are different with previously what I did but it still got wrong.

[narendasan]

I guess I wasnt specific enough, my bad, yes you do need to keep the rules_pkg source, I meant really comment out the http_archive sources for TensorRT, cuDNN and LibTorch and use the new_local_repository versions. Once you use that you do not need to use the distdir command

[chiehpower]

I guess I wasnt specific enough, my bad, yes you do need to keep the rules_pkg source, I meant really comment out the http_archive sources for TensorRT, cuDNN and LibTorch and use the new_local_repository versions. Once you use that you do not need to use the distdir command

Hi @narendasan ,

Thanks for your advice and reply!

I have two tests.

Test to install wheel file

location: ./TRTorch/py

Commnad:

$ sudo python3 setup.py install                                    

Output:

[sudo] password for nvidia: 
running install
building libtrtorch
Starting local Bazel server and connecting to it...
INFO: Analyzed target //cpp/api/lib:libtrtorch.so (32 packages loaded, 1947 targets configured).
INFO: Found 1 target...
Target //cpp/api/lib:libtrtorch.so up-to-date:
  bazel-bin/cpp/api/lib/libtrtorch.so
INFO: Elapsed time: 187.041s, Critical Path: 54.48s
INFO: 52 processes: 52 processwrapper-sandbox.
INFO: Build completed successfully, 509 total actions
creating version file
copying library into module
running build
running build_py
copying trtorch/_version.py -> build/lib.linux-aarch64-3.6/trtorch
running egg_info
writing trtorch.egg-info/PKG-INFO
writing dependency_links to trtorch.egg-info/dependency_links.txt
writing requirements to trtorch.egg-info/requires.txt
writing top-level names to trtorch.egg-info/top_level.txt
/usr/local/lib/python3.6/dist-packages/torch/utils/cpp_extension.py:304: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
  warnings.warn(msg.format('we could not find ninja.'))
reading manifest file 'trtorch.egg-info/SOURCES.txt'
writing manifest file 'trtorch.egg-info/SOURCES.txt'
copying trtorch/lib/libtrtorch.so -> build/lib.linux-aarch64-3.6/trtorch/lib
running build_ext
running install_lib
creating /usr/local/lib/python3.6/dist-packages/trtorch
copying build/lib.linux-aarch64-3.6/trtorch/logging.py -> /usr/local/lib/python3.6/dist-packages/trtorch
copying build/lib.linux-aarch64-3.6/trtorch/__init__.py -> /usr/local/lib/python3.6/dist-packages/trtorch
copying build/lib.linux-aarch64-3.6/trtorch/_compiler.py -> /usr/local/lib/python3.6/dist-packages/trtorch
creating /usr/local/lib/python3.6/dist-packages/trtorch/lib
copying build/lib.linux-aarch64-3.6/trtorch/lib/libtrtorch.so -> /usr/local/lib/python3.6/dist-packages/trtorch/lib
copying build/lib.linux-aarch64-3.6/trtorch/_C.cpython-36m-aarch64-linux-gnu.so -> /usr/local/lib/python3.6/dist-packages/trtorch
copying build/lib.linux-aarch64-3.6/trtorch/_version.py -> /usr/local/lib/python3.6/dist-packages/trtorch
copying build/lib.linux-aarch64-3.6/trtorch/_extra_info.py -> /usr/local/lib/python3.6/dist-packages/trtorch
copying build/lib.linux-aarch64-3.6/trtorch/_types.py -> /usr/local/lib/python3.6/dist-packages/trtorch
byte-compiling /usr/local/lib/python3.6/dist-packages/trtorch/logging.py to logging.cpython-36.pyc
byte-compiling /usr/local/lib/python3.6/dist-packages/trtorch/__init__.py to __init__.cpython-36.pyc
byte-compiling /usr/local/lib/python3.6/dist-packages/trtorch/_compiler.py to _compiler.cpython-36.pyc
byte-compiling /usr/local/lib/python3.6/dist-packages/trtorch/_version.py to _version.cpython-36.pyc
byte-compiling /usr/local/lib/python3.6/dist-packages/trtorch/_extra_info.py to _extra_info.cpython-36.pyc
byte-compiling /usr/local/lib/python3.6/dist-packages/trtorch/_types.py to _types.cpython-36.pyc
running install_egg_info
Copying trtorch.egg-info to /usr/local/lib/python3.6/dist-packages/trtorch-0.0.2-py3.6.egg-info
running install_scripts

There is no error message, but the thing is that I cannot find the name of trtorch folder in the /usr/local/lib/python3.6/dist-packages/. Also, If I type import trtorch in python3, it cannot find this module.

$ python3                                                     
Python 3.6.9 (default, Apr 18 2020, 01:56:04) 
[GCC 8.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> import torchvision
>>> import trtorch
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.6/dist-packages/trtorch/__init__.py", line 11, in <module>
    from trtorch._compiler import *
  File "/usr/local/lib/python3.6/dist-packages/trtorch/_compiler.py", line 5, in <module>
    import trtorch._C
ImportError: libtrtorch.so: cannot open shared object file: No such file or directory

---

Test the command by bazel

location: ./TRTorch

Commnad:

$ bazel build //:libtrtorch --verbose_failures                                

Output:

INFO: Analyzed target //:libtrtorch (0 packages loaded, 0 targets configured).
INFO: Found 1 target...
ERROR: /home/nvidia/ssd256/github/TRTorch/cpp/trtorchc/BUILD:10:10: C++ compilation of rule '//cpp/trtorchc:trtorchc' failed (Exit 1): gcc failed: error executing command 
  (cd /home/nvidia/.cache/bazel/_bazel_nvidia/d7326de2ca76e35cc08b88f9bba7ab43/sandbox/linux-sandbox/82/execroot/TRTorch && \
  exec env - \
    PATH=/home/nvidia/cmake-3.13.0/bin/:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/src/tensorrt/bin/ \
    PWD=/proc/self/cwd \
  /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer '-std=c++0x' -MD -MF bazel-out/aarch64-fastbuild/bin/cpp/trtorchc/_objs/trtorchc/main.pic.d '-frandom-seed=bazel-out/aarch64-fastbuild/bin/cpp/trtorchc/_objs/trtorchc/main.pic.o' -fPIC -iquote . -iquote bazel-out/aarch64-fastbuild/bin -iquote external/tensorrt -iquote bazel-out/aarch64-fastbuild/bin/external/tensorrt -iquote external/cuda -iquote bazel-out/aarch64-fastbuild/bin/external/cuda -iquote external/cudnn -iquote bazel-out/aarch64-fastbuild/bin/external/cudnn -iquote external/libtorch -iquote bazel-out/aarch64-fastbuild/bin/external/libtorch -iquote external/bazel_tools -iquote bazel-out/aarch64-fastbuild/bin/external/bazel_tools -Ibazel-out/aarch64-fastbuild/bin/cpp/api/_virtual_includes/trtorch -Ibazel-out/aarch64-fastbuild/bin/external/libtorch/_virtual_includes/ATen -Ibazel-out/aarch64-fastbuild/bin/external/libtorch/_virtual_includes/c10_cuda -Ibazel-out/aarch64-fastbuild/bin/external/libtorch/_virtual_includes/c10 -Ibazel-out/aarch64-fastbuild/bin/external/libtorch/_virtual_includes/caffe2 -isystem external/tensorrt/include/aarch64-linux-gnu -isystem bazel-out/aarch64-fastbuild/bin/external/tensorrt/include/aarch64-linux-gnu -isystem external/cuda/include -isystem bazel-out/aarch64-fastbuild/bin/external/cuda/include -isystem external/cudnn/include -isystem bazel-out/aarch64-fastbuild/bin/external/cudnn/include -isystem external/libtorch/include -isystem bazel-out/aarch64-fastbuild/bin/external/libtorch/include -isystem external/libtorch/include/torch/csrc/api/include -isystem bazel-out/aarch64-fastbuild/bin/external/libtorch/include/torch/csrc/api/include '-fdiagnostics-color=always' '-std=c++14' -fno-canonical-system-headers -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c cpp/trtorchc/main.cpp -o bazel-out/aarch64-fastbuild/bin/cpp/trtorchc/_objs/trtorchc/main.pic.o)
Execution platform: @local_config_platform//:host

Use --sandbox_debug to see verbose messages from the sandbox gcc failed: error executing command 
  (cd /home/nvidia/.cache/bazel/_bazel_nvidia/d7326de2ca76e35cc08b88f9bba7ab43/sandbox/linux-sandbox/82/execroot/TRTorch && \
  exec env - \
    PATH=/home/nvidia/cmake-3.13.0/bin/:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/src/tensorrt/bin/ \
    PWD=/proc/self/cwd \
  /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer '-std=c++0x' -MD -MF bazel-out/aarch64-fastbuild/bin/cpp/trtorchc/_objs/trtorchc/main.pic.d '-frandom-seed=bazel-out/aarch64-fastbuild/bin/cpp/trtorchc/_objs/trtorchc/main.pic.o' -fPIC -iquote . -iquote bazel-out/aarch64-fastbuild/bin -iquote external/tensorrt -iquote bazel-out/aarch64-fastbuild/bin/external/tensorrt -iquote external/cuda -iquote bazel-out/aarch64-fastbuild/bin/external/cuda -iquote external/cudnn -iquote bazel-out/aarch64-fastbuild/bin/external/cudnn -iquote external/libtorch -iquote bazel-out/aarch64-fastbuild/bin/external/libtorch -iquote external/bazel_tools -iquote bazel-out/aarch64-fastbuild/bin/external/bazel_tools -Ibazel-out/aarch64-fastbuild/bin/cpp/api/_virtual_includes/trtorch -Ibazel-out/aarch64-fastbuild/bin/external/libtorch/_virtual_includes/ATen -Ibazel-out/aarch64-fastbuild/bin/external/libtorch/_virtual_includes/c10_cuda -Ibazel-out/aarch64-fastbuild/bin/external/libtorch/_virtual_includes/c10 -Ibazel-out/aarch64-fastbuild/bin/external/libtorch/_virtual_includes/caffe2 -isystem external/tensorrt/include/aarch64-linux-gnu -isystem bazel-out/aarch64-fastbuild/bin/external/tensorrt/include/aarch64-linux-gnu -isystem external/cuda/include -isystem bazel-out/aarch64-fastbuild/bin/external/cuda/include -isystem external/cudnn/include -isystem bazel-out/aarch64-fastbuild/bin/external/cudnn/include -isystem external/libtorch/include -isystem bazel-out/aarch64-fastbuild/bin/external/libtorch/include -isystem external/libtorch/include/torch/csrc/api/include -isystem bazel-out/aarch64-fastbuild/bin/external/libtorch/include/torch/csrc/api/include '-fdiagnostics-color=always' '-std=c++14' -fno-canonical-system-headers -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c cpp/trtorchc/main.cpp -o bazel-out/aarch64-fastbuild/bin/cpp/trtorchc/_objs/trtorchc/main.pic.o)
Execution platform: @local_config_platform//:host

Use --sandbox_debug to see verbose messages from the sandbox
cpp/trtorchc/main.cpp: In function 'bool checkRtol(const at::Tensor&, std::vector<at::Tensor>, float)':
cpp/trtorchc/main.cpp:23:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kDEBUG, std::string("Max Difference: ") + std::to_string(diff.abs().max().item<float>()));
              ^~~~~~~
cpp/trtorchc/main.cpp:23:36: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kDEBUG, std::string("Max Difference: ") + std::to_string(diff.abs().max().item<float>()));
                                    ^~~~~~~
cpp/trtorchc/main.cpp:24:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kDEBUG, std::string("Acceptable Threshold: ") + std::to_string(threshold));
              ^~~~~~~
cpp/trtorchc/main.cpp:24:36: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kDEBUG, std::string("Acceptable Threshold: ") + std::to_string(threshold));
                                    ^~~~~~~
cpp/trtorchc/main.cpp: In function 'std::vector<long int> parseSingleDim(std::__cxx11::string)':
cpp/trtorchc/main.cpp:54:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kERROR, "Shapes need dimensions delimited by comma in parentheses, \"(N,..,C,H,W)\"\n e.g \"(3,3,200,200)\"");
              ^~~~~~~
cpp/trtorchc/main.cpp:54:36: error: 'trtorch::logging' has not been declared
     trtorch::logging::log(trtorch::logging::Level::kERROR, "Shapes need dimensions delimited by comma in parentheses, \"(N,..,C,H,W)\"\n e.g \"(3,3,200,200)\"");
                                    ^~~~~~~
cpp/trtorchc/main.cpp: In function 'trtorch::ExtraInfo::InputRange parseDynamicDim(std::__cxx11::string)':
cpp/trtorchc/main.cpp:78:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Dynamic shapes need three sets of dimensions delimited by semi-colons, \"[(MIN_N,..,MIN_C,MIN_H,MIN_W);(OPT_N,..,OPT_C,OPT_H,OPT_W);(MAX_N,..,MAX_C,MAX_H,MAX_W)]\"\n e.g \"[(3,3,100,100);(3,3,200,200);(3,3,300,300)]\"");
                  ^~~~~~~
cpp/trtorchc/main.cpp:78:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Dynamic shapes need three sets of dimensions delimited by semi-colons, \"[(MIN_N,..,MIN_C,MIN_H,MIN_W);(OPT_N,..,OPT_C,OPT_H,OPT_W);(MAX_N,..,MAX_C,MAX_H,MAX_W)]\"\n e.g \"[(3,3,100,100);(3,3,200,200);(3,3,300,300)]\"");
                                        ^~~~~~~
cpp/trtorchc/main.cpp: In function 'std::__cxx11::string get_cwd()':
cpp/trtorchc/main.cpp:91:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Unable to get current directory");
                  ^~~~~~~
cpp/trtorchc/main.cpp:91:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Unable to get current directory");
                                        ^~~~~~~
cpp/trtorchc/main.cpp: In function 'std::__cxx11::string real_path(std::__cxx11::string)':
cpp/trtorchc/main.cpp:103:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, std::string("Unable to find file ") + abs_path);
                  ^~~~~~~
cpp/trtorchc/main.cpp:103:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, std::string("Unable to find file ") + abs_path);
                                        ^~~~~~~
cpp/trtorchc/main.cpp: In function 'int main(int, char**)':
cpp/trtorchc/main.cpp:117:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::set_is_colored_output_on(true);
              ^~~~~~~
cpp/trtorchc/main.cpp:118:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kWARNING);
              ^~~~~~~
cpp/trtorchc/main.cpp:118:57: error: 'trtorch::logging' has not been declared
     trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kWARNING);
                                                         ^~~~~~~
cpp/trtorchc/main.cpp:119:14: error: 'trtorch::logging' has not been declared
     trtorch::logging::set_logging_prefix("");
              ^~~~~~~
cpp/trtorchc/main.cpp:175:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kDEBUG);
                  ^~~~~~~
cpp/trtorchc/main.cpp:175:61: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kDEBUG);
                                                             ^~~~~~~
cpp/trtorchc/main.cpp:177:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kINFO);
                  ^~~~~~~
cpp/trtorchc/main.cpp:177:61: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kINFO);
                                                             ^~~~~~~
cpp/trtorchc/main.cpp:179:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kERROR);
                  ^~~~~~~
cpp/trtorchc/main.cpp:179:61: error: 'trtorch::logging' has not been declared
         trtorch::logging::set_reportable_log_level(trtorch::logging::Level::kERROR);
                                                             ^~~~~~~
cpp/trtorchc/main.cpp:190:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Dimensions should be specified in one of these types \"(N,..,C,H,W)\" \"[(MIN_N,..,MIN_C,MIN_H,MIN_W);(OPT_N,..,OPT_C,OPT_H,OPT_W);(MAX_N,..,MAX_C,MAX_H,MAX_W)]\"\n e.g \"(3,3,300,300)\" \"[(3,3,100,100);(3,3,200,200);(3,3,300,300)]\"");
                      ^~~~~~~
cpp/trtorchc/main.cpp:190:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Dimensions should be specified in one of these types \"(N,..,C,H,W)\" \"[(MIN_N,..,MIN_C,MIN_H,MIN_W);(OPT_N,..,OPT_C,OPT_H,OPT_W);(MAX_N,..,MAX_C,MAX_H,MAX_W)]\"\n e.g \"(3,3,300,300)\" \"[(3,3,100,100);(3,3,200,200);(3,3,300,300)]\"");
                                            ^~~~~~~
cpp/trtorchc/main.cpp:215:32: error: 'trtorch::ptq' has not been declared
     auto calibrator = trtorch::ptq::make_int8_cache_calibrator(calibration_cache_file_path);
                                ^~~
cpp/trtorchc/main.cpp:229:26: error: 'trtorch::logging' has not been declared
                 trtorch::logging::log(trtorch::logging::Level::kERROR, "If targeting INT8 default operating precision with trtorchc, a calibration cache file must be provided");
                          ^~~~~~~
cpp/trtorchc/main.cpp:229:48: error: 'trtorch::logging' has not been declared
                 trtorch::logging::log(trtorch::logging::Level::kERROR, "If targeting INT8 default operating precision with trtorchc, a calibration cache file must be provided");
                                                ^~~~~~~
cpp/trtorchc/main.cpp:234:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid default operating precision, options are [ float | float32 | f32 | half | float16 | f16 | int8 | i8 ]");
                      ^~~~~~~
cpp/trtorchc/main.cpp:234:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid default operating precision, options are [ float | float32 | f32 | half | float16 | f16 | int8 | i8 ]");
                                            ^~~~~~~
cpp/trtorchc/main.cpp:248:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid device type, options are [ gpu | dla ]");
                      ^~~~~~~
cpp/trtorchc/main.cpp:248:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid device type, options are [ gpu | dla ]");
                                            ^~~~~~~
cpp/trtorchc/main.cpp:264:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid engine capability, options are [ default | safe_gpu | safe_dla ]");
                      ^~~~~~~
cpp/trtorchc/main.cpp:264:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kERROR, "Invalid engine capability, options are [ default | safe_gpu | safe_dla ]");
                                            ^~~~~~~
cpp/trtorchc/main.cpp:295:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Error loading the model (path may be incorrect)");
                  ^~~~~~~
cpp/trtorchc/main.cpp:295:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Error loading the model (path may be incorrect)");
                                        ^~~~~~~
cpp/trtorchc/main.cpp:301:18: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Module is not currently supported by TRTorch");
                  ^~~~~~~
cpp/trtorchc/main.cpp:301:40: error: 'trtorch::logging' has not been declared
         trtorch::logging::log(trtorch::logging::Level::kERROR, "Module is not currently supported by TRTorch");
                                        ^~~~~~~
cpp/trtorchc/main.cpp:355:30: error: 'trtorch::logging' has not been declared
                     trtorch::logging::log(trtorch::logging::Level::kWARNING, std::string("Maximum numerical deviation for output exceeds set threshold (") + threshold_ss.str() + std::string(")"));
                              ^~~~~~~
cpp/trtorchc/main.cpp:355:52: error: 'trtorch::logging' has not been declared
                     trtorch::logging::log(trtorch::logging::Level::kWARNING, std::string("Maximum numerical deviation for output exceeds set threshold (") + threshold_ss.str() + std::string(")"));
                                                    ^~~~~~~
cpp/trtorchc/main.cpp:359:22: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kWARNING, "Due to change in operating data type, numerical precision is not checked");
                      ^~~~~~~
cpp/trtorchc/main.cpp:359:44: error: 'trtorch::logging' has not been declared
             trtorch::logging::log(trtorch::logging::Level::kWARNING, "Due to change in operating data type, numerical precision is not checked");
                                            ^~~~~~~
Target //:libtrtorch failed to build
INFO: Elapsed time: 27.041s, Critical Path: 26.67s
INFO: 1 process: 1 linux-sandbox.
FAILED: Build did NOT complete successfully

Is there any idea for my error messages?
Thank you!

BR,
Chieh

[narendasan]

For error 1. there was a fix today that addresses that issue, the rpath was not getting added to the compile command for the Python bindings. I will investigate your second error and see if i can replicate it.

[narendasan]

Traced the 2nd issue to an API update that happened recently. Latest master should resolve this