🐛 [Bug] Windows crash at runtime

[xsacha]

Bug Description

I created a TRTorch 0.0.3 for Windows and have noticed it crashes at runtime when registering the operators.

Backtrace:

Schema:
trt::execute_engine(Tensor[] inputs, __torch__.torch.classes.tensorrt.Engine engine) -> Tensor[]

Function it dies in, while parsing schema:
https://github.com/pytorch/pytorch/blob/4a3aad354a14edb1337c6214c3d3870c136d5286/torch/csrc/jit/frontend/schema_type_parser.cpp#L307

To Reproduce

Steps to reproduce the behavior:

1. Use Windows
2. Use my precompiled TRTorch
3. Link to TRTorch

Prebuilt is available in PR #152 or for debug library:
trtorch-0.0.3-debug.zip

Expected behavior

Runs

Environment

Build information about the TRTorch compiler can be found by turning on debug messages

• PyTorch Version (e.g., 1.0): 1.6.0-rc3
• CPU Architecture: x64
• OS (e.g., Linux): Windows
• How you installed PyTorch (conda, pip, libtorch, source): libtorch
• Build command you used (if compiling from source):
• Are you using local sources or building from archives:
• Python version: 3.7
• CUDA version: 10.2
• GPU models and configuration: RTX 2060
• Any other relevant information:

[narendasan]

I am currently working required updates to TRTorch to be compatible with 1.6.0. There are some issues i have hit from using the 0.0.3 branch. Perhaps that is the root cause? When I compiled on windows I used the 1.5.1 official build from pytorch.org. Ill see if i can replicate once the update is complete.

[xsacha]

@narendasan Any update on this?

More details, exception is:
Unknown custom class type tensorrt.Engine. Please ensure it is registered.:
trt::execute_engine(Tensor[] inputs, torch.torch.classes.tensorrt.Engine engine) -> Tensor[]
~~~~~~ <--- HERE

[narendasan]

I just wrapped up the update to 1.6.0, so I can start to take a look at this. Do you have a short example program that can replicate this issue? Right now what I see is that some of the example applications we have seem to be able to start up properly without hitting this issue.

[xsacha]

Every model I've tested seems to hit this issue. I couldn't find a way to not reproduce this.

It could be I'm doing something wrong elsewhere. I'd be excited to see a path where this error doesn't occur!

[github-actions]

This issue has not seen activity for 30 days, Remove stale label or comment or this will be closed in 5 days

[github-actions]

This issue has not seen activity for 30 days, Remove stale label or comment or this will be closed in 5 days