Skip to content

Conversation

nicholas-happyverse
Copy link

The current container image for Triton uses Python 3.12 (see below):
image
Also, using Python 3.12 will sometimes have the "GLIBCXX_3.4.32 not found" error for Custom Python Backends created inside the official Nvidia container image (as mentioned in triton-inference-server/server#7913).

In my personal experience, using 3.12 instead of 3.10 for the conda environment and adding the conda install -c conda-forge libstdcxx-ng=13 -y enabled me to create a custom environment without issues.

Was hoping to update the documentation in case anyone else has issues with it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

1 participant