Skip to content

Conversation

larmoreg
Copy link

@larmoreg larmoreg commented Oct 4, 2024

Trying to do print(repr(request.inputs()[0].triton_dtype())) throws the following exception:

tritonclient.utils.InferenceServerException: [StatusCode.INTERNAL] Failed to process the request(s) for model 'example', message: TypeError: Unable to convert function return value to a Python type! The signature was
	(self: c_python_backend_utils.Tensor) -> TRITONSERVER_datatype_enum

With this change you get something like <TritonDtype.TYPE_FP32: 11>.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

1 participant