[Question] Is IOutputAllocator::reallocateOutput
guaranteed to be called before context->enqueueV3
returns?
#3875
Labels
triaged
Issue has been triaged by maintainers
Description
I cannot find any information regarding when
IOutputAllocator::reallocateOutput
is called with respect tocontext->enqueueV3
. Is there any guarantee this function is called beforeenqueueV3
returns or should I explicitly synchronize stream?In other words, in the following pseudo-code:
Should I explicitly synchronize the stream after
enqueueV3
for deviceallocator->getDeviceBuffer()
to be valid? Or isallocator->reallocateOutput
guaranteed to be called beforeenqueueV3
returns, in which case stream synchronization is unnecessary?Environment
TensorRT Version:
NVIDIA GPU:
NVIDIA Driver Version:
CUDA Version:
CUDNN Version:
Operating System:
Python Version (if applicable):
Tensorflow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if so, version):
Relevant Files
Model link:
Steps To Reproduce
Commands or scripts:
Have you tried the latest release?:
Can this model run on other frameworks? For example run ONNX model with ONNXRuntime (
polygraphy run <model.onnx> --onnxrt
):The text was updated successfully, but these errors were encountered: