Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

act 自动压缩pytorch_yolo实例中,python onnx--> tensorrt int8推理结果异常 #1834

Open
GDbbq opened this issue Jan 16, 2024 · 1 comment
Assignees

Comments

@GDbbq
Copy link

GDbbq commented Jan 16, 2024

设备

unbuntu20
nvidia 1080ti
cuda 11.7
ternsorrt 8.6
paddleslim 2.6
paddle 2.6

复现过程

  1. 下载链接提供yolov5s.onnx, 跑pytorch_yolo_series样例,得到量化后模型
  2. onnx推理预测,fp32 和 fp16结果均正常, int8没有框;
  3. 运行时,加载tensort模型会打印的消息,可能是造成结果异常的原因;fp32 和 fp16也会打印下面的内容,但是输出的图片结果是正常的。如下图,正常输出的结果
[01/16/2024-03:40:10] [TRT] [E] 3: [executionContext.cpp::setBindingDimensions::1513] Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::setBindingDimensions::1513, condition: engineDims.nbDims == dims.nbDims
)

output

@ceci3 ceci3 self-assigned this Feb 6, 2024
@lizexu123
Copy link
Contributor

这个[01/16/2024-03:40:10] [TRT] [E] 3: [executionContext.cpp::setBindingDimensions::1513] Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::setBindingDimensions::1513, condition: engineDims.nbDims == dims.nbDims
)应该是没什么影响,能跑通就没事,int8的结果正确吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants