Repository navigation
onnxruntime-gpu 1.10Β #5916
Description
Search before asking
- I have searched the YOLOv5 issues and found no similar feature requests.
Description
Using onnxruntime-gpu 1.10, the following error will occur.
raise ValueError("This ORT build has {} enabled. ".format(available_providers) +
ValueError: This ORT build has ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] enabled. Since ORT 1.9, you are required to explicitly set the providers parameter when instantiating InferenceSession. For example, onnxruntime.InferenceSession(..., providers=['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'], ...)
Use case
onnxruntime-gpu 1.10 requires providers
elif onnx: # ONNX Runtime
LOGGER.info(f'Loading {w} for ONNX Runtime inference...')
check_requirements(('onnx', 'onnxruntime-gpu' if torch.cuda.is_available() else 'onnxruntime'))
import onnxruntime
if torch.cuda.is_available():
session = onnxruntime.InferenceSession(w, None, providers=["CUDAExecutionProvider"])
else:
session = onnxruntime.InferenceSession(w, None)
Additional
No response
Are you willing to submit a PR?
- Yes I'd like to help by submitting a PR!
Reacted by HeII0W0rId
Activity
github-actions commentedon Dec 8, 2021
π Hello @guishilike, thank you for your interest in YOLOv5 π! Please visit our βοΈ Tutorials to get started, where you can find quickstart guides for simple tasks like Custom Data Training all the way to advanced concepts like Hyperparameter Evolution.
If this is a π Bug Report, please provide screenshots and minimum viable code to reproduce your issue, otherwise we can not help you.
If this is a custom training β Question, please provide as much information as possible, including dataset images, training logs, screenshots, and a public link to online W&B logging if available.
For business inquiries or professional support requests please visit https://ultralytics.com or email Glenn Jocher at glenn.jocher@ultralytics.com.
Requirements
Python>=3.6.0 with all requirements.txt installed including PyTorch>=1.7. To get started:
$ git clone https://github.com/ultralytics/yolov5 $ cd yolov5 $ pip install -r requirements.txtEnvironments
YOLOv5 may be run in any of the following up-to-date verified environments (with all dependencies including CUDA/CUDNN, Python and PyTorch preinstalled):
Status
If this badge is green, all YOLOv5 GitHub Actions Continuous Integration (CI) tests are currently passing. CI tests verify correct operation of YOLOv5 training (train.py), validation (val.py), inference (detect.py) and export (export.py) on MacOS, Windows, and Ubuntu every 24 hours and on every commit.
glenn-jocher commentedon Dec 8, 2021
@guishilike thanks for the bug report! I'm able to reproduce. I will work on a fix for this.
Add ONNX inference providers
Add ONNX inference providers (#5918)
glenn-jocher commentedon Dec 8, 2021
@guishilike good news π! Your original issue may now be fixed β in PR #5918. To receive this update:
git pullfrom within youryolov5/directory orgit clone https://github.com/ultralytics/yolov5againmodel = torch.hub.load('ultralytics/yolov5', 'yolov5s', force_reload=True)sudo docker pull ultralytics/yolov5:latestto update your imageThank you for spotting this issue and informing us of the problem. Please let us know if this update resolves the issue for you, and feel free to inform us of any other issues you discover or feature requests that come to mind. Happy trainings with YOLOv5 π!
Update Neuralmagic-YoloV5 integration to v6.1 (#29)
Add ONNX inference providers (ultralytics#5918)
somuchtolearn007 commentedon Nov 10, 2022
I am facing the same issue
This ORT build has ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] enabled. Since ORT 1.9, you are required to explicitly set the providers parameter when instantiating InferenceSession. For example, onnxruntime.InferenceSession(..., providers=['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'], ...)
while I am trying to run SimSwap. How to fix it?
glenn-jocher commentedon Nov 15, 2022
@somuchtolearn007 π hi, thanks for letting us know about this possible problem with YOLOv5 π. We've created a few short guidelines below to help users provide what we need in order to start investigating a possible problem.
How to create a Minimal, Reproducible Example
When asking a question, people will be better able to provide help if you provide code that they can easily understand and use to reproduce the problem. This is referred to by community members as creating a minimum reproducible example. Your code that reproduces the problem should be:
For Ultralytics to provide assistance your code should also be:
git pullorgit clonea new copy to ensure your problem has not already been solved in master.If you believe your problem meets all the above criteria, please close this issue and raise a new one using the π Bug Report template with a minimum reproducible example to help us better understand and diagnose your problem.
Thank you! π
Add ONNX inference providers (#5918)
Muffinxz commentedon Oct 24, 2023
I still have the same issue even after running
model = torch.hub.load('ultralytics/yolov5', 'yolov5s', force_reload=True)
@glenn-jocher
Any help please ?
glenn-jocher commentedon Oct 24, 2023
Hi @Muffinxz,
I apologize for the continued issue you're experiencing. To further investigate this problem, could you please provide us with a minimal reproducible example? This will help us better understand the problem and provide the most appropriate solution.
Additionally, could you provide the following information:
With this information, we'll be in a better position to assist you. Thank you!
Muffinxz commentedon Oct 24, 2023
@glenn-jocher
Sure the version of yolov5 i am using is 7.0.2
the version of pytorch 2.0.1+cu118
The ERROR : ValueError: This ORT build has ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] enabled. Since ORT 1.9, you are required to explicitly set the providers parameter when instantiating InferenceSession. For example, onnxruntime.InferenceSession(..., providers=['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'], ...)
glenn-jocher commentedon Oct 24, 2023
@Muffinxz
Thank you for providing the additional information.
The error message you are encountering, "ValueError: This ORT build has ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] enabled..." suggests that there is an issue with the Open Neural Network Exchange (ONNX) Runtime (ORT) build being used.
Since ORT 1.9, it is now required to explicitly set the providers parameter when instantiating InferenceSession. You can include the desired providers as a list in the providers parameter, for example:
To resolve this issue, you may need to update your ORT installation or check if there are any known compatibility issues between YOLOv5 v7.0.2, PyTorch 1.9, and the version of ORT you have installed.
Please let us know if updating ORT or checking for compatibility issues resolves the problem for you. If you have any further questions or issues, please don't hesitate to ask.
Add ONNX inference providers (#5918)