I have nvcc locally, in the container it's "not found", I don't believe it's part of the docker image: codeproject/ai-server:cuda12_2
There are no errors, the .NET YOLO just will not use the GPU, it is clearly using CPU as inference times are 200ms. With YOLOv5, I get inference times of 25ms.
I...