It looks like it installed the python packages for CUDA11.8. Do you have any another modules installed that has CUDA working?
Yes I have
Object Detection (YOLOv5 6.2) 1.9.1 Running just fine on the gpu.
It looks like it installed the python packages for CUDA11.8. Do you have any another modules installed that has CUDA working?
You might need to post your issue on CodeProject.AI forum. I do not use Linux and Chris for CodeProject.AI worked on support for Linux. I am not sure if he had GPU working in Linux, maybe that is why he had it disabled. Sorry I could not help.Yes I have
Object Detection (YOLOv5 6.2) 1.9.1 Running just fine on the gpu.
You might need to post your issue on CodeProject.AI forum. I do not use Linux and Chris for CodeProject.AI worked on support for Linux. I am not sure if he had GPU working in Linux, maybe that is why he had it disabled. Sorry I could not help.
CodeProject.AI Discussions - CodeProject
www.codeproject.com
It could be because your GPU is old and you are using CUDA 12.3.2. Try using CUDA 11.8 and cuDNN for CUDA 11.xI just installed a GeForce GTX 1650 graphics card on my Blue Iris server, the latest NVidia drivers, CUDA 12.3.2, CUDNN 9.0.0, and then I uninstalled, wiped, and reinstalled CodeProject.AI (version 2.6.5) and the ALPR module.
All of the modules are now using the GPU. However, I have a problem with the ALPR module. Whenever Blue Iris sends data to ALPR, OR whenever I upload an image for analysis through the CPAI Explorer, ALPR crashes and restarts:
View attachment 188343
(As you can see, Object Detection works with the GPU just fine.)
When I disable GPU for ALPR, it works just fine. But when GPU is enabled, it crashes consistently without being able to complete a single analysis.
Any ideas?
It could be because your GPU is old and you are using CUDA 12.3.2. Try using CUDA 11.8 and cuDNN for CUDA 11.x
Yes, because the modules need to be configured for the new CUDA version.Thanks. Would this require a reinstall of CodeProject.AI?
This is normal, I use the Object Detection module to find the license plate in the imageI still see Object Detection module being triggered for the LPR camera:
This is normal, I use the Object Detection module to find the license plate in the image
[
{
"api":"alpr",
"found":{
"success":true,
"processMs":668,
"inferenceMs":598,
"predictions":[
{
"confidence":0.97005695104599,
"label":"Plate: 9EVG363",
"plate":"9EVG363",
"x_min":58,
"y_min":75,
"x_max":186,
"y_max":159}
]
,
"message":"Found Plate: 9EVG363",
"moduleId":"ALPR",
"moduleName":"License Plate Reader",
"code":200,
"command":"alpr",
"requestId":"e980fd40-3b35-49a5-b813-f4c497043a99",
"inferenceDevice":"GPU",
"analysisRoundTripMs":3304,
"processedBy":"localhost",
"timestampUTC":"Sun,
03 Mar 2024 19:35:06 GMT"}
}
]
The reason you might be seeing slow times is maybe other cameras are using AI at the same time. Try running the below test to see what times you are getting.Thanks!
With the GPU, the times have gotten shorter but I'm still seeing multi-second analysis roundtrip times. Is this normal? Here's one example:
Code:[ { "api":"alpr", "found":{ "success":true, "processMs":668, "inferenceMs":598, "predictions":[ { "confidence":0.97005695104599, "label":"Plate: 9EVG363", "plate":"9EVG363", "x_min":58, "y_min":75, "x_max":186, "y_max":159} ] , "message":"Found Plate: 9EVG363", "moduleId":"ALPR", "moduleName":"License Plate Reader", "code":200, "command":"alpr", "requestId":"e980fd40-3b35-49a5-b813-f4c497043a99", "inferenceDevice":"GPU", "analysisRoundTripMs":3304, "processedBy":"localhost", "timestampUTC":"Sun, 03 Mar 2024 19:35:06 GMT"} } ]
View attachment 188394
The speed looks on the slow side, what speed were you getting with just CPU. You may also want to try Object Detection (YOLOv5 .NET) module instead of the Object Detection (YOLOv5 6.2) module. The Object Detection (YOLOv5 .NET) module will also use your Nvidia GPU.
The speed looks on the slow side, what speed were you getting with just CPU. You may also want to try Object Detection (YOLOv5 .NET) module instead of the Object Detection (YOLOv5 6.2) module. The Object Detection (YOLOv5 .NET) module will also use your Nvidia GPU.
CPU | GPU | GPU + YOLOv5 .NET | |
Roundtrip | 905 | 696 | 675 |
Processing | 508 | 312 | 320 |
Inference | 411 | 224 | 238 |
What you can try is a zone crossing so the camera triggers when the vehicle is in the middle of the FOV.Here's a possible Blue Iris/ALPR bug:
Blue iris records the first captured number, but in this case, the whole plate has NOT yet come into the picture. As a result, the captured plate number is wrong:
View attachment 188581
In fact, there's another "1" at the end of the plate.
I can tune Blue Iris, but the fact is that cars come and go at various speeds and it's hard to get a setting that works optimally in all scenarios.