CodeProject.AI Version 2.0

[MikeLud1]

Thank you for the info.

I made the changes like you suggested.

This is my current reaction time now

AI: [Objects] car:66% [690,334 1095,485] 5667ms

This is far from 6.2 and 17ms

May I ask if I am doing anything wrong?

I have 2 IPC-Color4K-T and a MINI PTZ. I don't think camera models matters, but just in case.

Please see attached picture of my pc spec and a confirmation that I have enable the correct one.

Thank you for your help.

Did you make the below changes to all your cameras

 

[dubber]

Did you make the below changes to all your cameras

View attachment 165437

Yes I did

 

[MikeLud1]

Yes I did

Post a screenshot of you main AI settings and one of your camera's AI settings

 

[dubber]

Is this what you're looking for?

Please let me know if I miss something or not the right screenshots.

Post a screenshot of you main AI settings and one of your camera's AI settings

 

[MikeLud1]

Is this what you're looking for?

Please let me know if I miss something or not the right screenshots.

Everything looks fine, try running a test using Explorer and see what detection time you are getting there. You can also run the Benchmark. When running the first test you should see about 300ms to 400ms and the Benchmark at about 10 operations per a second.

 

[dubber]

Please see below test results. This is using chrome. Not sure if that makes any difference vs IE

When I was performing benchmark test, I sometimes see "Unable to contact AI server"

Everything looks fine, try running a test using Explorer and see what detection time you are getting there. You can also run the Benchmark. When running the first test you should see about 300ms to 400ms and the Benchmark at about 10 operations per a second.

View attachment 165449
View attachment 165450

 

[David L]

Please see below test results. This is using chrome. Not sure if that makes any difference vs IE

When I was performing benchmark test, I sometimes see "Unable to contact AI server"

View attachment 165454

Can you provide this for us/Mike?



Also, make sure your Anti-Virus/Firewall is not causing issues. I have mine Off on my BI PC. You may want to Turn it Off to test...just not sure what Exclusions are needed with CPAI. When mine was running I Excluded my Blue Iris folders...

 

[dubber]

I'm also getting a lot of "AI: Alert cancelled [occupied] 4896ms"

I have excluded BI folders already from firewall.

 

[David L]

I'm also getting a lot of "AI: Alert cancelled [occupied] 4896ms"

I have excluded BI folders already from firewall.

View attachment 165458

What Video Card do you have? I notice the GPU is using Intel HD but showing AMD Radeon Processor. Forgive my ignorance, does Intel use AMD GPU Procs?


EDIT: Actually it looks like you have two GPUs...you may need to turn off the Intel Graphics in your BIOS if you have a Radeon Video Card installed...

EDIT2: Are you running BI on a Laptop?

Intel HD Graphics And Radeon Graphics

Hope you can help me with this one, and help me to understand, I'm not really to AMD stuff. I just would like to ask multiple questions regarding with this matter. I have little understanding with ...

superuser.com

 

[dubber]

What Video Card do you have? I notice the GPU is using Intel HD but showing AMD Radeon Processor. Forgive my ignorance, does Intel use AMD GPU Procs?


EDIT: Actually it looks like you have two GPUs...you may need to turn off the Intel Graphics in your BIOS if you have a Radeon Video Card installed...

EDIT2: Are you running BI on a Laptop?

Intel HD Graphics And Radeon Graphics

Hope you can help me with this one, and help me to understand, I'm not really to AMD stuff. I just would like to ask multiple questions regarding with this matter. I have little understanding with ...

superuser.com

Will having dual video cards, one built in and one "external" cause these types of issues?

No I'm not using a laptop. I have dell 7050

 

[David L]

Will having dual video cards, one built in and one "external" cause these types of issues?

No I'm not using a laptop. I have dell 7050

Not sure I am just observing. If it were me I would turn off the Intel HD graphics...

 

[David L]

Will having dual video cards, one built in and one "external" cause these types of issues?

No I'm not using a laptop. I have dell 7050

Here is my thought, of your two GPUs, you would want the AMD Radeon to be the one CPAI uses...

 

[MikeLud1]

Not sure I am just observing. If it were me I would turn off the Intel HD graphics...

Go to Device Manager and see if both GPU show up. I think you can go into the BOIS and disable the Intel GPU or just delete the device.

 

[David L]

Will having dual video cards, one built in and one "external" cause these types of issues?

No I'm not using a laptop. I have dell 7050

CodeProject.AI Version 2.0

Thank you for the info. I made the changes like you suggested. This is my current reaction time now AI: [Objects] car:66% [690,334 1095,485] 5667ms This is far from 6.2 and 17ms May I ask if I am doing anything wrong? I have 2 IPC-Color4K-T and a MINI PTZ. I don't think camera models...

ipcamtalk.com

 

[dubber]

I have disable the 2nd video card via bios.

Go to Device Manager and see if both GPU show up. I think you can go into the BOIS and disable the Intel GPU or just delete the device.

View attachment 165461

 

[actran]

@dubber In addition to @MikeLud1 original advice about "unchecking" main stream, make sure you configured the substream for every camera. That way, CP.AI will use substream image for analysis and will be faster. See screenshot below for example---your camera settings may differ from mine.

Also, uncheck "Static object analysis". Unless you need to check for a parked car, turn off this option. If you have this option enabled, you are telling BI5 to send images to CP.AI at regular intervals, increasing load on CP.AI.

There are other ways to increase AI speed like turning off default object detection and using Mike's custom model like ipcam-general for example.

 

[MikeLud1]

I have disable the 2nd video card via bios.

Did disabling the Intel GPU help

 

[dubber]

AI: [Objects] car:69% [343,380 785,552] 438ms
0 6/15/2023 4:54:17.147 AM DrivewayRight AI: [Objects] car:57% [735,343 1294,456] 438ms
0 6/14/2023 11:24:12.468 PM DrivewayRight AI: [Objects] car:73% [362,378 783,550] 1351ms
0 6/14/2023 11:18:38.607 PM DrivewayRight AI: [Objects] car:66% [363,379 781,551] 3355ms

I don't think it did

Did disabling the Intel GPU help

 

[JonSnow]

How can i get CPAI to use GPU instead of CPU, do i need to replace my custom models with ones that support GPU?

I do not have a Nvidia GPU and would like to make use of my Intel iGPU.

24:20:11:
24:20:11:Module 'Object Detection (YOLOv5 .NET)' (ID: ObjectDetectionNet)
24:20:11:Active:      True
24:20:11:GPU:         Support enabled
24:20:11:Parallelism: 0
24:20:11:Platforms:   windows,linux,linux-arm64,macos,macos-arm64
24:20:11:FilePath:    ObjectDetectionNet.exe
24:20:11:ModulePath:  ObjectDetectionNet
24:20:11:Install:     PreInstalled
24:20:11:Runtime:     execute
24:20:11:Queue:       objectdetection_queue
24:20:11:Start pause: 1 sec
24:20:11:Valid:       True
24:20:11:Environment Variables
24:20:11:CPAI_MODULE_SUPPORT_GPU = False
24:20:11:CUSTOM_MODELS_DIR       = %CURRENT_MODULE_PATH%\custom-models
24:20:11:MODELS_DIR              = %CURRENT_MODULE_PATH%\assets
24:20:11:MODEL_SIZE              = MEDIUM
24:20:11:USE_CUDA                = False
24:20:11:

 

[shannondalebreaux]

To get better times do the below.

Make sure Use main stream if available is unchecked
View attachment 165425

Use Object Detection (YOLOv5 .NET) Module and make sure GPU is Enabled
View attachment 165431

What does "t" on the "to cancel" field do?