Hell Yeah! Direct Deepstack Integration - 5.4.0 - March 31, 2021

[Pentagano]

@sebastiantombs
What I have observed if I have the gtx970 in silent mode instead of the default (Asus GPU tweak 3) the power at idle goes down the 8%
BUT the first trigger from a camera takes about 300ms to wake up the GPU, which seems to be a sleep mode. So about 400+ms for the first photo on DS then fast on the others.
Not so good if you have a super-fast object you want to track but probably ok for normal use and will save a lot of power, idles at 8% and temp in the low 30's.
When it wakes up the GPU it will resume to 28% power after that initial trigger.

 

[sebastiantombs]

I don't follow the power on my setup that closely. I just let the card run the way it wants too. Maybe it adds to my electric bill, probably does, but that's the least of my worries.

 

[Pentagano]

I don't follow the power on my setup that closely. I just let the card run the way it wants too. Maybe it adds to my electric bill, probably does, but that's the least of my worries.

I was mistaken. The power also settles to 8% at idle on the other modes. I also edited the windows power plan for the PCi config to OFF and not have a power savings setting. Not sure how much this will affect the working of the gpu yet. May respond faster if it's been idling?
I think tweaking the NVIDIA control settings so my CPU manages the monitor graphics rather than the GPU made a difference.

I have 5 DS instances, 4 for each exterior cams which are used most for AI and 1 for the inside cams which are not switched on for object detection so often.
Does having a DS server for each camera make a noticeable difference?

Also, is there any way of preventing this slight delay on the first trigger after the power settles to idle 8%?
(or maybe the delay is somewhere else? Perhaps the DS/AI interaction. I have the image folder on the SSD drive)

This is my current set up:



Also just to add you can see the delay each time the triggers start - once running much faster but every 1st snapshot there is a delay. Any ideas?

 

[JL-F1]

I added running two deepstack instances in BI
Before I was at ~150ms per, full rez/high
so for two cameras activated at same time it took about 300ms to be done with both
now it takes ~200ms per and with two cameras it is done in 200ms.

So, it added time but saved time

 

[Pentagano]

I found each instance took almost 900mb of memory so on just 16GB 5 instances took too much.

Got 2 running now. Once the snapshots come in and the gpu power is above 15% then it's fast!

Must be a reason for that initial delay on the first trigger. Am I the only one? Possibly a sleep setting (windows on max power, sleep off etc)
You can see how fast it is from he 4th column

 

[JL-F1]

I have not looked in awhile, but back when I ran AItool and the first windows GPU version of DS, it took ~470ms for the first activation in something like 5mins, then every other one was ~150ms until nothing happened for ~5min. DS commented they knew about this like 'wake time' issue but I have never seen them say it is fixed

 

[Pentagano]

I have not looked in awhile, but back when I ran AItool and the first windows GPU version of DS, it took ~470ms for the first activation in something like 5mins, then every other one was ~150ms until nothing happened for ~5min. DS commented they knew about this like 'wake time' issue but I have never seen them say it is fixed

hmm maybe this is the issue I'm observing then thanks. I did post an issue with the AI developer on git earlier today. But is this a DS issue or AI tool issue?

I haven't got DS to work on BI yet (without the AI tool).

Is there a step-by-step guide somewhere?

Got my BI all set up for the AI tool.

 

[JL-F1]

It is a DS issue, the 'delay'

Everything changes so fast a guide is hard

 

[Pentagano]

It is a DS issue, the 'delay'

Everything changes so fast a guide is hard

Is this delay evident using DS on the new BI function also?

Started a thread on the deepstack forum.

@sebastiantombs -
lowered the image quality to medium on my camera here - substream/512 bitrate/ 8fps.

52ms was the fastest!! Very impressed with this old used 970. (apart from this annoying start-up delay underlined

 

[MikeR33]

Can you run a GPU freq monitor tool and see if it's dropping it's speed when idle after 5 mins then speeds up after detection for 5 mins before slowing again? Don't think windows will control that it likely GPU config specific. I'll try and do some testing on my 1060 and see if it's doing the same.

 

[CCTVCam]

If you want to quieten your system / save power, rather than concentrating on your gpu, fit PWM fans to your case. That way they only switch on / ramp up when needed. Won't stop GPU noise but will cull noise / power overall. A GPU should be factory fitted with PWM in any event.

I can't imagine your GPU ramping the fans up high unless it's under heavy load. At 480 cuda cores it should be OK for DS unless the lower precision of a gaming card vs Quadro in some way increases processing.

 

[Pentagano]

Perfcap in Idle state is normal?

 

[Pentagano]

Fans arrived today. 2 x 12cm ones on the top and 1 small 8cm cpu type fan inside blowing directly on the gpu.
Opened up 2 of the empty card slots on the back and got a nice flow of air through the case.
Gpu is idling at a nice cool 29c with the case sealed up with the glass side on.
Awesome no need for an expensive new case yet.
Super silent also.
10c cooler

Update
If I have the fans on full 29c
Low speed 31c


Maybe when the office gets hot in summer I'll turn up the speed.
0.84w. Lol absolutely nothing

 

[Pentagano]

Would be great if I could add an automation for the case fans. If the gpu heats up then the fans turn on max. Got a dumb mechanical switch for the 2 speeds at the moment

 

[CCTVCam]

Question for the BI experts - Quadro vs Amd Radeon Pro?

I see Nvidia appears to be discontinuing Quadro in favour of the A series cards the cheapest of which the A2000 appears to be £699!!

Was wonderingt therefore how AMD's workstation cards ie W3100, W4100, W5100 stack up in BI? Can the BI code work with AMD cards?

 

[sebastiantombs]

At this time I believe only NVidia cards are compatible with DS. Look at the Tesla series of cards from NVidia.

 

[Pentagano]

At this time I believe only NVidia cards are compatible with DS. Look at the Tesla series of cards from NVidia.

Yep shame as I have an amd only user for extending 3 x 2k monitors for working.
Hope they'll extend functionality for other chipsets

 

[Pentagano]

At this time I believe only NVidia cards are compatible with DS. Look at the Tesla series of cards from NVidia.

Yep shame as I have an amd only user for extending 3 x 2k monitors for working.
Hope they'll extend functionality for other chipset

 

[105437]

Would an Tesla K20 improve DS performance? It's an entry level card but I'd consider buying one.

 

[wittaj]

I would think so. I got a 1030 card that is about as low as you can go and it was a significant improvement for DS.