Hell Yeah! Direct Deepstack Integration - 5.4.0 - March 31, 2021

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
575
Reaction score
269
Location
Uruguay
@sebastiantombs
What I have observed if I have the gtx970 in silent mode instead of the default (Asus GPU tweak 3) the power at idle goes down the 8%
BUT the first trigger from a camera takes about 300ms to wake up the GPU, which seems to be a sleep mode. So about 400+ms for the first photo on DS then fast on the others.
Not so good if you have a super-fast object you want to track but probably ok for normal use and will save a lot of power, idles at 8% and temp in the low 30's.
When it wakes up the GPU it will resume to 28% power after that initial trigger.
 

sebastiantombs

Known around here
Joined
Dec 28, 2019
Messages
11,511
Reaction score
27,690
Location
New Jersey
I don't follow the power on my setup that closely. I just let the card run the way it wants too. Maybe it adds to my electric bill, probably does, but that's the least of my worries.
 

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
575
Reaction score
269
Location
Uruguay
I don't follow the power on my setup that closely. I just let the card run the way it wants too. Maybe it adds to my electric bill, probably does, but that's the least of my worries.
I was mistaken. The power also settles to 8% at idle on the other modes. I also edited the windows power plan for the PCi config to OFF and not have a power savings setting. Not sure how much this will affect the working of the gpu yet. May respond faster if it's been idling?
I think tweaking the NVIDIA control settings so my CPU manages the monitor graphics rather than the GPU made a difference.

I have 5 DS instances, 4 for each exterior cams which are used most for AI and 1 for the inside cams which are not switched on for object detection so often.
Does having a DS server for each camera make a noticeable difference?

Also, is there any way of preventing this slight delay on the first trigger after the power settles to idle 8%?
(or maybe the delay is somewhere else? Perhaps the DS/AI interaction. I have the image folder on the SSD drive)

This is my current set up:

1635775022741.png

Also just to add you can see the delay each time the triggers start - once running much faster but every 1st snapshot there is a delay. Any ideas?

1635776083347.png
 
Last edited:

JL-F1

Getting the hang of it
Joined
Jun 12, 2020
Messages
115
Reaction score
71
Location
USA
I added running two deepstack instances in BI
Before I was at ~150ms per, full rez/high
so for two cameras activated at same time it took about 300ms to be done with both
now it takes ~200ms per and with two cameras it is done in 200ms.

So, it added time but saved time
 

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
575
Reaction score
269
Location
Uruguay
I found each instance took almost 900mb of memory so on just 16GB 5 instances took too much.

Got 2 running now. Once the snapshots come in and the gpu power is above 15% then it's fast!

Must be a reason for that initial delay on the first trigger. Am I the only one? Possibly a sleep setting (windows on max power, sleep off etc)
You can see how fast it is from he 4th column

1635788220496.png
 

JL-F1

Getting the hang of it
Joined
Jun 12, 2020
Messages
115
Reaction score
71
Location
USA
I have not looked in awhile, but back when I ran AItool and the first windows GPU version of DS, it took ~470ms for the first activation in something like 5mins, then every other one was ~150ms until nothing happened for ~5min. DS commented they knew about this like 'wake time' issue but I have never seen them say it is fixed
 

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
575
Reaction score
269
Location
Uruguay
I have not looked in awhile, but back when I ran AItool and the first windows GPU version of DS, it took ~470ms for the first activation in something like 5mins, then every other one was ~150ms until nothing happened for ~5min. DS commented they knew about this like 'wake time' issue but I have never seen them say it is fixed
hmm maybe this is the issue I'm observing then thanks. I did post an issue with the AI developer on git earlier today. But is this a DS issue or AI tool issue?

I haven't got DS to work on BI yet (without the AI tool).

Is there a step-by-step guide somewhere?

Got my BI all set up for the AI tool.
 

JL-F1

Getting the hang of it
Joined
Jun 12, 2020
Messages
115
Reaction score
71
Location
USA
It is a DS issue, the 'delay'

Everything changes so fast a guide is hard :(
 

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
575
Reaction score
269
Location
Uruguay
It is a DS issue, the 'delay'

Everything changes so fast a guide is hard :(
Is this delay evident using DS on the new BI function also?

Started a thread on the deepstack forum.

@sebastiantombs -
lowered the image quality to medium on my camera here - substream/512 bitrate/ 8fps.

52ms was the fastest!! Very impressed with this old used 970. (apart from this annoying start-up delay underlined
1635793307017.png
 
Last edited:

MikeR33

Getting the hang of it
Joined
Jan 26, 2018
Messages
34
Reaction score
28
Can you run a GPU freq monitor tool and see if it's dropping it's speed when idle after 5 mins then speeds up after detection for 5 mins before slowing again? Don't think windows will control that it likely GPU config specific. I'll try and do some testing on my 1060 and see if it's doing the same.
 

CCTVCam

Known around here
Joined
Sep 25, 2017
Messages
2,660
Reaction score
3,480
If you want to quieten your system / save power, rather than concentrating on your gpu, fit PWM fans to your case. That way they only switch on / ramp up when needed. Won't stop GPU noise but will cull noise / power overall. A GPU should be factory fitted with PWM in any event.

I can't imagine your GPU ramping the fans up high unless it's under heavy load. At 480 cuda cores it should be OK for DS unless the lower precision of a gaming card vs Quadro in some way increases processing.
 

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
575
Reaction score
269
Location
Uruguay
Fans arrived today. 2 x 12cm ones on the top and 1 small 8cm cpu type fan inside blowing directly on the gpu.
Opened up 2 of the empty card slots on the back and got a nice flow of air through the case.
Gpu is idling at a nice cool 29c with the case sealed up with the glass side on.
Awesome no need for an expensive new case yet.
Super silent also.
10c cooler

Update
If I have the fans on full 29c
Low speed 31c


Maybe when the office gets hot in summer I'll turn up the speed.
0.84w. Lol absolutely nothing
 
Last edited:

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
575
Reaction score
269
Location
Uruguay
Would be great if I could add an automation for the case fans. If the gpu heats up then the fans turn on max. Got a dumb mechanical switch for the 2 speeds at the moment
 

CCTVCam

Known around here
Joined
Sep 25, 2017
Messages
2,660
Reaction score
3,480
Question for the BI experts - Quadro vs Amd Radeon Pro?

I see Nvidia appears to be discontinuing Quadro in favour of the A series cards the cheapest of which the A2000 appears to be £699!!

Was wonderingt therefore how AMD's workstation cards ie W3100, W4100, W5100 stack up in BI? Can the BI code work with AMD cards?
 

105437

BIT Beta Team
Joined
Jun 8, 2015
Messages
1,995
Reaction score
881
Would an Tesla K20 improve DS performance? It's an entry level card but I'd consider buying one.
 
Top