DeepStack Case Study: Performance from CPU to GPU version

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
576
Reaction score
269
Location
Uruguay
Averaging 200-250ms on a 11th Gen i7-11700
Not bad thanks for the data. There's a lot of talk about the 12th gen, wonder how much faster that is.
Probably cheaper buying a low-range GPU than a 12gen i7 or i9 though.
 

bethzur

Getting the hang of it
Joined
May 19, 2021
Messages
97
Reaction score
57
Location
Pennsylvania
Averaging 200-250ms on a 11th Gen i7-11700
Are these on a sub-stream?

I think the 50ms times from the cheapest 30 series RTX are hard to beat for sub-streams for the money. I have it sample 3 images, once every 750ms. I was worried if the system got motion alerts on several cameras at once. A 250ms time could get backed up with 4-5 cameras triggering. That shouldn't be problem with 50ms times.
 

slabbel

Young grasshopper
Joined
Dec 12, 2014
Messages
30
Reaction score
24
Are these on a sub-stream?

I think the 50ms times from the cheapest 30 series RTX are hard to beat for sub-streams for the money. I have it sample 3 images, once every 750ms. I was worried if the system got motion alerts on several cameras at once. A 250ms time could get backed up with 4-5 cameras triggering. That shouldn't be problem with 50ms times.
Yeah, substream @ 1912x1080, default DS model only and Medium mode
 

MicahJames

Pulling my weight
Joined
Aug 26, 2019
Messages
186
Reaction score
212
Location
San Jose, ca
Sorry if this has already been answered but, I have a Radeon RX560. Will DS GPU version work or does it only work with Nvidia?
 
Joined
Jun 1, 2016
Messages
79
Reaction score
39
Well, it's the season for tinkering and maybe some Black Friday deals.
I'm running 12 or 13 cameras all running deepstack on a Dell Optiplex 7050 Micro i7-7700/16GB
Catching up on this and other threads, it would seem like the GTX 1050 ti would be a good choice. Although I'm sure I have a more powerful PSU in the garage, I'm also sure it's many years old.
Any recommendations on a particular brand or other cards before I squeeze the trigger?
Thanks in advance for all of the helpful knowlege!
 

CAL7

Getting the hang of it
Joined
Nov 26, 2020
Messages
64
Reaction score
26
Location
Florida
A question about cuDNN version (for a P400). All the docs on the Deepstack site, and references here, point to v10.1. But the Nvidia site gives v11.5 as the most recent available. For a new install, is it recommended to stay back on v10.1 or keep up with the latest? Thank you.
 

IReallyLikePizza2

Known around here
Joined
May 14, 2019
Messages
1,852
Reaction score
4,441
Location
Houston
A question about cuDNN version (for a P400). All the docs on the Deepstack site, and references here, point to v10.1. But the Nvidia site gives v11.5 as the most recent available. For a new install, is it recommended to stay back on v10.1 or keep up with the latest? Thank you.
I went with 10.1
 

TBurt

Getting the hang of it
Joined
Aug 14, 2021
Messages
68
Reaction score
97
Location
Houston
DeepStack has not updated the torch and torchvision that supports 11.X yet so it only works with 10.X
Crap, I went with 11.5. It seems to be working so far for the last week on my GTX 1060. What kind of problems would running the newer version cause?
 

ivanerr

n3wb
Joined
Sep 20, 2021
Messages
4
Reaction score
10
Crap, I went with 11.5. It seems to be working so far for the last week on my GTX 1060. What kind of problems would running the newer version cause?
According to NVIDIA you should be fine:
"since CUDA is backward compatible, existing CUDA applications can continue to be used with newer CUDA versions"
 
Joined
Jun 1, 2016
Messages
79
Reaction score
39
Well, it's the season for tinkering and maybe some Black Friday deals.
I'm running 12 or 13 cameras all running deepstack on a Dell Optiplex 7050 Micro i7-7700/16GB
Catching up on this and other threads, it would seem like the GTX 1050 ti would be a good choice. Although I'm sure I have a more powerful PSU in the garage, I'm also sure it's many years old.
Any recommendations on a particular brand or other cards before I squeeze the trigger?
Thanks in advance for all of the helpful knowlege!
Okay, picked up a MSI GeForce GTX 1050 Ti 4GT LP Graphics Board VD6238 4GB GDDR5 for $275 on ebay. Looking forward to seeing what this does to the response times. I should get it and installed within a week.
 
As an eBay Associate IPCamTalk earns from qualifying purchases.

jeremypsl

n3wb
Joined
Nov 29, 2021
Messages
17
Reaction score
3
Location
France
Hello everyone !

I'm new in this world, i came from Surveillance Station from Synology to Blue Iris/DeepStack.
I bought an entirly new server for this : a Zotac ECM73070C with an i7-10700 and RTX3070.
I also installed a M.2 Google Coral TPU but it seem to not be supported by DS so...
I Installed DS GPU version for Windows, lastest nVidia drivers, cuda and cudnn, but my CPU seem to be under heavy load and my GPU doing nothing...
Is there a way to check that ? Time respond, which componant is using, etc ?

Thanks !
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,449
Reaction score
47,588
Location
USA
Hello everyone !

I'm new in this world, i came from Surveillance Station from Synology to Blue Iris/DeepStack.
I bought an entirly new server for this : a Zotac ECM73070C with an i7-10700 and RTX3070.
I also installed a M.2 Google Coral TPU but it seem to not be supported by DS so...
I Installed DS GPU version for Windows, lastest nVidia drivers, cuda and cudnn, but my CPU seem to be under heavy load and my GPU doing nothing...
Is there a way to check that ? Time respond, which componant is using, etc ?

Thanks !
Have you done EVERY optimization in the wiki? Substreams is a must.

In Task Manager you can see if the GPU is being utilized.
 

MikeLud1

IPCT Contributor
Joined
Apr 5, 2017
Messages
2,141
Reaction score
4,118
Location
Brooklyn, NY
Hello everyone !

I'm new in this world, i came from Surveillance Station from Synology to Blue Iris/DeepStack.
I bought an entirly new server for this : a Zotac ECM73070C with an i7-10700 and RTX3070.
I also installed a M.2 Google Coral TPU but it seem to not be supported by DS so...
I Installed DS GPU version for Windows, lastest nVidia drivers, cuda and cudnn, but my CPU seem to be under heavy load and my GPU doing nothing...
Is there a way to check that ? Time respond, which componant is using, etc ?

Thanks !
DeepStack does not support RTX3000 series GPUs yet without some hacking see steps in the below post
I was able to get my 3060 to work with DeepStack, follow the steps below.

Install
CUDA Toolkit 11.4
cuDNN v8.2.4
DeepStack-Installer-GPU-2021.09.1.exe

Manually update to the below Windows Packages
numpy-1.21.2-cp37-cp37m-win_amd64
Pillow-8.3.2-cp37-cp37m-win_amd64
scipy-1.7.1-cp37-cp37m-win_amd64
torch-1.9.1+cu111-cp37-cp37m-win_amd64
torchvision-0.10.1+cu111-cp37-cp37m-win_amd64
 
Top