DeepStack Case Study: Performance from CPU to GPU version

What are those packages ?
They are Python modules that DeepStack uses

These are optional, DeepStack will work without updating the 3 packages below
numpy-1.21.2-cp37-cp37m-win_amd64
Pillow-8.3.2-cp37-cp37m-win_amd64
scipy-1.7.1-cp37-cp37m-win_amd64

These are required to have DeepStack work with RTX3000 series GPUs. This link has more details what they are. PyTorch link
torch-1.9.1+cu111-cp37-cp37m-win_amd64
torchvision-0.10.1+cu111-cp37-cp37m-win_amd64
 
Do i need to install Python from python.org or a package manager like anaconda to update those packages ?
No, what needs to be done are in the post, link below.

You can skip deleting the highlighted folders
1638360461146.png

 
Gah!

1638410705645.png
 
What does everyone think about if we making a community DeepStack model. If we develop a list of objects that we want DeepStack to identify then everyone shares images with the object in them and we make one model that everyone can use.
Sample of the list:
person
car
truck
deer
raccoon
fox
opossum
cat
dog
coyote
 
Step 1 - install Nvidia CUDA capable card, preferably one with a large number of CUDA cores.
Step 2 - Follow the installation instructions for the GPU version as posted on the DS forum/page. You can skip the last step in those instructions regarding Visual Studio.
Step 3 - You're good to go.

The GTX 1050 ti came yesterday and I threw it in my Dell Optiplex 7050 today.
It figures I'd botch the install as well. As best I could I followed the links provided by @jaydeel.
CUDA 10 failed repeatedly but CUDA 11 installed no problem after updating the GPU drivers from windows 10.
Installed zlib
Installed cuDNN
Copied the bin, lib and .h files to the appropriate directories.
Skipped the Visual Studio instructions..

Unfortunately, DeepStack is now only timing out after motion is detected.
Log tells me that Intel video hardware is detected and Nvidia hardware is detected.
 
The GTX 1050 ti came yesterday and I threw it in my Dell Optiplex 7050 today.
It figures I'd botch the install as well. As best I could I followed the links provided by @jaydeel.
CUDA 10 failed repeatedly but CUDA 11 installed no problem after updating the GPU drivers from windows 10.
Installed zlib
Installed cuDNN
Copied the bin, lib and .h files to the appropriate directories.
Skipped the Visual Studio instructions..

Unfortunately, DeepStack is now only timing out after motion is detected.
Log tells me that Intel video hardware is detected and Nvidia hardware is detected.
Did you install the below
Download GPU version for Windows

1638751646394.png
 
What does everyone think about if we making a community DeepStack model. If we develop a list of objects that we want DeepStack to identify then everyone shares images with the object in them and we make one model that everyone can use.
Sample of the list:
person
car
truck
deer
raccoon
fox
opossum
cat
dog
coyote
This would be great. I live in a rural area and would like DS to capture the wildlife that comes around our house. We have all of these animals plus skunks.
 
Yes, that's the version and instructions I used. I had to stop Blue Iris service for the install to complete.
Anything else I might try before I retrace my steps and install everything again?
Since you installed Cuda 11 try updating the below Windows Packages. Steps are in the post that is linked below.

Manually update to the below Windows Packages
numpy-1.21.2-cp37-cp37m-win_amd64
Pillow-8.3.2-cp37-cp37m-win_amd64
scipy-1.7.1-cp37-cp37m-win_amd64
torch-1.9.1+cu111-cp37-cp37m-win_amd64
torchvision-0.10.1+cu111-cp37-cp37m-win_amd64

Deepstack GPU for Windows problems (Cuda version 11 and Cudnn install).
 
  • Like
Reactions: Paul_V and JNDATHP
Thanks Mike - I followed the instructions now have another error. HW VA not compatible and Deepstack responding at 127.0.0.1 looks off to me. My machine is on a 192.168.1.x ip.

1638768123831.png
 
@MikeLud1 - I saw that recent addition about instances, but I have left mine at 1.

I am running multiple cameras with DeepStack and works fine.

Are you saying if we change this number (and then go in to each camera and override the Server and change the port number) that it would result in faster responses?
 
@MikeLud1 - I saw that recent addition about instances, but I have left mine at 1.

I am running multiple cameras with DeepStack and works fine.

Are you saying if we change this number (and then go in to each camera and override the Server and change the port number) that it would result in faster responses?
I tried using two instances on my set up and I did not see much of a difference at all with response time. I'm sure my results are not typical since I'm running an older i5 with a P400 GPU.
 
@MikeLud1 - I saw that recent addition about instances, but I have left mine at 1.

I am running multiple cameras with DeepStack and works fine.

Are you saying if we change this number (and then go in to each camera and override the Server and change the port number) that it would result in faster responses?

I only found that using more DS instances consumed more of my PC memory with no benefits.
I do run 2 - but 1 is for a custom model and only active sunset-sunrise.
The other has all of my 8 cameras.

btw I use AI tool and deepstack GPU on a gtx970. Installed in 15 minutes and worked first time luckily.

But very interested to see how the 1050 card works.
Maybe try the AI tool and run the deepstack instances from there? It runs the GPU instances on startup and has more granular control.