DeepStack ExDark - Detect objects in dark/night images and videos

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
That should certainly help those that experience DeepStack having trouble at night!

I guess the question now is will this version work with the BI DeepStack integration?

And what about the custom models for LPR and logo identification?

I guess time for someone to try it LOL.
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
So I just installed this to run with BI, I think LOL.

I manually ran it by going to the command prompt and typing: deepstack --MODELSTORE-DETECTION "C\DeepStack\model" --PORT 80

and it indicated it ran:

1621399529577.png


I will see how it does through the night. Of course no objects coming through to test it.

This is foreign to me so no idea if it will work with BI or if this command would have to be ran every time BI crashes or the computer restarts or...?
 
Last edited:

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
So no idea if it is working or not LOL.

I loaded up the other custom models for logo and plates, so will see if that works when UPS or FedEx go by. It isn't picking up plates but it said they were trained for Norway, so no shocker there.

What I do not know is if BI is picking up on these custom models.

I did notice that in the DeepStack directory is a sharedfiles folder that had face model and a few others that I assume are being used by DeepStack for BI, so I put the custom models in there to see if anything pops up.
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
OK, we need someone more experienced with DeepStack and how it works and its integration with BI lol.

I ran the tuning option in playback and stopped it with the UPS truck right in the center of the image as that seems to pull up everything the DeepStack can identify whether you asked for it or not LOL. Deepstack identified my neighbors potted plants, the stop sign, mailbox, parked cars, a ball in the yard, the UPS truck itself, but not the logo. So it must be coded in BI which models to use and even putting these in the sharedfiles folder didn't work.

I also ran the command file to run all of these, but they do not appear to be accepted by BI.

Let's see if anyone here is more experienced with how this works. I will send an email in a day or so if we do not see anyone have success with this and see if we can add custom models in DeepStack for BI. Maybe that is a future update, but in my novice experience, it looks like it is simply adding the models into the folder and maybe he needs to tell BI to run DeepStack with any models in that folder?
 
Last edited:

brianegge

Pulling my weight
Joined
Apr 27, 2020
Messages
194
Reaction score
248
Location
Ridgefield, CT
I looked at the dark training set. Doesn’t seem that it would be that useful. I train two models: one with color images and the other with IR images. When the camera switches to IR it sends a gray scale image, and I use that to determine which model to use. When I train my models I first separate the dataset into color and gray scale. You can’t simply apply a gray scale filter to a color image for training, as an object lit by IR looks quite a bit different.

The other thing which helps a lot is detecting stationary objects at startup and excluding them. Not sure how hard that would be with BI/DeepStack.
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
@brianegge - since it sounds like you have dabbled with this, I have been trying to get a custom model to work in BI and it isn't working LOL but not sure if user error or if it is something within BI that the developer would need to add to allow custom models.

Maybe it is something else on BI's end that needs to be ran to allow additional models to work, or maybe there is a coding change I would need to make to a file in DeepStack? Is there anything within the DeepStack files that specifies the models that are used?

I can confirm that the custom models are running by running this command:

deepstack --MODELSTORE-DETECTION "C:/DeepStack/sharedfiles" * --PORT 80

Yet for like the logo custom model, I cannot get the logo to show up in BI. I tried the new tuning option and nothing shows up - UPS and FedEx truck are as clear as day and it picks up it is a truck, but doesn't pull the logo.
 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
I will try the custom model soon too. Will read thru the posts here thank you @wittaj. This is a game changer with custom models now :) BI has got so much better in past couple of months it was already so good and with these updates it has added so much more..
 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
Does the deepstack models and deepstack itself in BI has to be on same port or can it be different ports ?

Reason I am asking seems like the custom model has a Command line I have to input which is port 80.

however my deepstack runs on port 82 which is in Blueiris. I can make that port 80 as well But was wondering if for any reason they need to be on same port or not.
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
Interesting - I don't have to input a custom model port. Where are you getting that at?

Maybe that is why the custom isn't working for some of us?
 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
Interesting - I don't have to input a custom model port. Where are you getting that at?

Maybe that is why the custom isn't working for some of us?
I was reading this see the instructions on deepstack custom model to run..



1622413677689.png


So Basically after I put the train model file into a folder then update my path accordingly But I left default Port 80 for the command.

What I am not sure about is if deepstack and the port here needs to be matched or not ?

Or do we just leave the custom model in the folder and point BI and BI takes care of all this ? Not sure.
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
Oh ok - that is if you run it outside of BI - I was trying those before the custom option became available.

I changed the port # to what it was in BI and they all showed running but never showed in BI.

I don't think we need to do this manual start as BI should start it now with the custom setup. I know at least one person got the logo and dark model to run.
 

hikky_b

Pulling my weight
Joined
Nov 24, 2019
Messages
156
Reaction score
168
Location
London
I was reading this see the instructions on deepstack custom model to run..


So Basically after I put the train model file into a folder then update my path accordingly But I left default Port 80 for the command.

What I am not sure about is if deepstack and the port here needs to be matched or not ?

Or do we just leave the custom model in the folder and point BI and BI takes care of all this ? Not sure.
Yep there's no need to manually start custom models outside of BI. I stopped Deepstack, put custom models in the folder and then hit start. BI took care of it all :D
 

hikky_b

Pulling my weight
Joined
Nov 24, 2019
Messages
156
Reaction score
168
Location
London
Nice, So how can you tell if its running. When I go to it says 404 page not found.
I'm not sure how to see which specific models are running, following your link on my system results in the same 404 but it's definitely running.

Use netstat -a|findstr :82 to check if DeepStack is running at all. People have had problems getting Open Logo to run however.
 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
Thank you @wittaj & @hikky_b I think its running as I can see a alert with an uppercase Car and lowercase car. I think I did read it somewhere here that dark custom model is the one with uppercase. Anyhow still see 404 Will see if openlogo one shows up or not.

1622416981946.png
 

jaydeel

BIT Beta Team
Joined
Nov 9, 2016
Messages
1,126
Reaction score
1,237
Location
SF Bay Area
I'm not sure how to see which specific models are running
To verify, just include the macro &JSON in a text or email 'On alert' action.

Here’s an example of the output... note that results are shown for all active models:
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
That is awesome!

I wonder what is up with mine? DeepStack works when I rollback to the stable version and when I update to the latest it doesn't work. I have tried deleting and adding cameras to no avail.

The IVS triggers work now again though LOL.
 
Top