4.8.5 - BIG NEWS No movement trigger and New AI integration/update

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
@fenderman I know that this is off topic, but out of curiosity can you share how you handle motion alerts in BI, such as zone crossing, make time, etc. I know that everyone’s use case is different. I’m just trying to get an idea of some best practices to use for motion triggers in BI.


Sent from my iPhone using Tapatalk
it varies by camera. There is no one fits all solution.
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
fyi you can start testing sentry using the setup guide provided above. Note there is an error in the manual, their email address image@smarthomesentry.biz the manual has "senty" missing the R.
 

Skispcs

Getting the hang of it
Joined
Jun 10, 2014
Messages
104
Reaction score
30
Some more info on how smartsentry will work. Essentially, you will be emailing snapshots of triggers so that sentry can analyze them on their server which will then text you. Hopefully the other options will be better integrated.
see attached sentry guide - skip to the blue iris section.
So Blue Iris still has to detect something and become triggered. The image taken after the trigger is emailed to a Cloud system and they then process it and text me if it is human or not.

I got excited at first but now not so much.
 

fbnoise

Getting the hang of it
Joined
Dec 29, 2014
Messages
270
Reaction score
61
The image taken after the trigger is emailed to a Cloud system and they then process it
And so you're back to reality at this point in time. Gotta hand off your data and hope for the best because the avg system and consumer software options (Windows) don't exist to solve this locally for a normal user with normal HW. Happy to see interest here because before long, we'll be able to process this stuff in-house as long as software/hardware evolves and the DIY demand is there.
 

devastator

Getting the hang of it
Joined
May 22, 2015
Messages
169
Reaction score
28
Location
Belgium
Lets see how it plays out.
I was very pleased to read this, untill i saw it uses email for sending the pics. Makes you dependent on 2 services: email and sentry.
Might go the amazon route then, they have an API
 

fbnoise

Getting the hang of it
Joined
Dec 29, 2014
Messages
270
Reaction score
61
Might go the amazon route then, they have an API
I'm an Amazon customer/investor and I wouldn't. We need local superpowers, and that isn't that far off from the present. Or, you can trust a really large and capable company with endless amounts of money, and end-goals of I don't quite know what, and hope for the best. I say all that and I doubt Amazon would get involved with gov surveillance. WTF am I even talking about
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
So Blue Iris still has to detect something and become triggered. The image taken after the trigger is emailed to a Cloud system and they then process it and text me if it is human or not.

I got excited at first but now not so much.
Blue iris having to detect something is not the issue, it is very easy for BI to detect motion. You dont get a text if its not a human or car. The biggest issue is that you have no control over the exact frame that gets sent. A better option - likely more costly would be to send 1fps to get processed continuously. The release note indicates that this is one of many add ons, including more of BI's own detection improvements.
 

No5

Young grasshopper
Joined
Mar 10, 2014
Messages
56
Reaction score
11
So BI detects, image is uploaded to the cloud for processing. Then if a match (for human activity in this example) is met, a notification is then sent. So how long realistically would that end-to-end process take to justify using the Sentry solution for real-time monitoring? Or maybe it's not meant for real-time?
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
So BI detects, image is uploaded to the cloud for processing. Then if a match (for human activity in this example) is met, a notification is then sent. So how long realistically would that end-to-end process take to justify using the Sentry solution for real-time monitoring? Or maybe it's not meant for real-time?
It's only a couple of seconds... It's going to take a while to smooth out to make it accurate and usable. It's a step in the right direction. Or you can spend some time setting up zone crossing and get highly accurate alerts.
 

pmcross

Pulling my weight
Joined
Jan 16, 2017
Messages
371
Reaction score
185
Location
Pennsylvania
So BI detects, image is uploaded to the cloud for processing. Then if a match (for human activity in this example) is met, a notification is then sent. So how long realistically would that end-to-end process take to justify using the Sentry solution for real-time monitoring? Or maybe it's not meant for real-time?
This is what I am concerned with as well. Granted it would be nice to get accurate alerts, but if there is a fair amount of latency involved then a local solution, such as Sighthound Video 6.0 (once released) or another AI integrator with BI would be the best solution. I am testing Sentry on a few of my cameras, I will report findings.
 

varghesesa

Sentry Rep.
Joined
Feb 1, 2019
Messages
209
Reaction score
200
Location
san jose
Hi Guys,

Full disclosure, I work for Sentry.

The integration is much tighter within the software. Email communication is for general users with or without Blue Iris.

The Blue Iris app leverages the Sentry API to get and receive the processed image results much faster. Enabling the functionality is just a mouse-click on a checkbox. No setup required. All alerts are sent via the Blue Iris communication channels: mobile app, desktop or browser.

Look forward to everyone's feedback. Hope this reduces false alerts.


Some more info on how smartsentry will work. Essentially, you will be emailing snapshots of triggers so that sentry can analyze them on their server which will then text you. Hopefully the other options will be better integrated.
see attached sentry guide - skip to the blue iris section.
Some more info on how smartsentry will work. Essentially, you will be emailing snapshots of triggers so that sentry can analyze them on their server which will then text you. Hopefully the other options will be better integrated.
see attached sentry guide - skip to the blue iris section.
 

varghesesa

Sentry Rep.
Joined
Feb 1, 2019
Messages
209
Reaction score
200
Location
san jose
This is what I am concerned with as well. Granted it would be nice to get accurate alerts, but if there is a fair amount of latency involved then a local solution, such as Sighthound Video 6.0 (once released) or another AI integrator with BI would be the best solution. I am testing Sentry on a few of my cameras, I will report findings.
This is Sam from Sentry. Performance may not meet your standards with the email integration. We are getting 3 sec response when no one is identified and up to 6 sec round trip response time when people are identified. Variables like internet connection speed can improve or affect performance. Working on an on premise solution.
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
Hi Guys,

Full disclosure, I work for Sentry.

The integration is much tighter within the software. Email communication is for general users with or without Blue Iris.

The Blue Iris app leverages the Sentry API to get and receive the processed image results much faster. Enabling the functionality is just a mouse-click on a checkbox. No setup required. All alerts are sent via the Blue Iris communication channels: mobile app, desktop or browser.

Look forward to everyone's feedback. Hope this reduces false alerts.
This is good news. Can you provide info on how many images get sent to sentry per alert? Will there be a way to constantly send images 1 or 0.5 fps so that sentry will not have to rely on a BI trigger?
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
Additionally, what will be the pricing structure?
 

Skispcs

Getting the hang of it
Joined
Jun 10, 2014
Messages
104
Reaction score
30
Even though I am not crazy about the cloud functionality, I wanted to give it a fair test.
I used images from four different Hikvision cameras taken through Blue Iris and sent about 100 images from each camera through the system.
A false positive is an image that came back as containing a human when it really did not.
A false negative is an image that did contain a human and was not detected.
About one third of the images were during reduced lighting. My definition of reduced lighting is street light or better. One of the four cameras stays in color mode all night as their is enough light to not send it into night mode.

During the day about 60% that contained a human were detected as containing a human.
During reduced lighting about 40% of those containing a human were detected.
I had two false positives, one of which is the attached picture with a guys face on the side. It made me laugh and I am not sure if that should count as a false positive.
The green rectangle on the bottom is from Blue Iris and was on the image I sent. The green rectangle on the face is from the Sentry system and was added to the text I received.

signal-2019-02-12-105839.jpg
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
Even though I am not crazy about the cloud functionality, I wanted to give it a fair test.
I used images from four different Hikvision cameras taken through Blue Iris and sent about 100 images from each camera through the system.
A false positive is an image that came back as containing a human when it really did not.
A false negative is an image that did contain a human and was not detected.
About one third of the images were during reduced lighting. My definition of reduced lighting is street light or better. One of the four cameras stays in color mode all night as their is enough light to not send it into night mode.

During the day about 60% that contained a human were detected as containing a human.
During reduced lighting about 40% of those containing a human were detected.
I had two false positives, one of which is the attached picture with a guys face on the side. It made me laugh and I am not sure if that should count as a false positive.
The green rectangle on the bottom is from Blue Iris and was on the image I sent. The green rectangle on the face is from the Sentry system and was added to the text I received.

View attachment 39199
The blue iris motion highlighting and rectangles may confuse their algorithm. On the images you sent was there blue highlighting or green rectangles present near the person?
 

varghesesa

Sentry Rep.
Joined
Feb 1, 2019
Messages
209
Reaction score
200
Location
san jose
The blue iris motion highlighting and rectangles may confuse their algorithm. On the images you sent was there blue highlighting or green rectangles present near the person?
Sam from Sentry: That's a good point. The blue highlighting can affect the image processing. We also noticed a false negative (person was there but not alerted) when part of the body was covered with the blue highlighting.
 

varghesesa

Sentry Rep.
Joined
Feb 1, 2019
Messages
209
Reaction score
200
Location
san jose
The blue iris motion highlighting and rectangles may confuse their algorithm. On the images you sent was there blue highlighting or green rectangles present near the person?
Even though I am not crazy about the cloud functionality, I wanted to give it a fair test.
I used images from four different Hikvision cameras taken through Blue Iris and sent about 100 images from each camera through the system.
A false positive is an image that came back as containing a human when it really did not.
A false negative is an image that did contain a human and was not detected.
About one third of the images were during reduced lighting. My definition of reduced lighting is street light or better. One of the four cameras stays in color mode all night as their is enough light to not send it into night mode.

During the day about 60% that contained a human were detected as containing a human.
During reduced lighting about 40% of those containing a human were detected.
I had two false positives, one of which is the attached picture with a guys face on the side. It made me laugh and I am not sure if that should count as a false positive.
The green rectangle on the bottom is from Blue Iris and was on the image I sent. The green rectangle on the face is from the Sentry system and was added to the text I received.

View attachment 39199
Great analysis. Also keep in mind we provide additional logic which suppresses frames for a better user experience. We skip alerts when we recognize an "event" has already been detected and alerted upon. For example, if the kids are playing in the backyard, the backyard camera will send an alert the first time the activity is detected. However, if the kids are playing for 30 minutes, you will not receive alerts for the next 30 minutes while the kids continue to play. The software is smart enough to know it is the same "event".
 
Last edited:

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
Great analysis. Also keep in mind we provide additional logic which suppresses frames for a better user experience. For example we will not fire additional alerts in a 1 minute time window from the first alert. The idea is the motion is probably caused by the same person and the end user does not care for additional alerts regarding the same event.
The problem with that is if the first alert is a non-human, the second will not be detected.
 
Top