[tool] [tutorial] Free AI Person Detection for Blue Iris

[naidu]

It's way simpler! I'll explain it in detail later. Meanwhile, you can still use the duplicate camera setup if you prefer that. I always try to update AI Tool in a way so that you can stick with a specific setup if you prefer it. Sometimes it's not possible, but I always invest alot of time trying to.

For some reason my HD recording are missing on trigger.



I wonder using other method will fix the issue.

 

[kapee96]

Hi @GentlePumkin. Awesome Application. worked for me with 8 Camera right from the get go and almost 96% hits. The only issue I got so far was that as per my BlueIris setting I delete all my JPEGS from the AIINPUT folder when it reaches 1 GB. I wasn't anticipating hitting this anytime soon but I have 2 kids who decided to have play in the backyard for a couple of hours and yes I had a TON of pictures captured on the folder and the AI application caught all of them.

Now as soon as the 1GB Limit hit the folder files were deleted and when I clicked on the AI Tool --> History tab and clicked one of the alerts the application crashed.

Not a biggy but I had to restart it again and it was all good but since a new release is planned wanted to let you know

 

[GentlePumpkin]

usually AI Tool automatically deletes entrys for images that were deleted during runtime. And starting takes a few seconds with a large history because AI Tool is checking if all entries are still valid. Your problem though indicates that there might be something wrong with the code that monitors the input folder.

 

[kapee96]

usually AI Tool automatically deletes entrys for images that were deleted during runtime. And starting takes a few seconds with a large history because AI Tool is checking if all entries are still valid. Your problem though indicates that there might be something wrong with the code that monitors the input folder.

is there a setting i need to check for this?

 

[msauto]

I tried the face recognition feature. I guess most people would like to use this to get information like "person xy is home" or to block alerts when a known person is detected. Generally a good idea I had in mind too, but I think it would undermine the reliability as p.e. anyone could just print your face and wear it. Additionally and probably most importantly, the face recognition seldomly works if the face resolution is as low as it usually is on p.e. a 2MP camera. On higher res cameras this probably is a less important point. Third point is that face detection is significantly slower than usual object detection in my experience (can someone confirm that?).

Thanks for the reply! And i am interested in it for all the reasons above as well as a couple more, like for technician recognition for access to restricted tools etc... (i own and operate an auto repair facility that is completely automated), not to mention the cool factor would be through the roof! LOL . I am running my automation system as well as security and surveillance on a dell 720 server with dual zeons and over 100 gb ram so i am a little better off than some in the power area and my 13 cameras are 2 mp 1920x1080 so they are border line. I certainly wouldn't want to cause reliability issues with the current software, it's rock solid here and works flawlessly. With that said I would be glad to beta test if you or anyone were so inclined to make this a feature that a person could switch on if their hardware and situation would allow reliable use. And turn off if not. Thank You again for your valuable time!

 

[GentlePumpkin]

is there a setting i need to check for this?

All of this should work automatically.

 

[Tinbum]

Now as soon as the 1GB Limit hit the folder files were deleted and when I clicked on the AI Tool --> History tab and clicked one of the alerts the application crashed.

Not a biggy but I had to restart it again and it was all good but since a new release is planned wanted to let you know

I can't remember exactly what comes up on the screen but does it give you the option of continuing or closing? EDIT see below;



See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.

** Exception Text **
System.ArgumentException: Parameter is not valid.
at System.Drawing.Bitmap..ctor(String filename)
at WindowsFormsApp2.Shell.list1_SelectedIndexChanged(Object sender, EventArgs e)
at System.Windows.Forms.ListView.OnSelectedIndexChanged(EventArgs e)
at System.Windows.Forms.ListView.WmReflectNotify(Message& m)
at System.Windows.Forms.ListView.WndProc(Message& m)
at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m)
at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)
at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)


** Loaded Assemblies **
mscorlib
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4180.0 built by: NET48REL1LAST_B
CodeBase: file://C:/Windows/Microsoft.NET/Framework/v4.0.30319/mscorlib.dll
----------------------------------------
aitool
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file://C:/Program%20Files/AI%20Tool/aitool.exe
----------------------------------------
System.Windows.Forms
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4084.0 built by: NET48REL1
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms/v4.0_4.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
----------------------------------------
System
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4084.0 built by: NET48REL1
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll
----------------------------------------
System.Drawing
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4084.0 built by: NET48REL1
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Drawing/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
----------------------------------------
System.Net.Http
Assembly Version: 4.2.0.0
Win32 Version: 4.6.26011.01
CodeBase: file://C:/Program%20Files/AI%20Tool/System.Net.Http.DLL
----------------------------------------
System.Configuration
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4084.0 built by: NET48REL1
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Configuration/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll
----------------------------------------
System.Core
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4180.0 built by: NET48REL1LAST_B
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Core/v4.0_4.0.0.0__b77a5c561934e089/System.Core.dll
----------------------------------------
System.Xml
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4084.0 built by: NET48REL1
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll
----------------------------------------
System.Windows.Forms.DataVisualization
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4084.0
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms.DataVisualization/v4.0_4.0.0.0__31bf3856ad364e35/System.Windows.Forms.DataVisualization.dll
----------------------------------------
Newtonsoft.Json
Assembly Version: 12.0.0.0
Win32 Version: 12.0.2.23222
CodeBase: file://C:/Program%20Files/AI%20Tool/Newtonsoft.Json.DLL
----------------------------------------
System.Numerics
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4084.0 built by: NET48REL1
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Numerics/v4.0_4.0.0.0__b77a5c561934e089/System.Numerics.dll
----------------------------------------
System.Runtime.Serialization
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4180.0 built by: NET48REL1LAST_B
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Runtime.Serialization/v4.0_4.0.0.0__b77a5c561934e089/System.Runtime.Serialization.dll
----------------------------------------
System.Data
Assembly Version: 4.0.0.0
Win32 Version: 4.8.4084.0 built by: NET48REL1
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_32/System.Data/v4.0_4.0.0.0__b77a5c561934e089/System.Data.dll
----------------------------------------
Telegram.Bot
Assembly Version: 14.11.0.0
Win32 Version: 14.11.0.0
CodeBase: file://C:/Program%20Files/AI%20Tool/Telegram.Bot.DLL
----------------------------------------
SixLabors.ImageSharp
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file://C:/Program%20Files/AI%20Tool/SixLabors.ImageSharp.DLL
----------------------------------------
netstandard
Assembly Version: 2.0.0.0
Win32 Version: 4.8.4084.0
CodeBase: file://C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/netstandard/v4.0_2.0.0.0__cc7b13ffcd2ddd51/netstandard.dll
----------------------------------------
System.Numerics.Vectors
Assembly Version: 4.1.4.0
Win32 Version: 4.6.26515.06
CodeBase: file://C:/Program%20Files/AI%20Tool/System.Numerics.Vectors.DLL
----------------------------------------
SixLabors.Core
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file://C:/Program%20Files/AI%20Tool/SixLabors.Core.DLL
----------------------------------------
System.Memory
Assembly Version: 4.0.1.0
Win32 Version: 4.6.26606.05
CodeBase: file://C:/Program%20Files/AI%20Tool/System.Memory.DLL
----------------------------------------
System.Buffers
Assembly Version: 4.0.2.0
Win32 Version: 4.6.25519.03
CodeBase: file://C:/Program%20Files/AI%20Tool/System.Buffers.DLL
----------------------------------------

** JIT Debugging **
To enable just-in-time (JIT) debugging, the .config file for this
application or computer (machine.config) must have the
jitDebugging value set in the system.windows.forms section.
The application must also be compiled with debugging
enabled.

For example:

<configuration>
<system.windows.forms jitDebugging="true" />
</configuration>

When JIT debugging is enabled, any unhandled exception
will be sent to the JIT debugger registered on the computer
rather than be handled by this dialog box.



If so then I think I have seen it. It's when the file is still in the history list but the file from the folder has been deleted.

( I think it occurs when you have left AITool open on the history page and then scroll down the list and click on a file that shows because the history page has not refreshed since the file was deleted . EDIT just tried that and it didn't do it)

 

[GentlePumpkin]

okay I've probably fixed the issue @kapee96 and @Tinbum just discussed.
The history list that contains information on all recent alerts is continously kept up to date during runtime.
Every time an old image is deleted by Blue Iris from the input folder, AI Tool will notice that and also delete the history entry. You can verify if that works by simply deleting everything in your input folder and checking if the history list is empty.

Additionally, when AI Tool starts it will remove history list entrys related to images that have been deleted while AI Tool wasn't running. This code had a small bug: it loaded the unchecked history list before actually cleaning it up, so obsolete entrys would be loaded aswell.

I'll publish another preview for 1.67 including this fix.

 

[Tinbum]

okay I've probably fixed the issue @kapee96 and @Tinbum just discussed.
The history list that contains information on all recent alerts is continously kept up to date during runtime.
Every time an old image is deleted by Blue Iris from the input folder, AI Tool will notice that and also delete the history entry. You can verify if that works by simply deleting everything in your input folder and checking if the history list is empty.

Additionally, when AI Tool starts it will remove history list entrys related to images that have been deleted while AI Tool wasn't running. This code had a small bug: it loaded the unchecked history list before actually cleaning it up, so obsolete entrys would be loaded aswell.

I'll publish another preview for 1.67 including this fix.

Wow I'm very impressed how quick you did that.

 

[joshwah]

Is there anyway to overlay the [summary] on the alert image that is sent?

 

[GentlePumpkin]

Is there anyway to overlay the [summary] on the alert image that is sent?

no, that's not possible.

Meanwhile, the latest preview including the fix discussed above is available for download now: AI Tool Releases (zip download can be found in the "> Assets" drop menu)

 

[kapee96]

okay I've probably fixed the issue @kapee96 and @Tinbum just discussed.
The history list that contains information on all recent alerts is continously kept up to date during runtime.
Every time an old image is deleted by Blue Iris from the input folder, AI Tool will notice that and also delete the history entry. You can verify if that works by simply deleting everything in your input folder and checking if the history list is empty.

Additionally, when AI Tool starts it will remove history list entrys related to images that have been deleted while AI Tool wasn't running. This code had a small bug: it loaded the unchecked history list before actually cleaning it up, so obsolete entrys would be loaded aswell.

I'll publish another preview for 1.67 including this fix.

WOW that was Quick. Very impressed with the Application and it gets better and better from here.. @GentlePumpkin again Awesome Work. Looking forward for the v1.67 release.

Now i just to see how to Push Notifications on my Phone (iOS) in the night if the AI Tool catches someone moving around the house. if someone has a quick link would save me a lot of time
My Configuration:: BlueIris v5.x + AI Tool + Docker for Windows + Homebridge for HomeKit.

 

[joshwah]

Haven't yet figured out why.
EDIT: Not true, I changed something in code yesterday which may have caused it. So in 1.67 preview 3 it does not happen anymore. Can you confirm that? @joshwah

Nope still an issue in preview 6... see image; Screenshot

 

[smwein]

I have this set up but it doesn't seem that my trigger is working. I tested the url and it work but when the AI picks up something I don't have event in my time line. Not sure what to do.

Thanks

 

[joshwah]

I have this set up but it doesn't seem that my trigger is working. I tested the url and it work but when the AI picks up something I don't have event in my time line. Not sure what to do.

Thanks

Send a screenshot of your "record" & "Trigger" tab.

 

[smwein]

I think i fixed. I typed the right trigger into browser but not into AI Tools.

Thanks

 

[joshwah]

I am having some issues where quite a few objects are NOT being detected in AI.. see some examples below:

Screenshot

Captured with Lightshot

prnt.sc

Screenshot

Captured with Lightshot

prnt.sc

Screenshot

Captured with Lightshot

prnt.sc

Screenshot

Captured with Lightshot

prnt.sc

Screenshot

Captured with Lightshot

prnt.sc

Screenshot

Captured with Lightshot

prnt.sc

Screenshot

Captured with Lightshot

prnt.sc

Any ideas?

 

[joshwah]

Also, i cant seem to get the mask working on 1.67 preview 6. No matter what I do, it still detects the objects BEHIND the mask... see image: Screenshot and Screenshot

 

[aaronjlee]

Awesome application! I have set up and have everything talking appropriately, however each time an image goes to be processed I get the following error in the log:

[12.06.2020, 08:12:24.819]: Starting analysis of C:\BlueIris\aiinput\aiIPC.20200612_081224111.jpg
[12.06.2020, 08:12:24.821]: (1/6) Uploading image to DeepQuestAI Server
[12.06.2020, 08:12:24.920]: (2/6) Waiting for results
[12.06.2020, 08:12:24.921]: (3/6) Processing results:
[12.06.2020, 08:12:24.922]: System.NullReferenceException | Object reference not set to an instance of an object. (code: -2147467261 )
[12.06.2020, 08:12:24.923]: ERROR: Processing the following image 'C:\BlueIris\aiinput\aiIPC.20200612_081224111.jpg' failed. Failure in AI Tool processing the image.
[12.06.2020, 08:12:24.924]: uploading image to chat "xxxxxxxx"

Any ideas? Thanks so much for taking the time to share this with everyone....AWESOME application of deep learning APIs and automation.

PS. I cannot seem to figure out what the login for DeepQuest is (localhost:81) asks for username and password.

 

[GentlePumpkin]

Nope still an issue in preview 6... see image; Screenshot

Oh not, that is correct behavior. These overall number of analyzed images isn not stored in the history.csv but instead for each camera in the cameras config file (p.e. ./cameras/default.txt). Otherwise the overall number of detections would decrease as soon as old alert images are deleted.