[tool] [tutorial] Free AI Person Detection for Blue Iris

[jompa68]

Hi,

I can't get AI Input (1.67) to work properly:




Deepstack is activated and reachable
AI Input POST the image to Deepstack

Spoiler: Deepstack log

[GIN] 2020/09/17 - 23:19:21 | 200 | 27.46µs | 192.168.0.200 | POST /v1/vision/detection,
[GIN] 2020/09/17 - 23:20:04 | 200 | 30.819µs | 192.168.0.200 | POST /v1/vision/detection,
[GIN] 2020/09/17 - 23:20:08 | 200 | 25.601µs | 192.168.0.200 | POST /v1/vision/detection,
[GIN] 2020/09/17 - 23:27:48 | 200 | 23.406µs | 192.168.0.200 | POST /v1/vision/detection,
[GIN] 2020/09/17 - 23:27:53 | 200 | 61.496µs | 192.168.0.200 | POST /v1/vision/detection,
[GIN] 2020/09/18 - 01:21:30 | 200 | 28.996µs | 192.168.0.200 | POST /v1/vision/detection,
[GIN] 2020/09/18 - 01:42:53 | 200 | 25.452µs | 192.168.0.200 | POST /v1/vision/detection,
[GIN] 2020/09/18 - 01:44:21 | 200 | 28.814µs | 192.168.0.200 | POST /v1/vision/detection,
[GIN] 2020/09/18 - 01:56:12 | 200 | 14.674443ms | 192.168.0.10 | GET /,
[GIN] 2020/09/18 - 01:56:12 | 200 | 250.325629ms | 192.168.0.10 | GET /assets/vendor/simple-line-icons/css/simple-line-icons.css,
[GIN] 2020/09/18 - 01:56:12 | 200 | 10.108289ms | 192.168.0.10 | GET /assets/device-mockups/device-mockups.min.css,
[GIN] 2020/09/18 - 01:56:12 | 200 | 15.824693ms | 192.168.0.10 | GET /assets/vendor/fontawesome-free/css/all.min.css,
[GIN] 2020/09/18 - 01:56:12 | 200 | 254.019158ms | 192.168.0.10 | GET /assets/vendor/bootstrap/css/bootstrap.min.css,
[GIN] 2020/09/18 - 01:56:12 | 200 | 10.205689ms | 192.168.0.10 | GET /assets/css/new-age.min.css,
[GIN] 2020/09/18 - 01:56:12 | 200 | 15.113805ms | 192.168.0.10 | GET /assets/img/deepstack.png,
[GIN] 2020/09/18 - 01:56:12 | 200 | 1.95221ms | 192.168.0.10 | GET /assets/img/loader.gif,
[GIN] 2020/09/18 - 01:56:12 | 200 | 1.884452ms | 192.168.0.10 | GET /assets/img/iot.jpg,
[GIN] 2020/09/18 - 01:56:12 | 200 | 996.118µs | 192.168.0.10 | GET /assets/img/dark-background.png,
[GIN] 2020/09/18 - 01:58:08 | 200 | 94.084µs | 192.168.0.200 | POST /v1/vision/detection,

Docker version is deepquestai/deepstack:noavx and Vision detection is set to true

I suppose i could adjust the time zone but I doubt it will solve my issue.

In case it matter, I'm running Portainer in a Proxmox VM and Windows 10 also in a VM.

I did search the thread because this issue does come out but no answer work in my case.


Thanks!

Drop the container docker and install SSH and WebTerminal addon in HA(remember to set a password before it can be started)
open the addon page and then run this command to start deepstack

docker run --restart=always -e VISION-DETECTION=true -v localstorage:/datastore -p 83:5000 --name deepstack deepquestai/deepstack

after you have setup the new docker it will show in portainer so you can manage it there if you want.

Note!
if you dont have deepstack already in docker you need to run this first

docker pull deepquestai/deepstack

UPDATE!
Was to happy way to early....still error in AI. But if i run it manually from a cmd and with curl all my attempt is success. Why?

[19.09.2020, 07:20:08.887]: Starting analysis of D:\aiinput\altansd.20200919_072008903.jpg
[19.09.2020, 07:20:08.900]: (1/6) Uploading image to DeepQuestAI Server
[19.09.2020, 07:20:08.950]: (2/6) Waiting for results
[19.09.2020, 07:20:09.029]: (3/6) Processing results:
[19.09.2020, 07:20:09.033]: System.NullReferenceException | Object reference not set to an instance of an object. (code: -2147467261 )
[19.09.2020, 07:20:09.036]: ERROR: Processing the following image 'D:\aiinput\altansd.20200919_072008903.jpg' failed. Failure in AI Tool processing the image.
[19.09.2020, 07:20:13.820]:
[19.09.2020, 07:20:13.823]: Starting analysis of D:\aiinput\altansd.20200919_072013908.jpg
[19.09.2020, 07:20:13.826]: (1/6) Uploading image to DeepQuestAI Server
[19.09.2020, 07:20:13.833]: (2/6) Waiting for results
[19.09.2020, 07:20:13.837]: (3/6) Processing results:
[19.09.2020, 07:20:13.840]: System.NullReferenceException | Object reference not set to an instance of an object. (code: -2147467261 )
[19.09.2020, 07:20:13.843]: ERROR: Processing the following image 'D:\aiinput\altansd.20200919_072013908.jpg' failed. Failure in AI Tool processing the image.
[19.09.2020, 07:26:24.238]:
[19.09.2020, 07:26:24.241]: Starting analysis of D:\aiinput\altansd.20200919_072624506.jpg
[19.09.2020, 07:26:24.244]: (1/6) Uploading image to DeepQuestAI Server
[19.09.2020, 07:26:24.252]: (2/6) Waiting for results
[19.09.2020, 07:26:24.255]: (3/6) Processing results:
[19.09.2020, 07:26:24.259]: System.NullReferenceException | Object reference not set to an instance of an object. (code: -2147467261 )
[19.09.2020, 07:26:24.262]: ERROR: Processing the following image 'D:\aiinput\altansd.20200919_072624506.jpg' failed. Failure in AI Tool processing the image.

 

[jcarver1112]

Am I the only one who has had no luck with this? Aside from the fact that blue iris is generating a bunch of pictures every time there is motion, this AI seems to be very confused on what should be simple recognition.

 

[Tinbum]

Am I the only one who has had no luck with this? Aside from the fact that blue iris is generating a bunch of pictures every time there is motion, this AI seems to be very confused on what should be simple recognition.

I've found that the beta likes to find people all over the place that don't exist. If you run the VorlonCD version it'll mask them all out .

 

[balucanb]

Hello All. Having an issue with masking, but only on one camera. I have checked and re checked the resolution is correct, i produced the mask the same for all comeras but for some reason this 1 camera will not show the mask? Any ideas? Thx.

 

[Tinbum]

Hello All. Having an issue with masking, but only on one camera. I have checked and re checked the resolution is correct, i produced the mask the same for all comeras but for some reason this 1 camera will not show the mask? Any ideas? Thx.

Wrong file type by accident?

 

[balucanb]

Wrong file type by accident?

No, I learned a long time ago to check all the obvious stuff first LOL. It is saved as a png. I just thought about this. I have 2 of that model, of cameras. I only needed a mask on one of them, think I will try and throw one on the 2nd one and see f I have the same problem

 

[balucanb]

No, I learned a long time ago to check all the obvious stuff first LOL. It is saved as a png. I just thought about this. I have 2 of that model, of cameras. I only needed a mask on one of them, think I will try and throw one on the 2nd one and see f I have the same problem

Well that din't work? 2nd camera (same model) worked fine.

 

[105437]

I'm just now trying to get this set up. I'm getting the following error...

[19.09.2020, 22:48:44]: OnCreatedAsync>> Error: Skipping image because queue is greater than '100'. (Adjust 'MaxImageQueueSize' in .JSON file if needed): S:\BI_New\Entry_Clone.20200919_224844007.jpg


This is still happening after editing the .json file as follows...

"MaxImageQueueSize": 9999,

Is there another Maximum Queue setting someplace? Thanks!

 

[Chris Dodge]

VorlonCD mod updates:

I'm just now trying to get this set up. I'm getting the following error...

[19.09.2020, 22:48:44]: OnCreatedAsync>> Error: Skipping image because queue is greater than '100'. (Adjust 'MaxImageQueueSize' in .JSON file if needed): S:\BI_New\Entry_Clone.20200919_224844007.jpg


This is still happening after editing the .json file as follows...

"MaxImageQueueSize": 9999,

Is there another Maximum Queue setting someplace? Thanks!

That is the correct setting. You probably just need to make sure all instances of AITOOL.EXE are closed before modifying the file. But the real answer is to find some way in BI to reduce the number of images created, and to add more deepstack servers to the list. Sure you have BI set to "only when triggered"? Reduce jpeg snapshot each mm:ss ?

 

[hapstabu]

Hello to all and thank you to GentlePumpkin and Chris Dodge for all your work on this project. This does a fantastic job of reducing false alerts from shadows of blowing leaves that have plagued me since starting with surveillance software.

I have been using two versions of Chris Dodge's project, and have come up with an issue sending alerts to Telegram. The first version that I used would send alerts to Telegram with no issues, however, I downloaded the latest version, and it is failing to send alerts.

If I use the test button in the Camera Actions page, it will give me a "Succeeded" popup, but the alerts will error out when trying to send to Telegram.

Errors seem to indicate an issue with the version of Newtonsoft.json.dll. I have checked, and I have ~15 instances of that file on my Windows 10 machine with versions ranging from 6.x to 12.x.

Any Ideas? Following are snips from log files from the 9/3/20 build that works, and the 9/17/20 build that does not work. Thanks in advance.

From Version 1.67.8.35473 built on 9/3/2020 6:42:26 PM
[19.09.2020, 12:27:21.695]: Trigger> Uploading image to Telegram...
[19.09.2020, 12:27:21.757]: TelegramUpload> uploading image to chat "##########"
[19.09.2020, 12:27:24.256]: TelegramUpload> ...Finished in 2499ms
[19.09.2020, 12:27:24.264]: Trigger> -> Sent image to Telegram.


From Version 1.67.8.22287 built on 9/17/2020 11:22:54 AM
[20.09.2020, 11:45:00.318]: TelegramUpload> uploading image to chat "-##########"
[20.09.2020, 11:45:00.370]: TelegramUpload> ERROR: Could not upload image C:\Users\ftsadmin\AppData\Local\Temp\Prater.20200920_114457814.jpg to Telegram: Could not load file or assembly 'Newtonsoft.Json, Version=11.0.0.0, Culture=neutral, PublicKeyToken=################' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040) [FileLoadException] Mod: <TelegramUpload>d__30 Line:1342:33
[20.09.2020, 11:45:00.374]: TelegramUpload> ...'Default' 'Telegram_RetryAfterFailSeconds' value was set to '300' seconds, so not retrying until 9/20/2020 11:50:00 AM
[20.09.2020, 11:45:00.406]: Trigger> Error: Could not load file or assembly 'System.Buffers, Version=4.0.2.0, Culture=neutral, PublicKeyToken=################' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040) [FileLoadException] Mod: <Trigger>d__32 Line:1570:29

 

[Chris Dodge]

@hapstabu - the latest version fixes that:

Releases · VorlonCD/bi-aidetection

Alarm system for Blue Iris based on Artificial Intelligence. - VorlonCD/bi-aidetection

github.com

 

[hapstabu]

@hapstabu - the latest version fixes that:

Releases · VorlonCD/bi-aidetection

Alarm system for Blue Iris based on Artificial Intelligence. - VorlonCD/bi-aidetection

github.com

Thank you, I will try it.

 

[hapstabu]

Hello to all and thank you to GentlePumpkin and Chris Dodge for all your work on this project. This does a fantastic job of reducing false alerts from shadows of blowing leaves that have plagued me since starting with surveillance software.

I have been using two versions of Chris Dodge's project, and have come up with an issue sending alerts to Telegram. The first version that I used would send alerts to Telegram with no issues, however, I downloaded the latest version, and it is failing to send alerts.

If I use the test button in the Camera Actions page, it will give me a "Succeeded" popup, but the alerts will error out when trying to send to Telegram.

Errors seem to indicate an issue with the version of Newtonsoft.json.dll. I have checked, and I have ~15 instances of that file on my Windows 10 machine with versions ranging from 6.x to 12.x.

Any Ideas? Following are snips from log files from the 9/3/20 build that works, and the 9/17/20 build that does not work. Thanks in advance.

From Version 1.67.8.35473 built on 9/3/2020 6:42:26 PM
[19.09.2020, 12:27:21.695]: Trigger> Uploading image to Telegram...
[19.09.2020, 12:27:21.757]: TelegramUpload> uploading image to chat "##########"
[19.09.2020, 12:27:24.256]: TelegramUpload> ...Finished in 2499ms
[19.09.2020, 12:27:24.264]: Trigger> -> Sent image to Telegram.


From Version 1.67.8.22287 built on 9/17/2020 11:22:54 AM
[20.09.2020, 11:45:00.318]: TelegramUpload> uploading image to chat "-##########"
[20.09.2020, 11:45:00.370]: TelegramUpload> ERROR: Could not upload image C:\Users\ftsadmin\AppData\Local\Temp\Prater.20200920_114457814.jpg to Telegram: Could not load file or assembly 'Newtonsoft.Json, Version=11.0.0.0, Culture=neutral, PublicKeyToken=################' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040) [FileLoadException] Mod: <TelegramUpload>d__30 Line:1342:33
[20.09.2020, 11:45:00.374]: TelegramUpload> ...'Default' 'Telegram_RetryAfterFailSeconds' value was set to '300' seconds, so not retrying until 9/20/2020 11:50:00 AM
[20.09.2020, 11:45:00.406]: Trigger> Error: Could not load file or assembly 'System.Buffers, Version=4.0.2.0, Culture=neutral, PublicKeyToken=################' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040) [FileLoadException] Mod: <Trigger>d__32 Line:1570:29

Thank you Chris Dodge, this is resolved by Version 1.67.8.21724 built on 9/20/2020 11:04:09 AM

Working great!

 

[gmouer]

Are there current installation/setup instructions anywhere? I would like to try this AI but everything I found points to this thread (1-1/2yr old, 87 pages) as the installationsetup instructions ! I looked through many pages of the thread and see that the software has undergone so many changes since it first came out that the early installation/setup instructions are probably not valid anymore. I see that most of this thread is very experienced users that have followed the project closely. I am a newcomer that would like very much to try the AI but very confused where to even start.

 

[bat1939]

Are there current installation/setup instructions anywhere? I would like to try this AI but everything I found points to this thread (1-1/2yr old, 87 pages) as the installationsetup instructions ! I looked through many pages of the thread and see that the software has undergone so many changes since it first came out that the early installation/setup instructions are probably not valid anymore. I see that most of this thread is very experienced users that have followed the project closely. I am a newcomer that would like very much to try the AI but very confused where to even start.

Watch this video from The Hookup to get you started.

 

[105437]

VorlonCD mod updates:


That is the correct setting. You probably just need to make sure all instances of AITOOL.EXE are closed before modifying the file. But the real answer is to find some way in BI to reduce the number of images created, and to add more deepstack servers to the list. Sure you have BI set to "only when triggered"? Reduce jpeg snapshot each mm:ss ?

Thanks for the reply @Chris Dodge! I created a different folder for the AI snapshots and limited the snapshots to every 3 seconds. Each clip is stored there for an hour and then deleted. I'm sure I'll have additional questions so I really appreciate your patience and help!

 

[juched]

Drop the container docker and install SSH and WebTerminal addon in HA(remember to set a password before it can be started)
open the addon page and then run this command to start deepstack

docker run --restart=always -e VISION-DETECTION=true -v localstorage:/datastore -p 83:5000 --name deepstack deepquestai/deepstack

View attachment 70823

after you have setup the new docker it will show in portainer so you can manage it there if you want.

Note!
if you dont have deepstack already in docker you need to run this first

docker pull deepquestai/deepstack

UPDATE!
Was to happy way to early....still error in AI. But if i run it manually from a cmd and with curl all my attempt is success. Why?

[19.09.2020, 07:20:08.887]: Starting analysis of D:\aiinput\altansd.20200919_072008903.jpg
[19.09.2020, 07:20:08.900]: (1/6) Uploading image to DeepQuestAI Server
[19.09.2020, 07:20:08.950]: (2/6) Waiting for results
[19.09.2020, 07:20:09.029]: (3/6) Processing results:
[19.09.2020, 07:20:09.033]: System.NullReferenceException | Object reference not set to an instance of an object. (code: -2147467261 )
[19.09.2020, 07:20:09.036]: ERROR: Processing the following image 'D:\aiinput\altansd.20200919_072008903.jpg' failed. Failure in AI Tool processing the image.
[19.09.2020, 07:20:13.820]:
[19.09.2020, 07:20:13.823]: Starting analysis of D:\aiinput\altansd.20200919_072013908.jpg
[19.09.2020, 07:20:13.826]: (1/6) Uploading image to DeepQuestAI Server
[19.09.2020, 07:20:13.833]: (2/6) Waiting for results
[19.09.2020, 07:20:13.837]: (3/6) Processing results:
[19.09.2020, 07:20:13.840]: System.NullReferenceException | Object reference not set to an instance of an object. (code: -2147467261 )
[19.09.2020, 07:20:13.843]: ERROR: Processing the following image 'D:\aiinput\altansd.20200919_072013908.jpg' failed. Failure in AI Tool processing the image.
[19.09.2020, 07:26:24.238]:
[19.09.2020, 07:26:24.241]: Starting analysis of D:\aiinput\altansd.20200919_072624506.jpg
[19.09.2020, 07:26:24.244]: (1/6) Uploading image to DeepQuestAI Server
[19.09.2020, 07:26:24.252]: (2/6) Waiting for results
[19.09.2020, 07:26:24.255]: (3/6) Processing results:
[19.09.2020, 07:26:24.259]: System.NullReferenceException | Object reference not set to an instance of an object. (code: -2147467261 )
[19.09.2020, 07:26:24.262]: ERROR: Processing the following image 'D:\aiinput\altansd.20200919_072624506.jpg' failed. Failure in AI Tool processing the image.

This is going to sound silly, but the "true" needs to be "True" to work.

docker run --restart=always -e VISION-DETECTION=True -v localstorage:/datastore -p 83:5000 --name deepstack deepquestai/deepstack

 

[B-Murda]

@Chris Dodge

Keep up the awesome work! We're lucky to have you improving this while our other buddy is busy. Excited to see the two merge into one and you two maybe combining forces hah!

Question for ya.
I changed to yours a bit back but haven't had time to fiddle with it too much.
One odd thing I noticed (may have missed a post and don't see on the repo mentioned) is thatyours seems to use a json file for the settings. How does this relate to the .txt ones?
What I am finding is in yours for example it's not showing any of the relevant things enabled yet they are working. Is it reading this from the txt file ones or if none are enabled it's just using all of them maybe lol?
Are the txt files used at all on yours?

Also a bug maybe on this latest one, unless someone else can confirm. Having it run at startup (via the setting in it, which just adds the registry entry) it is now throwing an error saying the start in folder is not the same after reboots. I didn't have this issue until after updating and am fairly sure I'd rebooted from a windows update the day before fine but thought would mention in case it's realted. I togged it off and on and same issue still. When the error happens I see the AI icon in the taskbar for a moment so it's like it runs and dies off instantly with that error. Thoughts?

 

[Chris Dodge]

@B-Murda - Upon first run (when it doesnt see the JSON file) it migrates all old settings from AITOOL.EXE.CONFIG (or WindowsFormsApp2.user.config) and all the \camera\*.txt files all into AITOOL.SETTINGS.JSON file. So nothing is read from those original camera txt files after the first import.

The error about the start in folder is fixed in the latest build. If you dont see it fixed with the latest file on the releases page (I updated the zip file a few days ago), watch for a new release in a day or two.

 

[kalyway]

@Chris Dodge - Just wanted to comment and say your most recent release (1.77) is truly amazing! Having the ability to send MQTT messages with different variables in the topic and payload seriously reduces the amount of legwork I had to do in order to get person detection properly working with HASS. I am allowing a ton of motion events, even shadows triggering and such, and the dynamic masks just make this one of the BEST forks/tools I've seen for doing AI detection. Thank you so much for taking time to keep this tool updated with new and useful features! (I'm using a 6700 with BI and deepstack running on it)

It has seriously changed my entire setup and works pretty well.