Cameras getting no signal after hours of Inactive profile?

[pbc]

So weird issue. Since i've been home I've been manually changing the profile to Inactive for 12 hours a day. The other day I did this and one of my cameras didn't come back (said no signal on screen).

Yesterday, did the same thing, and didn't notice until this morning that all cameras were showing as No Signal and the CPU shows as 100%?

Looking at the video, they all crashed at 3pm since I still had 2 cameras recording in Inactive mode.



Cameras are all fine (GUI works), and I had to shut down BlueIris and end the task (via task manager since it is setup to run as a service).

Any idea why it would do this?

 

[pbc]

So happened once again last night, cameras were set to inactive for 12 hours, and just noticed this morning when I checked that the CPU was running at 100% with BlueIris and all cameras had a "no signal' on them. I had to shut down BlueIris and "end task" of the service, at which point the service restarts and everything goes back to normal.

Concerning especially if I go away for a few days.

Any ideas on what I can check to troubleshoot this?

 

[mikeynags]

@pbc not a lot of info here to go on. It could be a networking issue at the Blue Iris machine. Can you give us some detail on what types of cams you are running and the layout of your network? Are the cams wireless/wired etc.

 

[pbc]

System is all wired. I have my i7-6700 Precision Tower 3620 wired to a switch which is connected to my router.

All cameras are POE and in my sig which I'll copy here "Blue Iris/Dell 3620 Precision Tower (i7-6700, 32gb), 2 Hikvision ColorVu DS-2CD2347G1-LU, 1 Dahua IPC-HFW5241E-Z12E (LPR), 6 Dahua IPC-T5442TM-AS ".

Most settings can be found in this post:

CPU running at 100%?

What motion detection settings do have set? Don’t forget that a high resolution camera will mean more stream data for BI to analyse if it’s trying to detect motion.

ipcamtalk.com

Unfortunately my log file doesn't seem to exist in the BlueIris\Log directory. Not sure if that is because I didn't have "Log to file" clicked. Right now the log in the status page starts from when I restarted the service.

 

[pbc]

Also running deepstack with AITools on cloned cameras to send triggers to my cameras using AI to detect just people and cars. Running Open ALPR as well.

 

[pbc]

Strangely, even though the cameras starting with "AI" are cloned and show as not consuming any bitrate, they still basically almost double the CPU usage on BI, not sure if that's because I have the triggers set to "on" on those cameras whereas the main cameras have trigger as off. They are not on continuous record.

 

[pbc]

BTW, just for additional info. Deepstack and AITools might cause an additional 20% or so spike when triggered. OpenALPR maybe another 3% or so as I am using a different GPU.

 

[mikeynags]

You really are pushing that I7-6700 hard I see. For 800-1100 MP/s an i7-8700 is recommended. When you get the No Signal status in BI, how long does it last for? DO you have to bounce the BI service to get the cams back? I'm assuming you are running BI as a service.

 

[pbc]

You really are pushing that I7-6700 hard I see. For 800-1100 MP/s an i7-8700 is recommended. When you get the No Signal status in BI, how long does it last for? DO you have to bounce the BI service to get the cams back? I'm assuming you are running BI as a service.

Seem to get mixed messages on that with some folks noting my usage seems high for that number of cams/MP/s but that the i7-6700 should be more than capable.

So when it happens, the cameras never come back online with BI (even though they are fine when I log into their web GUI's). I have to end the task of BI using task manager, it then restarts itself as a service and all is back to normal. I've only ever seen it happen when I turn the cameras on inactive for several hours.

Will try leaving them active for now and see if it happens again I guess.

 

[pbc]

"4-core CPUs from the Good performance section are sufficient for most users. Past advice says these should be able to run around 40 megapixels worth of cameras (5x 8MP cameras, or 10x 4MP cameras, or 20x 2 MP cameras) if you set conservative frame rates. However Blue Iris has been continuing to improve, and today you can go far beyond previous limits by enabling more powerful software optimizations to reduce the video processing needs. See the CPU optimization guide and sub streams. 6 and 8+ CPU cores are nice if you can afford them, but with a well-optimized configuration you probably won't need them. "

From the BI Hardware thread, I'm running 8x4MP cams with 15 FPS on a "great performance" CPU. Certainly have an issue with why my clone cameras, despite no bit rate and no continuous recording, are almost doubling CPU usage as I thought clones would not be doing that.

But the problem only seems to occur when I have clicked "Inactive" profile and it never goes back to active.

 

[mikeynags]

OK - I was going by one of your screenshots that showed 921 MP/s. Weird that it only does that in the inactive profile. What are you using the inactive profile for? Is it to squelch notifications? My system only runs about 600MP/s and I am running an i7-8700 which runs between 15-20% CPU typically.

 

[pbc]

Yes, that is the MP/s, when I have all cameras enabled. The strange thing is if I disable all the cloned cameras it drops to ~400 MP/s, I assume this is because I have all the motion triggers/settings "on" on my clone cameras and off on the main cameras that are recording all the time. Cams are all 4096 bitrates and 15FPS.

Having said that, for fun I just disabled all my clone cameras, went into my main cameras and turned on their motion triggering, and it goes from ~400 MP/s to 480 MP/s and 25-30% CPU usage then when the clones are on where it jumps to 900+ MP/s and 40% plus usage. Main, figuring out CPU usage can be a PIA.

As for the inactive thing, yes ,with Covid my schedule isn't common, so it's easiest just to put them all Inactive vs being berated with notifications.

 

[pbc]

Hmmm... so first time it has done this in a while, this time had nothing to do with the Inactive profile. Below is the log file entry. Any ideas?

Not sure what the "CGadSocket" entry is?

3     2020-08-25 9:22:44 PM     LPR                     MOTION
3     2020-08-25 9:22:59 PM     LPR                     MOTION
3     2020-08-25 9:25:30 PM     LPR                     MOTION
3     2020-08-25 9:26:03 PM     LPR                     MOTION
0     2020-08-25 9:26:40 PM     New                     Delete: nothing to do [2.14T/2.14T, 594.9G free]
0     2020-08-25 9:26:40 PM     Stored                  Delete: nothing to do [0K/2.14T, 2.70T free]
0     2020-08-25 9:26:40 PM     Alerts                  Delete: nothing to do [105/168 hrs, 0K/1.00G, 378.6G free]
0     2020-08-25 9:26:40 PM     aiinput                 Delete: nothing to do [166/168 hrs, 182.2M/10.0G, 594.9G free]
0     2020-08-25 9:26:40 PM     LPR                     Delete: 20 files 1.29M [504/504 hrs, 26.9G/100.0G, 2.70T free]
1     2020-08-25 9:26:53 PM     GarageDoor              Signal: network retry
1     2020-08-25 9:26:53 PM     Backyard                Signal: network retry
1     2020-08-25 9:26:53 PM     Southwall               Signal: network retry
1     2020-08-25 9:26:53 PM     Garage                  Signal: network retry
1     2020-08-25 9:26:53 PM     Northwall               Signal: network retry
1     2020-08-25 9:26:53 PM     LPR                     Signal: network retry
1     2020-08-25 9:26:53 PM     FrontDoor               Signal: network retry
1     2020-08-25 9:26:53 PM     Driveway                Signal: network retry
2     2020-08-25 9:27:15 PM     Northwall               FORCE quitting CGadSocket thread 18 310 1554480
2     2020-08-25 9:27:15 PM     Backyard                FORCE quitting CGadSocket thread 18 310 1554451
2     2020-08-25 9:27:15 PM     Southwall               FORCE quitting CGadSocket thread 18 310 1554472
2     2020-08-25 9:27:15 PM     FrontDoor               FORCE quitting CGadSocket thread 18 310 1552111
2     2020-08-25 9:27:15 PM     Garage                  FORCE quitting CGadSocket thread 18 310 1293462
2     2020-08-25 9:27:15 PM     GarageDoor              FORCE quitting CGadSocket thread 18 310 1293463
2     2020-08-25 9:27:15 PM     LPR                     FORCE quitting CGadSocket thread 18 310 1552116
1     2020-08-25 9:27:23 PM     FrontDoor               Signal: network retry