Cameras dropping out

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
I’m running 8 cameras of different types on a server grade machine that should clearly be able to support them. However, I’m getting seemingly random camera drop outs that result in very short clips and gaps in between with the result that critical information is lost.

The server is a dual Xeon with 12GB of memory and I’m storing onto a 3TB external drive. CPU utilization generally runs 25%, or less, to maybe 40%. There are a couple of 1920 cameras, a couple of 640, and some 1080, and although they are all set to record continuously they are also set at 5FPS and with 2-5MB buffers that I just increased to 20MB. Recording is set for 8 hour blocks and 30GB per. No audio.

I’m also noticing that the default folders “New” and “Storage” don’t seem to be performing as I expect in that there are random very old files in New that it seems should not be there, and likewise some files in Storage that appear out of place as being too recent. I thought that the software routinely moved aged files from New to Storage at some interval, but that does not seem to be the case.

I’m sure I’m missing something here. Just can’t figure out what it is. Any suggestions would be welcome. Thanks.

LL
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
What cameras? What version of blue iris?
Sometimes the database becomes corrupt and old files are not deleted. You need to regenerate or repair it.
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
What cameras? What version of blue iris?
Sometimes the database becomes corrupt and old files are not deleted. You need to regenerate or repair it.
BI is the most current version since we keep it updated with each launch. BI id run as a service. The program is not kept active. The cameras are a mix including a couple of HooToo PTZ but most of the rest are IPC-HDW3100S. The problem does not seem to be camera related.

How are the DB's regenerated or repaired?
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
BI is the most current version since we keep it updated with each launch. BI id run as a service. The program is not kept active. The cameras are a mix including a couple of HooToo PTZ but most of the rest are IPC-HDW3100S. The problem does not seem to be camera related.

How are the DB's regenerated or repaired?
Right click on the clips >database
If that doesnt solve the database issue...simply delete the "db" folder and restart blue iris..it will rebuild the database.
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
Right click on the clips >database
If that doesnt solve the database issue...simply delete the "db" folder and restart blue iris..it will rebuild the database.
The right click didn't seem to do anything so I deleted the DB folder and it seems to be rebuilding. Thanks.

About the New v Storage, Is it the case the BI moves files from New to Storage periodically, and it it is supposed to do that, is there a set interval, is it storage capacity driven, or what? And, does it make sense to manually move things that are now out of place? For example I have a few files from March still in the New folder when I would really expect only files from, say, July.
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
The right click didn't seem to do anything so I deleted the DB folder and it seems to be rebuilding. Thanks.

About the New v Storage, Is it the case the BI moves files from New to Storage periodically, and it it is supposed to do that, is there a set interval, is it storage capacity driven, or what? And, does it make sense to manually move things that are now out of place? For example I have a few files from March still in the New folder when I would really expect only files from, say, July.
You would need to right click on the clip list on the right side of the screen....But deleting the DB folder is actually the best way.
After the revuild it should eventually move the old data. It will only move the data if you specified the movement.You can set it to move based on time or capacity or both, but capacity is what should be used..why delete footage simply by date if you have more room. If you are storing the data on a single drive, its pretty much pointless to move the clips into a new folder..simply just use the new folder and set it to delete afterwards...
the settings are in blue iris options>clips and archiving.
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
You would need to right click on the clip list on the right side of the screen....But deleting the DB folder is actually the best way.
After the revuild it should eventually move the old data. It will only move the data if you specified the movement.You can set it to move based on time or capacity or both, but capacity is what should be used..why delete footage simply by date if you have more room. If you are storing the data on a single drive, its pretty much pointless to move the clips into a new folder..simply just use the new folder and set it to delete afterwards...
the settings are in blue iris options>clips and archiving.
Great. Thanks for the pointers. Circling back to my original topic of short file clips, do you think that problem is related to the DB and file retention problem?
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
Great. Thanks for the pointers. Circling back to my original topic of short file clips, do you think that problem is related to the DB and file retention problem?
No the dropouts are not related to the database...its a signal issue..can be the cams, the network, the blue iris pc, blue iris...
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
No the dropouts are not related to the database...its a signal issue..can be the cams, the network, the blue iris pc, blue iris...
OK, sounds like more digging is needed. BTW, the DB rebuild did sort out the new/old file issue without any help from me. In checking the clips/archiving settings as you recommended I noticed that the New folder had a size limit of only 29GB. I reset it to 400GB with a 7 day retention. Easy enough since I have 3TB available exclusively to BI. I'll give it some time to see if that has any effect on the drop problem before spending more time on this.

Thanks for the pointers, Very helpful!
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
OK, sounds like more digging is needed. BTW, the DB rebuild did sort out the new/old file issue without any help from me. In checking the clips/archiving settings as you recommended I noticed that the New folder had a size limit of only 29GB. I reset it to 400GB with a 7 day retention. Easy enough since I have 3TB available exclusively to BI. I'll give it some time to see if that has any effect on the drop problem before spending more time on this.

Thanks for the pointers, Very helpful!
No problem...I would not use the 7 day retention...why delete clips early if you have the space?
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
No problem...I would not use the 7 day retention...why delete clips early if you have the space?
I assumed the 7 day setting applied only to the New folder since that's where this setting is and there's no such setting in Storage. Not so?
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
I assumed the 7 day setting applied only to the New folder since that's where this setting is and there's no such setting in Storage. Not so?
Any of the folders, new, storage, alerts, clips..can have a set day limit...the point is, why use it...simply use the folder size as the limitation...why delete clips before you need the space...
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
Any of the folders, new, storage, alerts, clips..can have a set day limit...the point is, why use it...simply use the folder size as the limitation...why delete clips before you need the space...
OK, reasonable. I was just truing to keep New to a manageable size given that I have 8 cameras going there. I have recording set to 8 hour blocks meaning 2 blocks per day, times 7 days, times 8 cameras, making finding a given file reasonable easy. Having the size limit at 400GB then makes the 7 day limit trigger transfer to Storage (where they remain until the drive gets full before starting to over-wright), eliminating bumping up to a storage limit as having any possible impact on the drop problem.
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
OK, reasonable. I was just truing to keep New to a manageable size given that I have 8 cameras going there. I have recording set to 8 hour blocks meaning 2 blocks per day, times 7 days, times 8 cameras, making finding a given file reasonable easy. Having the size limit at 400GB then makes the 7 day limit trigger transfer to Storage (where they remain until the drive gets full before starting to over-wright), eliminating bumping up to a storage limit as having any possible impact on the drop problem.
If storage is on the same drive as the new, there is no benefit this dual folder setup...might as well leave it all in the new folder...
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
If storage is on the same drive as the new, there is no benefit this dual folder setup...might as well leave it all in the new folder...
I understand, and from the perspective of storage capacity you are absolutely correct. My perspective is that when I'm looking to excerpt a segment from the camera files it's most often because of an incident within the past few days, usually withing the past week. And, I'm frequently looking for segments from more than one camera. If I set a 7 day limit on New then I'm only scanning through 1344 files (3per dayX 7days X8 cameras) to find the 1 or 2 files I need. If everything is in a single folder, and remember the target drive is 3TB, then I'm scanning WAY more to find what I need. And, the only way to limit that is to set an overall storage limit, which would seem to defeat the purpose of having tiered storage.
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
I understand, and from the perspective of storage capacity you are absolutely correct. My perspective is that when I'm looking to excerpt a segment from the camera files it's most often because of an incident within the past few days, usually withing the past week. And, I'm frequently looking for segments from more than one camera. If I set a 7 day limit on New then I'm only scanning through 1344 files (3per dayX 7days X8 cameras) to find the 1 or 2 files I need. If everything is in a single folder, and remember the target drive is 3TB, then I'm scanning WAY more to find what I need. And, the only way to limit that is to set an overall storage limit, which would seem to defeat the purpose of having tiered storage.
That is what the clips viewer and timeline are for. There is no need to look for the files in their respective folders, unless I'm not understanding what you are doing..
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
That is what the clips viewer and timeline are for. There is no need to look for the files in their respective folders, unless I'm not understanding what you are doing..
Maybe we're using different methods for viewing and extracting from old files. Let me give you an example, because it could be that I'm not following the easiest path. A typical scenario for me might be that I need to look at what was recorded two days ago between 3:00 and 4:00 PM on 3 of the 8 cameras. I would go to the New folder, find the files for the cameras I'm interested in, and click to open each in turn. I would then mark out the clips I want and export them. Is there an easier way?
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
Maybe we're using different methods for viewing and extracting from old files. Let me give you an example, because it could be that I'm not following the easiest path. A typical scenario for me might be that I need to look at what was recorded two days ago between 3:00 and 4:00 PM on 3 of the 8 cameras. I would go to the New folder, find the files for the cameras I'm interested in, and click to open each in turn. I would then mark out the clips I want and export them. Is there an easier way?
This is how I do it..from the help file.

Bulk Clip Conversion and Export
Select multiple clips in the clips list then right-click and select Convert/Export. The Convert/Export window appears to allow you to make changes to the output folder or output compression format. When you click OK, you will see the clips marked with an export icon in the clips list. As they are converted and exported, you will see these icons turn a sold green. The process occurs as a background task and any errors encountered will be logged to the Status/Messages window.
While clips are waiting to be exported, you may select them and the Convert/Export option to remove them from the queue.
 

LarryL

n3wb
Joined
Aug 20, 2014
Messages
21
Reaction score
1
OK, Haven't tried that method. Actually I don't have the clips list open in part because I usually have all 8 cams open and that really takes all the screen space in order to be viewable. Thanks again for the poointers.
 

fenderman

Staff member
Joined
Mar 9, 2014
Messages
36,897
Reaction score
21,250
Also also remember that you can hold down ctrl and select multiple clips at once to export

Sent via Taptalk
 
Top