Blue iris new to stored not working well

dohat leku

Getting the hang of it
Joined
May 19, 2018
Messages
278
Reaction score
30
Location
usa
Folks

I have a 256gb C drive (SSD and windows folder) and D drive (8tb). One thing that has consistently given me issues is the clips and archiving. Every month, somehow it doesn't move new to stored and then I'm left with 0 bytes left in C Drive. I like to keep the New folder on the SSD since it's much faster and often have to pull up feeds over the last few hours. I run BI as a service. Does anybody know why this fails that often and you facing the same issue?

Also, to rectify, rebuilding the database doesn't do the trick - I have to delete all new and stored files and then it works fine but only for a few weeks. Deleting these files also means I have to let go of all my footage if I need it unless I duplicate it to another computer. Overall a big pain

1624210638397.png


Thx
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,448
Reaction score
47,588
Location
USA
You have it set based on GB, not number of days, so if you haven't reached the GB limit by the end of the month, it isn't moving.

BUT - most of us do not use stored. It is wasting CPU processing and wearing out drives by moving it.

Just put it all in NEW on the D drive and be done with it!
 

biggen

Known around here
Joined
May 6, 2018
Messages
2,539
Reaction score
2,765
will do. Is it better to set by gb or days or both?
It depends on your drive size and how full it is to begin with. 256GB is tiny. Windows probably eats up 20GB of it alone. So for you, if you really insist on moving files around, then I'd set it for X days instead of GB unless you set the GB size real low.

All of my BI installations record directly to mechanical drives and I have no speed issues previewing or playing back clips. You may want to try just recording directly to mechanical as @wittaj suggests to save you the hassle of moving files around all the time.
 

SouthernYankee

IPCT Contributor
Joined
Feb 15, 2018
Messages
5,170
Reaction score
5,320
Location
Houston Tx
I would not be using 180 GB for BI BVR files on a 256 GB SSD drive that is the C system drive. You need space of thing like pagefile, swapfile and upgrade files. DO NOT PUT BVR files on a SSD. I would use no more than 100 GB if you really need to. Note: i started with my continuous BVR files on an SSD, i killed the SSD in a little of 3 months.
==========================
My Standard allocation post.

1) Do not use time (limit clip age)to determine when BI video files are moved or deleted, only use space. Using time wastes disk space.
2) If New and stored are on the same disk drive do not used stored, set the stored size to zero, set the new folder to delete, not move. All it does is waste CPU time and increase the number of disk writes. You can leave the stored folder on the drive just do not use it.
3) Never allocate over 90% of the total disk drive to BI.
4) if using continuous recording on the BI camera settings, record tab, set the combine and cut video to 1 hour or 3 GB. Really big files are difficult to transfer.
5) it is recommend to NOT store video on an SSD (the C: drive).
6) Do not run the disk defragmenter on the video storage disk drives.
7) Do not run virus scanners on BI folders
8) an alternate way to allocate space on multiple drives is to assign different cameras to different drives, so there is no file movement between new and stored.
9) Never use an External USB drive for the NEW folder. Never use a network drive for the NEW folder.


Advanced storage:
If you are using a complete disk for large video file storage (BVR) continuous recording, I recommend formatting the disk, with a windows cluster size of 1024K (1 Megabyte). This is a increase from the 4K default. This will reduce the physical number of disk write, decrease the disk fragmentation, speed up access.
Hint:
On the Blue iris status (lighting bolt graph) clip storage tab, if there is any red on the bars you have a allocation problem. If there is no Green, you have no free space, this is bad.
 

Flintstone61

Known around here
Joined
Feb 4, 2020
Messages
6,587
Reaction score
10,894
Location
Minnesota USA
I have the Db database and "Alerts" going to the SSD. Writing NEW to 2 Western digital 3.5" 5400 rpm drives. No processing wasted on moving to STORED. With 15 cameras 100 residents I get requests to review footage daily. I'm pretty fast at finding recorded video now. People are like "wow".....
What's are the specs of your Blue Iris Machine?
 
Last edited:

dohat leku

Getting the hang of it
Joined
May 19, 2018
Messages
278
Reaction score
30
Location
usa
10 2mp cameras, i5 processor, already getting better performance removing the Stored folder and just keeping new. I'm seeing roughly 50% for cpu & memory now which isn't bad

Am I going to get substantial better access speeds by formatting by 8gb B drive with windows cluster size of 1024K (1 Megabyte)

Thx
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,448
Reaction score
47,588
Location
USA
Which processor - i5 can be on a like 3rd generation to current generation - do you have a 4XXX series or 8XXXX series for example.

Regardless, if you follow EVERY optimization in this wiki, you will see great results. Don't skip any that you think are not important.

Many come here saying they have done every optimization and once they start posting screenshots, we see they are not utilizing substreams...and that is a HUGE saver of CPU.

A member here was running 50 cameras with an i7 4790 and was at 100% CPU and was looking for recommendations for a new machine. After strong persuasion by many of us, he reluctantly agreed to do every optimization and is now at 30% CPU. Direct-to-disc and substreams are a must....

 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,448
Reaction score
47,588
Location
USA
You should be seeing WAY better than 50% CPU, so not every optimization is being utilized or you changed something you thought would lower CPU and is doing the opposite.

Substreams have only been utilized in BI for the past year or so, so if you set it up before then, you are missing out on a great CPU saver.

A 4th generation with over 50 cameras and higher MP cameras is running more efficient than your 6th generation with only 10 cameras of 2MP.

The cluster size recommendation can result in faster retrieval of video, but that isn't the cause for your higher CPU.

Post a screenshot of your Blue Iris status Cameras page as that will begin to figure out what is wrong.

And you are doing direct-to-disc BVR?
 

SouthernYankee

IPCT Contributor
Joined
Feb 15, 2018
Messages
5,170
Reaction score
5,320
Location
Houston Tx
How much memory do you have in the BI PC ?
how many files are in the BI new folder and the BI saved folder ?
are you recording on motion or continuous ?

Screen shots of
1) windows task manager process tab sorted by memory (most at the top), Must contain, memory, disk, network, GPU, GPU engine columns
2) windows task manager performance, GPU (if you have multiple GPUs, then multiple screen shots)
3) Blue Iris Setting about tab (black out your license key)
4) Blue iris status (lighting bolt graph,upper left corner) clip storage tab
5) blue Iris status cameras tab
 

dohat leku

Getting the hang of it
Joined
May 19, 2018
Messages
278
Reaction score
30
Location
usa
  • BI 5.4.5.3 x64 (5/13/2021) from About tab - I only upgrade every 1-2 months or so
  • 8gb memory
  • New has 102 files, 500gb since I just deleted the stored folder yesterday and now only use the New folder (if it gets to 6500gb, it'll delete the files)
  • Continuous motion for all cameras
  • direct to disc is on for all camera in the recording tab

1624306225120.png

1624306403179.png

1624306447553.png


1624306546521.png
 

dohat leku

Getting the hang of it
Joined
May 19, 2018
Messages
278
Reaction score
30
Location
usa
btw, the CPU does range in the 40-60% of the range with the occasional 90% - my remote desktop session usually takes 10-12%

Thx
 

Flintstone61

Known around here
Joined
Feb 4, 2020
Messages
6,587
Reaction score
10,894
Location
Minnesota USA
Dude, try and figure out substreams, and something new I did today. I read the fucking manual, (Thanks Looney) and found out how to have Windows Defender exclusions for the Folder C:\ Blue Iris and process
C:\Program Files\Blur Iris 5\BlueIrisAdmin.exe
also revamped my Windows login to be an administrator with a password, so that the Blue Iris Service can get the required privileges to restart the service.
Checked in an hour later and my CPU was down to 8% at idle. with 15 Cams.
 

Flintstone61

Known around here
Joined
Feb 4, 2020
Messages
6,587
Reaction score
10,894
Location
Minnesota USA
I had something interesting happen with my 8TB WD purp when I set it to 1024K clusters.(Unit Allocation size) I heard some mechanical noises from the heads, and sounded like it was seeking.
I read a forum with a video editing guy. He uses 128K clusters to good effect. So I tried that and the mechanical noise in the drive stopped. SO thats how it's setup right now.
 
Top