Hell Yeah! Direct Deepstack Integration - 5.4.0 - March 31, 2021

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
I am using ONVIF triggers and BI deepstack and it works as intended...
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
It has worked for me since Deepstack AI was introduced in BI. I am on the current one right now just released today.
 

maximosm

Young grasshopper
Joined
Jan 8, 2015
Messages
95
Reaction score
6
I have test Also with disabled onvif triggers and with move sensor of Bi active but i have the same result .It have not to do with the onvif.
 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
I could be wrong, But Seems like for me something weird during export.

So when I switched the cam to view in sub stream option. When I try to export the clip it only is giving me Sub Stream not main stream export no matter if, I check off the box while exporting and choosing not to use sub stream when available for export.

Can someone check this ? I just switch the main stream solo option off for that cam and exported seems like now I am exporting main stream fine. But when that sub stream option is check to view seems like cannot get to export main stream video.
 

Dave Lonsdale

Pulling my weight
Joined
Dec 3, 2015
Messages
456
Reaction score
195
Location
Congleton Edge, UK
Your confusing me with the offloading. I don't fully understand your hardware configuration maybe draw it out. So I was re-reading your post on the previous page so your using three NICs, built-in nic for internet, and 2 of your additional 4 ports connected to two 16 port poe switches then your cameras? How many cameras are your talking about? Do you need 16 ports?
To jump back briefly to my system configuration with its saturated ethernet port, thank you RevJoe for prompting me to think more carefully about what I have and what I need. So I sketched out my system (including what I want) as you suggested. It's attached. The physical location of things does lend itself to using a third switch - the one wildlife camera I have at the moment is a big Dahua SD-59225-HNI PTZ so definitely needs another PoE+ / 802.3at switch. I hope that transferring three cameras away from the TPE-160 will bring its traffic down to an acceptable level. I'm sure it's the same for many others, systems evolve and grow over time - so you're stuck with much of what you already have.

I have one question - If I were to buy a (I'm guessing managed) switch specified at 1Gbit, do they all gather together data from their ports running at 100Mbit and upscale them into a 1Gbit stream if that upstream port is connected to a 1Gbit device (ie the network card)?
 

Attachments

As an Amazon Associate IPCamTalk earns from qualifying purchases.

RevJoe

Getting the hang of it
Joined
Jun 15, 2020
Messages
92
Reaction score
36
Location
NM
To jump back briefly to my system configuration with its saturated ethernet port, thank you RevJoe for prompting me to think more carefully about what I have and what I need. So I sketched out my system (including what I want) as you suggested. It's attached. The physical location of things does lend itself to using a third switch - the one wildlife camera I have at the moment is a big Dahua SD-59225-HNI PTZ so definitely needs another PoE+ / 802.3at switch. I hope that transferring three cameras away from the TPE-160 will bring its traffic down to an acceptable level. I'm sure it's the same for many others, systems evolve and grow over time - so you're stuck with much of what you already have.

I have one question - If I were to buy a (I'm guessing managed) switch specified at 1Gbit, do they all gather together data from their ports running at 100Mbit and upscale them into a 1Gbit stream if that upstream port is connected to a 1Gbit device (ie the network card)?
No. The end to end connection between any one point depends on the links involved. so if you have a 100MB switch between the cams and the the main 1GB switch the link from cam to 1gb switch is 100mb. think of the link speed as your pipe diameter. your speed between points is always at the lowest diameter of the pipe. that being said if your pc goes to the 1gb switch and then that switch links to the 100mb switch, and other items and assuming those other items are spewing network traffic on the 1gb switch meant for our pc then your link to the 1gb switch is going to use that 1 GB pipe and your port usage will vary based on the amount of traffic pointed at your pc. But if you only have traffic coming from the 1 100MB switch then your pc will have a 1GB link to the switch but your monitored traffic usage should be right around 100MB assuming your 100MB switch is saturated. Does that make sense?

You should check ebay for a 1GB poe managed switch. I bought a 48 Port Extreme 460-G2 for 800USD last year. There were a lot of other deals I went with that one because I work with those at work, it was a bit of over kill for my home solution, but has about 25 ports open for expansion. I currently only run 4 cameras, I want to get 4 or 5 more. Just got to get the wife on board with them.

**Edited for some clarity and typos.
 
Last edited:

Dave Lonsdale

Pulling my weight
Joined
Dec 3, 2015
Messages
456
Reaction score
195
Location
Congleton Edge, UK
Dear RevJoe, thanks again for the explanation, even though I may still be missing a key point. Following on from your suggestion and before sending my previous message I did look at the spec for several managed switches and as you have now clarified, I didn’t find rate conversion (100Mbit to 1Gbit). So, bearing in mind that CCTV IP cameras operate at 100Mbit, I’m afraid I still fail to see the point of buying a switch that is either capable of 1Gbit or is managed.

So, we‘re back to where I started, checking out with you guys that the best solution to solve a saturated NIC port running at 100Mbit is to move some of the cameras to another NIC port via a 100Mbit switch having a sufficient power budget - isn’t it? - as per my sketch.

If true, it makes you realise that a multi port NIC is a fabulous product. Not only can it be configured to shield cameras from the Internet, it can also handle 100Mbit on all ports simultaneously. And is cheap to buy.
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,428
Reaction score
47,549
Location
USA
It comes down to available capacity - just like we don't want our BI computer to be running at 100% CPU, we don't want a switch running at 100% capacity either. It runs hotter and can shorten the life, and is now a bottleneck potentially in the whole system.
 

JL-F1

Getting the hang of it
Joined
Jun 12, 2020
Messages
115
Reaction score
71
Location
USA
I have an issue I've seen and proved while watching live:

The camera is already triggered from wind, then around 5-10 seconds into the still triggered from motion a car drives by and BI/DS misses it. I assume this is because it analyzed the first 5 secs of images and missed the car at 6 secs in?

Would it fix to change the number of analyzed images to the same as the break time: 10 at 1 sec with break time at 10 sec?
 

RevJoe

Getting the hang of it
Joined
Jun 15, 2020
Messages
92
Reaction score
36
Location
NM
Dear RevJoe, thanks again for the explanation, even though I may still be missing a key point. Following on from your suggestion and before sending my previous message I did look at the spec for several managed switches and as you have now clarified, I didn’t find rate conversion (100Mbit to 1Gbit). So, bearing in mind that CCTV IP cameras operate at 100Mbit, I’m afraid I still fail to see the point of buying a switch that is either capable of 1Gbit or is managed.

So, we‘re back to where I started, checking out with you guys that the best solution to solve a saturated NIC port running at 100Mbit is to move some of the cameras to another NIC port via a 100Mbit switch having a sufficient power budget - isn’t it? - as per my sketch.

If true, it makes you realise that a multi port NIC is a fabulous product. Not only can it be configured to shield cameras from the Internet, it can also handle 100Mbit on all ports simultaneously. And is cheap to buy.
Maybe this will help you figure out your bandwidth issues needs

I get what your doing, your trying to offload some of the workload form the trendnet to the outbuilding. I am assuming your intending to buy a another switch for there. If it was me I would got POE GB switch right there in your house and move the trendnet to the outbuilding and route that input into your GB switch. Ignore that the cameras are only using 100MB ports that's not the issue here. The issue is the pipe between the switches and your PC.

Do you POE Injectors? Maybe some that came with your various cameras your not using? If so then use them in the out building and use a 1GB unmanaged switch then you have some room for the additional cams your planning if I read the diagram right. Your issue is your network bandwidth not your cameras. I get there is a cost but a its a one time cost to future proof if your not done expanding. But if your not adding more cams then your method is the cost effective way.

Have you considered optimizing the frame rates and format being used? I am using H.265, FPS 20, and VBR for my bit rate. I am avg 15MB on my BI ethernet for my 4 cameras. H264 will use more then the H265. Also for reference my switch runs several VLANs. My main data VLAN which includes the internet and a camera only one VLAN for BI.

Also keep in mind your PC only has so much processing abilities and in and out lanes (Known as HSIO and PCI-E Lanes) you can hit a wall, as those items are limited on based on your CPU and motherboard build, when this happens the bottleneck is now the PC not the network.

Anyways its all food for thought.
 

RevJoe

Getting the hang of it
Joined
Jun 15, 2020
Messages
92
Reaction score
36
Location
NM
I have an issue I've seen and proved while watching live:

The camera is already triggered from wind, then around 5-10 seconds into the still triggered from motion a car drives by and BI/DS misses it. I assume this is because it analyzed the first 5 secs of images and missed the car at 6 secs in?

Would it fix to change the number of analyzed images to the same as the break time: 10 at 1 sec with break time at 10 sec?
Might also be the options for retriggers. I need to fine tune my retrigging settings. I been lazy this last week I need to devote a full night of going through all my alerts to tweak the motion zones, and triggers and the timing of the retriggers I am also behind several version of BI, which might be way my ONVIF stuff is not triggering deepstack. I am also considering trying out deepstack cpu to see what the processing time and cpu usage might be my gt1030 avgs 250ms when processes a image. GPU prices on ebay are crazy.
 

Dave Lonsdale

Pulling my weight
Joined
Dec 3, 2015
Messages
456
Reaction score
195
Location
Congleton Edge, UK
Maybe this will help you figure out your bandwidth issues needs

I get what your doing, your trying to offload some of the workload form the trendnet to the outbuilding. I am assuming your intending to buy a another switch for there. If it was me I would got POE GB switch right there in your house and move the trendnet to the outbuilding and route that input into your GB switch. Ignore that the cameras are only using 100MB ports that's not the issue here. The issue is the pipe between the switches and your PC.

Do you POE Injectors? Maybe some that came with your various cameras your not using? If so then use them in the out building and use a 1GB unmanaged switch then you have some room for the additional cams your planning if I read the diagram right. Your issue is your network bandwidth not your cameras. I get there is a cost but a its a one time cost to future proof if your not done expanding. But if your not adding more cams then your method is the cost effective way.

Have you considered optimizing the frame rates and format being used? I am using H.265, FPS 20, and VBR for my bit rate. I am avg 15MB on my BI ethernet for my 4 cameras. H264 will use more then the H265. Also for reference my switch runs several VLANs. My main data VLAN which includes the internet and a camera only one VLAN for BI.

Also keep in mind your PC only has so much processing abilities and in and out lanes (Known as HSIO and PCI-E Lanes) you can hit a wall, as those items are limited on based on your CPU and motherboard build, when this happens the bottleneck is now the PC not the network.

Anyways its all food for thought.
OK thanks RevJoe, I’ll chew some of this over.
 

IAmATeaf

Known around here
Joined
Jan 13, 2019
Messages
3,287
Reaction score
3,252
Location
United Kingdom
At Dave, even though the cams are only 100mbs the connection back to your BI PC is also only 100mbs which is what is being saturated. Also don’t forget that TCP/IP networks due to the way they work don’t really like or perform that well once they reach level of 65% saturation as you end up with collisions and fallbacks.

This is why I ensured that any uplink connections on my switches are 1gbs back to the BI PC.
 

Dave Lonsdale

Pulling my weight
Joined
Dec 3, 2015
Messages
456
Reaction score
195
Location
Congleton Edge, UK
At Dave, even though the cams are only 100mbs the connection back to your BI PC is also only 100mbs which is what is being saturated. Also don’t forget that TCP/IP networks due to the way they work don’t really like or perform that well once they reach level of 65% saturation as you end up with collisions and fallbacks.

This is why I ensured that any uplink connections on my switches are 1gbs back to the BI PC.
Very useful feedback IAmATeaf to have 65% as a maximum target level. Many thanks for that.
I still struggle, though, to understand the 1gbs advice from RevJoe and you. Are you saying that if you use a 1gbs switch connected to only to several 100gbs cameras (limiting the PC uplink speed to 100gbs), then this is better than using a 100mbs switch? Putting other system limitations to one side - why?
 

sebastiantombs

Known around here
Joined
Dec 28, 2019
Messages
11,511
Reaction score
27,690
Location
New Jersey
The PoE ports don't need to be 1GB, 100MB is fine. The UPLINK port(s) need to be 1GB though. The UPLINK port(s) carry the total traffic of all the other ports of the switch. The total "speed", all the traffic, of the cameras is on the uplink port(s). If the PoE switches are aggregated in another switch that switch needs all ports to be 1GB since each port will be carrying the total traffic of the switches feeding it. I have two PoE switches, 100MB for the cameras and 1GB uplinks, feeding a 1GB dual port network card in the BI PC. No bottle necks anywhere and the dual port card isn't even being "tickled" by the switches. Each port on that card is running 100-110 Mb/PS.
 
Last edited:

Edcfish

Pulling my weight
Joined
May 31, 2019
Messages
124
Reaction score
121
Location
USA
Here is another way to look at it.
If you have 10 cameras and each of your cameras are consistently using 20% (20MB) of the 100MB connection from the camera to the switch; with 10 cameras all on and using that 20MB aggregated is now 200MB total bandwidth coming into ( and needing to go out of ) the switch.

The total bandwidth needed from the switch to the PC in order to not lose any data is now double the capacity of the actual 100MB uplink to the PC.

If that uplink to the PC were 1GB (1000MB for ease of math) then you would only be using 20% of the total bandwidth (200MB of 1000MB) between the switch and the PC, leaving plenty of headroom.

And as has already been said, the theoretical maximum is significantly higher than the real world maximum. That 65% is pretty dead on for every decent brand of switch I have used...there were a couple of no name-ish type 5 port switches i used to have that seemed to bog down after a few minutes of any sort of continuous streaming.

I use a switch similar to this one: D-Link PoE+ Switch at Amazon

Depending on exactly what your needs are, there are certainly smaller and cheaper models available such as this one: NETGEAR 5-Port Gigabit Ethernet Unmanaged PoE Switch at Amazon
 
As an Amazon Associate IPCamTalk earns from qualifying purchases.

Dave Lonsdale

Pulling my weight
Joined
Dec 3, 2015
Messages
456
Reaction score
195
Location
Congleton Edge, UK
Here is another way to look at it.
If you have 10 cameras and each of your cameras are consistently using 20% (20MB) of the 100MB connection from the camera to the switch; with 10 cameras all on and using that 20MB aggregated is now 200MB total bandwidth coming into ( and needing to go out of ) the switch.

The total bandwidth needed from the switch to the PC in order to not lose any data is now double the capacity of the actual 100MB uplink to the PC.

If that uplink to the PC were 1GB (1000MB for ease of math) then you would only be using 20% of the total bandwidth (200MB of 1000MB) between the switch and the PC, leaving plenty of headroom.

And as has already been said, the theoretical maximum is significantly higher than the real world maximum. That 65% is pretty dead on for every decent brand of switch I have used...there were a couple of no name-ish type 5 port switches i used to have that seemed to bog down after a few minutes of any sort of continuous streaming.

I use a switch similar to this one: D-Link PoE+ Switch at Amazon

Depending on exactly what your needs are, there are certainly smaller and cheaper models available such as this one: NETGEAR 5-Port Gigabit Ethernet Unmanaged PoE Switch at Amazon
Oh dear, sebastiantombs and Edcfish, will I ever get to the bottom of this one? Firstly, please believe me when I say that it’s easy to understand that the data from all the camera ports in a switch must add arithmetically not to lose data in the upstream port. However, RevJoe’s advice to select a 1Gbit switch prompted me to sketch my system and ask the following question in post #426:-

I have one question - If I were to buy a (I'm guessing managed) switch specified at 1Gbit, do they all gather together data from their ports running at 100Mbit and upscale them into a 1Gbit stream if that upstream port is connected to a 1Gbit device (ie the network card)?

His answer was in post #427 was “NO”. He did introduce other considerations but my post #428 was an attempt to stick with the one key question. So what is the definitive answer? If RevJoe is correct and the 1Gbit upstream port in the switch auto-negotiates down to 100Mbit then we‘re back to my post #435.
 
As an Amazon Associate IPCamTalk earns from qualifying purchases.

sebastiantombs

Known around here
Joined
Dec 28, 2019
Messages
11,511
Reaction score
27,690
Location
New Jersey
All I can relate to you is that plugging in to the 1GB ports of my switches results in a 1GB connection to my PC. The NIC in the PC is set to auto negotiate, but the output port of the switch is 1GB. The switches are IPCamPower. In my mind, and I did some network installations as well as network administration for years, if there are 10 ports on a switch getting hit with 100MbPS from each port the aggregate traffic to the 1GB port is, indeed, 1GB. This is simply because a total of 1GB of data is being "combined" at that port. There's more involved, in the electronics of course and some overhead may be removed during aggregation, but the net result is ~1GB at the 1GB port.
 
Last edited:

Dave Lonsdale

Pulling my weight
Joined
Dec 3, 2015
Messages
456
Reaction score
195
Location
Congleton Edge, UK
OK sebastiantombs, thanks for the reply. It would seem to me to be very do-able - you write the data from each camera port into a registers at 100Mbit and then read them sequentially at 1000Mbit for the upstream port. I wonder if some switches are clever enough to do that by detecting the 1Gbit NIC interface speed automatically without being ‘managed’. What about yours - did you have to configure it? Is there any chance, please that you could tell me the model number of your switches? Hopefully, there’s a manual on the Internet.
 
Top