Your internet speed has nothing to do with the LAN side.
Having a camera connected to a router is likely the problem. Best practice is to not run a camera thru a router.
Is there anyway you can remove the router from the equation, even temporarily to see the results of the computer connected to the switch the PTZ is on? And the computer makes a difference as well.
Cameras connected to Wifi routers (whether wifi cam or hard-wired) are problematic for surveillance cameras because they are always streaming and passing data. And the data demands go up with motion and then you lose signal or a packet is lost. A lost packet and it has to resend. It can bring the whole network down if trying to send cameras through a wifi router. At the very least it can slow down your entire system.
Unlike Netflix and other streaming services that buffer a movie, these cameras do not buffer up part of the video, so drop outs are frequent, especially once you start adding distance. You would be amazed how much streaming services buffer - don't believe me, start watching something and unplug your router and watch how much longer you can watch NetFlix before it freezes - mine goes 45 seconds. Now do the same with a camera connected to a router and it is fairly instantaneous (within the latency of the stream itself)...
Most consumer grade wifi routers are not designed to pass the constant video stream data of cameras, and since they do not buffer, you get these issues. The consumer routers are just not designed for this kind of traffic, even a GB speed router.
So the more cameras you add, the bigger the potential for issues.