@mkkoskin and @naviathan had the trick for me.
Changing my stream to TCP/554 instead of UDP/80 made a huge difference for my camera setup. I used Zoneminder to ONVIF tem. then tweaked the settings to TCP port 554.
rtsp:/admin:mysecurepassword@192.168.1.211:554/0