Did you port forward RTSP externally? I forgot this and IP Cam Viewer worked fine but IVMS did not.
Did you select manual ports on the camera (6.3.10 Configuring NAT (Network Address Translation) Settings)?
How many cameras are you using? I had to setup different ports per camera to get mine...