Some Hikvision bullets have a phsyical reset button - which model is yours?
On a mini-bullet, it's located at the back of the camera
On a varifocal bullet, you can find it by unscrewing the cap of the camera, at the front.
Couple of pictures to show where, attached.
Depending on the model and firmware version of your NVR, you may also be able to activate a feature called Virtual Host (via a web browser, Configuration >> Network >> Advanced Settings >> Other) which will allow you to connect to cameras connected to the POE ports directly through a web browser. Once you've enabled it, navigate to System >> Camera Management.
Otherwise though, the exterior POE switches you've ordered should be much more flexible