It might not be power itself, but due to many contacts for ethernet wires, poe-adapter in, out,... one single bad contact can cause the eth link to fail. So the risk of having exactly the behaviour you described, is pretty high.
Off couse you can try it on another ethernet switch or dig even...