That usage definitely seems high, I believe my system is pushing a lot more through it and has a much older i3 running it.
First suggestion would be to ditch Teamviewer, using native RDP should lower the processor utilization.
Also for the hardware acceleration, have you tried Yes+VideoPostProc...