Should I remove my front gate?

You sound like my therapist
 
I would keep the gate, never hurts to have extra layer of security to front door.

If you need to improve curb appeal, maybe add a decorative screen like
image_99a1711.png