It will depend on if your router supports it. It’s called site-to-site VPN. I use Peplink routers in three locations and have all three of them running in a site-to-site VPN so I can access all of them from any of the three locations.
Do a search on site to site vpn for your specific brand router.