AWS Site-to-Site VPN connection is one way to establish this kind of direct connection. VPN enables you to connect to another network and behave as though you are actually on that network.
https://techdirectarchive.com/2023/03/23/how-to-set-up-site-to-site-vpn-connection-on-aws/