Two ISP connection and 4 NIC

I have two ISP connections for Internet and the BM server has four
interfaces, two public interfaces with completely different IP addresses
and two private interfaces.
I want to connect two different Terminal Server one for each ISP
connection.

When I connect to the public side of the server, I can only connect
to the public IP address that is in the same subnet as the default route
uses.

Thank you