LT browser extension over vpn

Hi,

I have deployed LT servers over AWS and connecting to my aws vpc over vpn.
My macbook is getting IP from the VPN ( Local IP 172.23.x.x) and also there is a Public IP on my mac which is from the ISP.
When I am doing a curl to the DNS name of the servers, I can resolve and LT works fine but when I am using the Browser extension, the entire traffic is going over the public IP.
When using curl I see that the traffic is going from the vpn interface and hence working.
My AWS Security Group is only allowing traffic from a Priavte IP subnet(172.23.x.x./24) and hence when using chrome extension, things are not working.
Is there any way to force the traffic from chrome to go via the Private IP?