Hi, I like to know ask to setup the network architecture for multiple servers behind a single port that is persistent.

My setup is

1. Mulitple servers running Enet (UDP custom protocol). The connection are persistent.
.e.g Client A connects to Server B, and the load balancer/router need to route everything.

For HTTP, I can do serverA.domain.com, serverB.domain.com, which the load balancer can use host headers to route. But Enet is UDP and a custom protocol.

Is there a software router to be able to do this? 

Yes there should be stuff around to do this. It works off the source address/port number and using those to identify which server machine to route to. (It needs to be both because of outbound natting -- the same internet IP may represent >1 client).

Magic search term will include "routing" "UDP" and "sticky" or "affinity".

There's going to be a timeout setting within which the packets arriving from a given IP/PORT tuple will be sent to the same target as the previous ones from that tuple.

Thanks for the replies. I just found too that Nginx have UDP load balancing. I'm currently using IPTables but I'm not sure how scalable it can be. I'm looking at thousands of servers.

I do have some specific requirements, I need the clientA to connect specifically to a serverB, so I cannot use the load balancer to decide the routing. When the client connects, the client can make a HTTP request to a backend endpoint, which decides which server the to connect to. I'm hoping to be able to set the routing on the "load balancer" to set the routing. I'm not familiar with hardware routers but I don't think they have API to control it programtically.

Currently my research points to using a software load balancer like Linux Virtual Server. Either that or I have to write my own router but I'm trying to avoid that and use existing solutions.

 

Yes,it is not a load balancer but rather a router that can be controlled by API. We don't have enough public IPs in the long run, we might go a lot more than 12K.

I can't use a different port, it has to be same port beause of a certain requirement. I can put out a few public IPs but each IP should be  covering a few hundred servers.

Until IPv6, which seems it will never be implemented.
 

Who says it is a game ? Anyway I can't talk about it specifically but I'm looking at a much larger scale than 12K servers so public IP address is definitely not enough. 

I need to control the outgoing port from server because on mobile 4G network, some ISP (tested) block packets if the packets come from other ports.

That's what I'm hoping to avoid doing to write my own since I have too many things to code, and see if there are existing solutions available.

Webrtc would work because the ISP do not block the webrtc ports.  In my setup, if I change the Enet servers to webrtc, I would face the same problem. Imagine each of my Enet server is webrtc, and I do not have enough public IPs, so that's my issue now.

If I server the webrtc over it's non standard ports, likely the ISP would block them too.