Network disconnect when using controller

I got disconnect when using controller to play the game, while it works perfectly if using keyboard&mouse.
I have tried to monitor the game using F1, and I can see that the network latency increase significatly when I'm using controller and disconnect eventually.