Input lag (wrong abilities) when using second skillset

I have my second skillset switch on LB. Sometimes when I activate LB+RT (then release) then RB it will not active my RB skill and instead activates my LB+RB skill. It feels like the button combinations are not being decided on my local gamepad but instead on the server and some input changes are lagging on the server.

These are my current abilities but it also happens if I switch them around:
LB+RT = conductivity
RT = mana tempest
RB = spark
LB+RB = frost bolt