Ogham Village Network Spikes

Ogham village is currently unplayable for me. The ping continues to spike from 50 ms to 200 and sometimes to 2000 for particular reason. Its only the ogham village map that causes this issues. The graphs says its all on the network side. I have re-launched the game, steam, restarted my computer, nothing fixes it.