<Ps5> Unused skill always reappears on skill bar

I have a build which uses Mjölner in Slot 1, and a different weapon in Slot2. I have an Arc spell slotted into Thundergod's Wrath (Mjölner's skill), and almost every 10-15 minutes the game decides to put Arc on the skill bar on the Square button, which is always my "use" button, and that makes it hard to pick up loot or do anything really when there is an enemy nearby. I tried putting Arc to Triangle, deleting it from the bar, putting it on L1, putting it on the secondary bar, but after 10-15 minutes, it will always get back automatically to Square.


Also my friend said he had the same issue with other weapons eith bound skill when swapping them, so it's not just a Mjölner problem