Weapon Set 1 and 2 passive not applying correctly

"Ancestral Artifice" and "Watchtowers" was not applying the +1 to totem limit when set to weapon set 2. I would get extra totems when I respeced and didnt use weapon skill set 1 or 2, but when applied to weapon set 2 the extra totems would not proc from the passives. There seems to be an issue with these skills, and hypothetically others, where they are not applying correctly when switching between weapon set 1 & 2. I did multiple tests and could not get the extra totem limit to proc when on weapon set 2, but would have multiple totems out if i didnt utilize the weapon sets.