Herald of Ice prevents minions being summoned on weapon swap

If you have herald of ice on one weapon swap it prevents minions (skeletal arsonists) being summoned on weapon swap despite it being inactive on the other weapon. When you unstocked the herald of ice gem the minions are summoned, but when you swap weapons they are unsummoned and cannot be resummoned until the gem is undocketed again.