Rite of Passage charm bricks Armoury rooms in temple.

Hey. I'm using the Rite of Passage charm with "spirit of the primate" which summons a bunch of minions. Those minions randomly run through the blocked temple doors and attack mobs that are in there, after that, the room is permanently locked and I even tried killing the mobs in there by casting frost bomb through the closed door lol still doesn't work because for the door to open you need to grab something from the Vaal weapon rack.
I already got rid of the charm, but fix this please, it bricks half of my temple just because those minions hang around forever and never disappear even if you unequip the charm.