Elemental penalty Bug

Hi, this is for POE2, I finished with 2 chars and I am on endgame now, if I remove all my equipment and go to Clearview, or Trial of Chaos I have no penalty on my chars, but if I tp to my hideout all my chars has -40 penalty resistance. even if I put an armor that gives me a total of 75% resistance on all, I never reach the cap, unless I access those 2 previous maps mentioned, but on any other map, I still have a penalty. it this just a visual bug or this is actually giving the penalty on my chars on any map?

thanks