Trials of Chaos fails to load after returning from town (PS5)

Trials of Chaos loads initially, but after returning from town through portal, I get stuck in an infinite load screen. Sometimes, closing the game and reopening fixes it.

The only way to guarantee I don't get stuck, is to use the map and walk through every single Trials room that I have completed, to resume my progress. Since this is too time consuming, I prefer to leave most of the loot behind, so that I don't have to portal to town to sell.