If you don't know to press 'Close Temple', you just never see its effect and remain confused

You're expecting the player to interact with something they just left. That is not something a player does. Vast majority of players is just gonna leave and see that the temple is different in unexplained ways.

Also, the animation for "removing rooms" is way too fast, I barely saw it.