Temporal Rift Causes insane FPS drops

Specs
cpu: amd ryzen 7 3800x3d
gpu: amd radeon rx 7900 xtx
32 GB ddr4 3600 ram

I've ran games for the past few years with 150+ FPS no problem on most titles. POE2 has given me some issues since the start big swings in fps 100 - 200 depending on what I'm doing. But this league is different.

So... This patch and decided to play a frost wall/frost bomb chrono. Things have been mostly the same FPS wise (tolerable, but frustrating) until about a week ago (when I got my 3rd ascendency... temporal rift). Today I finally decided I'm going to fix it, and went down quite a rabbit hole downloading benchmark software and all the monitoring tools (gpuz, hwinfo, process lasso, etc...) that are recommended to improve / diagnose this kind of thing. And what it seems like is some sort of CPU problem inside POE2 I see massive spikes in CPU ms. Oddly enough external monitors don't seem as dramatic.

Things I tried from reading various peoples posts online with similar issues,
- I updated my BIOS version to the latest
- updated my chipset drivers
- I undervolted my cpu -0.05
- I cleared my shader directories
- I tried every setting in POE (renders / and general settings)
- I tried disabled CPU 0
- I tried power setting 99% instead of 100%
- I even completely reinstalled POE2 hoping for a miracle
- I'm sure there are some more things, but I can't remember them all...

Well, After all that I'm sitting in my hideout without any improvements feeling extremely frustrated and demoralized. But notice something odd, when I stand still things seem fine. I start to just spam frost walls and blow them up with frost bomb to try and check fps and it seems pretty stable, but when I walk around and cast it starts going crazy... Then, I quit casting and realize... it's not from me casting anything. Simply walking around in circles causes me to drop 50+ frames pretty quickly. And it all suddenly makes sense, I've had this issues since I had got my 3rd ascendency... and I see those little bastards leaving a shimmering trail crushing my fps. I go to Doryani refund temporal rift and viola.... my fps is back to what it was.... All this time spent because of those damn images. 1 skill point has ruined my evening and my class!

Anyhow, sorry for the rant I just couldn't believe it. I'm not sure if it's just me, but I figured maybe this could help someone else not burn hours trying to fix something they cant. My only guess is it takes a lot of CPU to save all my previous states, and when I start mapping and leaving the trail my poor CPU just can't handle it.

Cheers

Looks like maybe this is the same thing

https://www.pathofexile.com/forum/view-thread/3407172