Poison SRS Necromancer Random Crashing to Desktop

My wife and I both league started a poison srs necromancer. Everything was fine until we got up to having our 3 main spectres: Perfect Judgemental Spirit, Perfect Guardian Turtle, and Perfect Forest Warrior. At that point we started getting random Crashes to Desktop. At least one per map, all the way to running out of portals without dying or dumping off loot.

I went through every forum thread I could find on random crashes and I tried all of it. Reinstalled drivers, DISM and SFC, optimizing settings, switching to Vulkan, etc. Everything I could think of. My Wife and I run the same rig, and a friend has a very similar setup. He has had no crashing issues this league. It got to the point where we couldn't play because we ran out of portals just from crashing.

So we built Pathfinders. We have been running juiced t16s on our Pathfinders with no issue. Same settings, nothing has changed on our setups at all. My feeling is that it's something to do with the spectres. I initially thought it was the asenath's explosion from the AG but turning it off didnt help. We still crash when we play our necros but never on PF

More Details:
Rig:
Ryzen 5 5600x
EVGA RTX 3080 FTW
ROG Strix B550-A Gaming
4 x 8gb Corsair Vengence @ 3200mhz
main monitor 1440p @ 155hz (limited to 60 as part of troubleshooting)
Game install is on a Crucial P2 NVME

No settings changes in game or otherwise made any difference
Doesn't seem to matter how many mobs are on screen or what content is present in the map.
Full reinstall of the game and a windows build update and DDU reinstall made no difference.
I even tried turning off PBO in bios and disabling XMP (or whatever the AMD equiv is)