No Damage with Downscaling on

Playing the new Phrecia event and have a Witch with the Herald ascendancy. I join a friends party and he has level downscaling on and I can not damage any monster. I had my Wife join the party and she was able to kill things with no issues. I'm at a loss as to what could be broken and wonder if its affecting my character through maps.