Flask damaging Energy Shield

This is quite annoying. Got a new chest and went from 1.6 k to 3k ES, was super happy, doing first map. Steady good ES, low mana, used mana pot, ES went from 3k to 800 screen flashed ''red'' got few hits and I was like whaaat? Normal mobs fighting. Dead.