Can't ascend using quest Barya

Did all acts until act 3 unascended on a new character then went back to do trials. Finished trials of chaos on quest ultimatum and got to pick my ascension then went back to do Sekhemas Barya and I was unable to get my other ascendancy points from the quest