Originator's memories map modifier: Targeted by a meteor when using a flask

I have had way too many random experiences with this modifier. Sometimes it does nothing at all, some other times it just one-shots me.

My char is not weak at all (I can tank most pinnacle bosses at ease).

I think there is some hidden interaction that makes it have a 3000x more dmg modifier or something.

I understand it has to have some drawbacks, but being so random is impossible to predict or evade. Please make it deal a fixed amount of damage regardless of other stuff that may be going on.

Step by step and fix after fix, this league is getting better, even enjoyable... XD

Thank you in advance!