Physical Damage Modifiers vs. Blade Vortex

So I'm yet to get a clear answer to how mods work on gear when running Blade Vortex. BV states it deals physical damage in its gem description. I understand that phys damage implicit modifiers are not global on daggers and only work for the base attack. However, say I had a dagger that had the implicit for Global Crit Damage, and then alc'd it and rolled a mod that says "+ Increased Physical Damage" or "+ Life Gained on Hit". Do those work when I cast Blade Vortex? Or are those mods only for the standard swing attack on the dagger?

I posted this on Reddit and half the posts gave me one answer while the other half gave me the total opposite. Global Chat seems to be unsure as well. How is this such a popular build but nobody seems to fully understand how it works?

The rule of thumb for weapon and armour mods is that if they can be local, they are. %IPD on a weapon applies only to that weapon's base damage, so won't help with any damage you're including with spells or even other weapons. The LGoH specifies attacks only so won't help with spells either (off the top of my head the only LGoH that doesn't do this is Cybil's Paw).

Increased physical damage on anything other than a weapon will benefit your BV.