Why cant ascendancy skills be assigned to a weapon set?

The title explains it, is this even intended? and if so why? its so annoying to have to manually weapon swap before pressing skills like time freeze.

In the recent interviews the Devs got asked about it and they didn't even seem to know that's the case.

I think they said it wasn't intended, but it's likely due to them not being a skill gem. I assume it's going to be changed at some point in the future.