Cannot mine Verisium Ore

Hello, this is my first thread ever on PoE, forgive any mishaps I might make.

So, as a GamePad user on the PC version of PoE. During the Settlers of Kalguur season, I have been experiencing bugs with the “A” button on my Xbox Controller. It’s hard to pin down exactly when and why I can’t Interact with certain Objects (NPC’s, Doors, and especially Verisium Ore.) For example, in the Labyrinth, I could not open the door in the Aspirants Trial. That is, until I interacted with the stash in there and then I was able to open the door. Weird situations like this occur.

But that is not the primary reason I am making this thread. I have been completely unable to interact with Verisium Ore, all other Ores work fine. So I believe it must be something with the “Hold & Charge” aspect of Verisium.

I am playing a Slayer, using FrostBlades of Katabasis with multistrike and other gems. When interacting with the Verisium Ore my character simply casts this skill repeatedly.

TLDR:
Xbox Gamepad, primary skill and interact button bound to “A”. Can’t mine Verisium Ore at all. Other small bugs with “A” button.

Remove skill from buttom X)) it must be free

Or A buttom

I'm having the same problem sometimes with my controller. I disabled the A button and I have the miners and they're being paid. Sometimes on Verisium ore I hold down A and nothing happens. Am I missing something?

Update. I have to leave a skill in slot A then remove the skill gem. That's the only way I can get it to work. Kind of a pain in the neck.