A simple Orb of Chance vendor recipe solves a lot of issues.

"

Eck wrote:

It's weird to me that Orbs of Chance are so difficult to obtain outside of drops, when their usage is relatively small. I think that some of the most common complaints I hear are a lack of respeccing options that are feasible as well as difficulty crafting if you get short on scouring orbs. If there was a relatively low-level vendor recipe for Orbs of chance- perhaps, 1 alteration, 1 transmutation and 1 augmentation or something else that uses the low-tier currencies, then not only would crafting be better since you could get to scouring orbs more often, but you could also more realistically respec your character though still at a cost. Being able to go chance -> scouring -> regret is a good chain but it's too hard to start. Players need a fairly quick avenue to orbs of chance.

"

Metronomy wrote:

There is a vendor recipe for orb of chance already, though you may find it to be pretty difficult (which is actually a good thing because if it was easy it would make reallocating your passive skill points too easy)

You already get like 16 refund points from doing all the quests, and I have never used all of them on any character.
The point is that you are meant to be putting in at least some thought into what your passives are so that you only need to make minor changes.
That being said, its not really all that hard to collect orbs of regret if you really need to, I have 47 unused ones that I don't need in my stash without selling any scourings.