Killing Bloated Miller before finishing passive skill tutorial results in guide arrows stuck on tree

I killed the bloated miller before finishing the passive skill tree guide prompt and levelled to 3 before taking a passive skill tree point. This resulted in the guide arrows being on my tree. I am now on level 15 on this character and there are quite a few arrows.