Sweep skill losing its sound effect at random times

it was mostly during Delve runs, or perhaps because that's just what I mostly do so I can't really tell when and where it happens. It would lose the sound effect and would not be back until I move to a different location through portals.