Atlas points from unique maps is very frustrating

Getting atlas points from Corruption - easy part - see the red tendrils through fog - go there and you got your point.
Getting atlas points from unique maps - you have ZERO control over it. Some Unique maps can elude you.
I have plenty of Untainted Paradises (it's like Common Uniqe maps), quite a few Castaways, 3 Viridian Forests. but finding Silent Cave and one with boss rush - nope.
For past 48 hours (with small nap) i've been speedrunning towers to found last 2 missing. Nope. Just more Paradises.