You only get Spirits if a purple or gold hero shows up on a manual refresh, because spirits are basically a backup to make sure you get heroes if you're trying a lot.