You only get spirit points for purples or golds when you buy spins with credits by clicking "refresh." If a purple or gold comes up in a purchased spin, you get points. If a purple or gold comes up at the time clock cool down, you don't get points, but it's a shuffle chance to see if you can flip over a purple or gold and decide to "recruit" the hero or not.