My first guess would be someone else took them first... once they've been taken, the gems don't show, but if you scroll over the player it will tell you what they have until the clock runs out.