If someone is holding your gems, and they click on the gem reward faster than you, then you don't get it. It disappears for you but the other person gets them since he clicked faster than you.