Actually, I see what you are saying Rocco. I usually collected reward long after the sail was finished but I noticed today that if I didn't have the pirate screen open when the sail started I failed to get the envelope with the reward, even if I refreshed long before the sail was finished. This does seem like a bug.