Once you get to a certain star level, it locks in so you can't fall below that. I think it varies by hero quality how many stars you need to do that.