This happens when the quality of shoes is not up to standard. Of course, it is related to a person's collocation habits, such as the way of wearing shoes and so on.
So you have to understand on your own. But in general, the normal collocation of brand shoes will not cause the sponge to fall off.