Turn up like a bad penny

Gifford:

8.216 (157:3). Turn up like a bad penny – Proverbial expression of the superstitious belief that it is almost impossible to rid oneself of a small, meaningless, and annoying detail.