You’re right. Lots and lots of people use headphones and a very little number of people report this issue, so either they have cases or bottom modules with production flaws or headphones with badly designed or flawed pins.
I have looked into this a while ago and this is what I found:
So from that small sample it looks like the main reasons are:
- flawed bottom module and
- cheap headphones