You are not the only one - but there are few of us who do not wish to dedicate their life to their phones and just want to use them as a tool. Which means the phone has to be convenient and fit in our life (and pants pockets 
and we’re not modifying our life to fit around our phone.
As you can see, everyone who says “not a problem” suggests solutions such as a “phone holster” or “adequate clothing” or a dedicated pouch.
Sadly, I have gotten mostly the same, not at all helpful responses in my thread why I will not buy a FP3.
It’s a pity, I liked the FP idea, but unless the FP4 comes out when I need a new phone, and is smaller again, I have to look for a different phone 