That’s why adaptive brightness has been a thing for a while. The phone learns what you prefer by providing feedback. My Pixel 3 learned what I liked in a few days and by adjusting it only a few times at night and during the day. If FPs approach is some kind of static setting for all, then it’s harder indeed. Although you can enable a toggle “go below 30% brightness” and it’s fixed for both camps. But that’s kind of a poor man’s solution, but yes, that would fix it.
Extra dim is already something Android now provides in version 12, but it’s broken on a Fairphone.