I messed around a lot with my phone OS-wise for fun and for months now, never got the trouble you describe.
I guess Fairphone support will be no big help with a TWRP version not coming with Fairphone Open OS and with OSes other than Fairphone OS or Fairphone Open OS. They just don’t officially support community-driven alternatives, understandably.
Factory reset in Fairphone Open OS, which doesn’t do much? …
Oh, and always good for testing:
https://forum.fairphone.com/t/howto-use-twrp-without-flashing-it-e-g-for-backup/23747