I want as little Google as possible on my Fairphone 4!

Is it possible to remove GBoard and have password? I tried with AnySoftKeyboard and Simple Keyboard from F-Droid. When I turn on the phone I can’t type the password and have to factory reset.