Absolutely.
Fairphone even provides you with its own fully supported Fairphone Open OS, which comes without the Google Mobile Services and thus without any Google Apps, so you don’t need a Google account.
Here’s a topic for you to investigate …
And perhaps you want to switch over to Open OS before importing contacts into an App which perhaps isn’t present on the Open variant.