Imported contacts are not recognized as such on incoming SMS

So, I have a brand new FP6 with the latest /e/os. After initial setup I imported all my contacts from a .vcf file. Now the problem is that when a contact, that does not yet have a message history on the FP writes me a SMS, the contact is not recognized a such and the message is displayed with the phone number as sender instead of the name. That implicates that I do not know who sent me the message, which is quiet, yeah … no so much awesome. Only if I add the phone number from the chat to contacts again, the sync works.

In case I first wrote a message to a certain contact, the reply is also displayed as new chat with the phone number. After adding to contact again from, via the message app, I end and up with two chats: the first holds my initial message and is headlined by the contacts phone number, the second holds everything starting from the contact’s reply and is correctly displayed with the contact name instead.

Any ideas how to fix this as I would like to avoid adding all my contacts by hand.