Maybe it is helpful to make a clean install of android and try to format the card again.
I had a similar problem after updating to android 6. Wasnt able to copy files to the phone from the computer and apps like gallery and music player need long time to get access to the sd card.