Difficult… Did you check the e/Forum of there is something reported for the new version? Else can you somehow measure that the battery is not the cause? Either with the help of another Fairphone (from an Angel) or an electronic tool measuring the voltage.
So do you have the feeling the USB Port is worn out over time or not?
Did you disassamble (at least take out battery) and cleaned the contacts?