So, I finally purchase a TP4056 modules (such as this one tp4056 and build a little dock with my kids legos and made sure it was thight and make sure the plus wire it on the plus 
I’ve left the battery to charge for 3 hours, put the battery back in the FP2, the boot was longer than usual but started.
The phone can now charge as normally.
Issue fixes, root cause is probably that the battery was too discharged to allow the FP2 to boot, all this could been avoided if the charging process didnt start the phone 
8 Likes