It has been done, but it doesn’t seem to be a straightforward business:
Before taking that step, are you sure that your charger works flawlessly? Quality control of electronic gadgets are not always 100 %, and it might well be that your charger gives excessive voltage (i.e. >5V). Have you tried other means, e.g. connecting to a PC?