Nokia 5110 does not want to charge battery

When I plug charger to the phone with completely discharged battery small battery icon appears, but there is no charging indicator at all. In 20 seconds battery icon disappears from the screen and it shuts. If I turn charger off and then on this is repeated.

After 5-10 tries charging indicator appears and starts to show the battery charging, but everything disappears in one minute and charging stops.

I have to switch it off and on again and repeat this process constantly - the charging process does not continue more then one minute!

I bought new battery but it did not help.

Please, advise something