Take a spudger and remove the back panel.
Carefully remove the battery with a spudger.
Take the new battery and place it into the slot. The phone should operate normally.