Chosen Solution

I’m planning on replacing my dead battery with a new one, but don’t know how to get rid of the old one safely.

That depends on the country you live, but in most countries old batteries of any kind are considered an environmental hazard and are disposed of separately. In Europe most places that actually sell batteries have a container to drop old batteries safely, in addition any shop selling electronics near you should be able to help you in any case.