It seems prudent for all midi modules to fetch out and replace or remove the original battery.
Grabbed a Yamaha MU80 recently off ebay. It also had a coin cell battery. Seller attempted to replace soldering in battery with another, trying to solder a wire to the top of it. As can be expected, it didn't go well, as you can't solder wire onto a battery and they used a bit of tape to try and keep their new battery on it.
So even though the battery tested good, it complained about low battery on bootup, prompting me to open it and discover the stodgy workmanship. Thankfully, my soldering iron seems to be better, and I removed the replacement battery, the remains of the original battery terminals, and installed a new CR2032 battery holder. While the CR2032 is significantly smaller in capacity to the original CR2450, it is way easier to get CR2032s and more frequent replacement isn't a problem now it is in a holder.