I'm 99% sure I took mine out and left it out and it worked fine. They are kinda tricky to get apart so if you already have it open, might as well take it out. The only thing it does is keep time - and if you have it on the network it'll sync with NTP for time anyways. Batteries will eventually leak, so my vote is out.