Replaceable rechargeable batteries are the best choice (assuming the weight doesn't bother you).

You can quickly swap in a new pair, and recharge the other one. Some mice can even charge the batteries themselves. You get the best of all worlds.