Is It Okay To Leave The Batteries Inside The Device When Not In Use?

Logically, it shouldn't make any difference whether the batteries (the AA-sized ones) are left within the electronic gadget which is not in use. But it's often advised to remove them when the device is not in use for an extended period of time.

Apart from possible damage because of the leakage, is there any other reason?