Project help

Hi my project is controlling the devices by palm movement,that is depending on position of the palm particular device ll be switched on or off.
Major disadvantage is, our palm is recognized as red object in RGB format,so if there is any other red object in room then project fails.
So please guide me to overcome this problem plz............