Learning Visual Stabilization Reflexes in Robots with Moving Eyes

1Giorgio Metta, 2Francesco Panerai, and 3Giulio Sandini
1AI-Lab, Massachusetts Institute of Technology, USA
2LPPA, Collège de France, Paris, France
3LIRA-Lab, DIST, University of Genova, Italy

This work addresses the problem of learning stabilization reflexes in robots with moving eyes. Most essential in achieving efficient visual stabilization is the exploitation/integration of different motion related sensory information. In our robot, self-motion is measured inertially with an artificial vestibular system (gyroscopes) and visually by estimating the optic flow. The first sensory system provides short latency measurements of rotations and translations of the robotís head in space, the second, a delayed estimate of the motion across the image plane. A self-tuning neural network learns to combine these two measurements and generates oculo-motor compensatory behaviors that stabilize the visual scene. We describe the network architecture, the learning mechanism, and the stabilization performance evaluated using direct measurements on the image plane. We further speculate on the similarities between the robot implementation and biological stabilization reflexes.