Theory for Calibration-Free Eye Gaze Tracking

Eye gaze direction and point of regard has proven to be a very powerful and useful source of information in human computer interaction. The user’s gaze direction can be used as an input, in addition to the mouse, keyboard and other input means. However, despite the potential applications, gaze tracking systems are still expensive and they require cooperation in calibration. In this paper we develop a theory for eye gaze tracking, introduce the optical plane, and show its analogy to multi-view epipolar geometry, where the eyeball center is considered a focal point. We first use it to prove that eye gaze tracking under fixed head position is a homography between the pupil project center in image plane and the point of regard in screen plane. This theory supports existing gaze tracking methods that require user calibration at each session. Next we use it to develop a family of eye gaze tracking techniques that requires no user calibration, and allow free head motion. The theory is supported by preliminary results of ray tracing simulation, and a prototype system is already in advanced stage.

By: Arnon Amir, Myron Flickner, David Koons

Published in: RJ10275 in 2002

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

rj10275.pdf

Questions about this service can be mailed to reports@us.ibm.com .