Patent US2729238A successfully refreshed from Google Patents.
US5360971A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus and method for eye tracking interface
Assignee: Research Foundation of the State University of New York
•
Filing: 1993-01-19
•
Granted: 1994-11-01
•
Expires: 2013-01-19
Abstract
Abstract An eye tracking interface system for generating communication and control functions as a result of pre-defined eye gestures is disclosed. The system includes a detecting device adapted to detect bio-electromagnetic signals generated by eye movements. A first processor receives the detected bio-electromagnetic signals, and generate tokens corresponding to said pre-defined eye gestures. A second processor receives the tokens, and generates command signals based on a protocol correlating tokens to desired command signals. Thereafter, a user interface responds to said command signals, and provides control functions in response to said command signals.
Inventors
- 👤 Arie A. Kaufman
- 👤 Amit Bandopadhay
- 👤 George J. Piligian
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 04:39
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/011; G06F3/013; A; A61; A61B; A61B3/00; A61B3/10; A61B3/113; A61B5/00; A61B5/72; A61B5/7203; A61B5/7207
Claims Analysis
Total Claims: 78
Claim 1
Independent Claim
90 words
An eye tracking interface system for controlling task-performing functions comprising: a detecting device adapted to detect bio-electromagnetic signals generated by eye movements; a first processor adapted to receive said detected bio-electromagnetic signals and, in response thereto, assigning tokens from a set of symbolic tokens corresponding to eye movement classifications, thereby producing a plurality of tokens representative of said bio-electromagnetic signals; a second processor adapted to receive said plurality of tokens, recognize patterns of tokens, and generate command signals based on said recognized patterns; where said command signals control task-performing functions.
Claim 2
Dependent Claim
90 words
An eye tracking interface system for controlling task-performing functions comprising: a detecting device adapted to detect bio-electromagnetic signals generated by eye movements; a first processor adapted to receive said detected bio-electromagnetic signals and, in response thereto, assigning tokens from a set of symbolic tokens corresponding to eye movement classifications, thereby producing a plurality of tokens representative of said bio-electromagnetic signals; a second processor adapted to receive said plurality of tokens, recognize patterns of tokens, and generate command signals based on said recognized patterns; where said command signals control task-performing functions.
Claim 3
Dependent Claim
21 words
The system according to claim 1, wherein said set of symbolic tokens includes symbolic tokens corresponding to a blink or wink.
Claim 4
Dependent Claim
23 words
The system according to claim 1, wherein said set of symbolic tokens includes symbolic tokens corresponding to an eye moving right or left.
Claim 5
Dependent Claim
23 words
The system according to claim 1, wherein said set of symbolic tokens includes symbolic tokens corresponding to eyes looking steadily at a point.
Claim 6
Dependent Claim
25 words
The system according to claim 1, wherein said set of symbolic tokens includes symbolic tokens corresponding to eyes moving fast to the right or left.
Claim 7
Dependent Claim
22 words
The system according to claim 1, wherein said set of symbolic tokens includes symbolic tokens corresponding to eyes looking right or left.
Claim 8
Dependent Claim
22 words
The system according to claim 1, wherein said set of symbolic tokens includes symbolic tokens corresponding to eyes looking up or down.
Claim 9
Dependent Claim
24 words
The system according to claim 1, wherein said set of symbolic tokens includes symbolic velocity tokens corresponding to a plurality of eye velocity classifications.
Claim 10
Dependent Claim
19 words
The system according to claim 8, wherein said eye velocity classifications include zero velocity, pursuit velocity and saccade velocity.
Claim 11
Dependent Claim
23 words
The system according to claim 8, wherein said system disengages in response to a symbolic velocity token corresponding to a saccade velocity classification.
Claim 12
Dependent Claim
15 words
The system according to claim 1, wherein said system engages in response to symbolic tokens.
Claim 13
Dependent Claim
15 words
The system according to claim 1, wherein said system re-engages in response to symbolic tokens.
Claim 14
Dependent Claim
16 words
The system according to claim 1, wherein said symbolic tokens are associated with numerical value tokens.
Claim 15
Dependent Claim
34 words
The system according to claim 13 wherein said second processor includes a distance processor that receives value tokens corresponding to the position of each eye for determining the distance and/or depth of an object.
Claim 16
Dependent Claim
24 words
The system according to claim 14 wherein said object is displayed on a screen as a two dimensional representation of a three dimensional space.
Claim 17
Dependent Claim
16 words
The system according to claim 13, wherein said numerical value tokens indicate displacement, speed or duration.
Claim 18
Dependent Claim
14 words
The system according to claim 1, wherein said detecting device detects electro-oculograph (EOG) signals.
Claim 19
Dependent Claim
35 words
The system according to claim 17, wherein said detecting device further comprises: signal electrodes disposed about the eye, said signal electrodes providing inputs to respective channels for detecting horizontal and vertical movements of the eye.
Claim 20
Dependent Claim
16 words
The system according to claim 18, wherein a ground electrode is in contact with the user.
Claim 21
Dependent Claim
16 words
The system according to claim 18, wherein said signal electrodes are disposed in an eye frame.
Claim 22
Dependent Claim
56 words
The system according to claim 17, further comprising: an analog-to-digital converter responsive to said EOG signals for providing digital data corresponding to sampled data, said digital samples being transmitted to said first processor; and a drift processor for detecting drift occurrence, said drift processor providing an appropriate offset voltage for substantially eliminating the effect of drift.
Claim 23
Dependent Claim
42 words
The system according to claim 21, wherein said drift processor includes a data averaging device for taking an average value of said digital data, and an offset voltage generating device to generate an offset voltage according to variations in said average value.
Claim 24
Dependent Claim
58 words
The system according to claim 17, wherein during an interaction mode said first processor receives EOG signals resulting from eye movements and generates a token from said set of symbolic tokens when said EOG signals fall within a range of one or more classification parameters corresponding to a given eye movement classification that corresponds to said generated token.
Claim 25
Dependent Claim
49 words
The system according to claim 17 wherein said eye movement classifications are established by a calibration test that determines a set of one or more parameters corresponding to a given eye movement classification, where each said eye movement classification corresponds to a token from said set of symbolic tokens.
Claim 26
Dependent Claim
47 words
The system according to claim 24, wherein during an interaction mode said first processor receives EOG signals resulting from eye movements, and generates a token from said set of symbolic tokens when said EOG signals fall within said classified set of parameters corresponding to said generated token.
Claim 27
Dependent Claim
45 words
The system according to claim 17, wherein said eye movement classifications include a plurality of velocity classifications that are established by a calibration test that determines a velocity parameter corresponding to each said velocity classification, where each said velocity classification corresponds to a velocity token.
Claim 28
Dependent Claim
55 words
The system according to claim 26, wherein during an interaction mode, said first processor receives EOG signals resulting from eye movements and generates a velocity token from said set of symbolic tokens when the eye velocity determined from said EOG signals fall within the range of a classified velocity parameter corresponding to said generated token.
Claim 29
Dependent Claim
14 words
The system according to claim 27, wherein classification membership is determined by minimum difference.
Claim 30
Dependent Claim
26 words
The system according to claim 27, wherein said set of symbolic tokens includes a zero velocity token, a pursuit velocity token, and a saccade velocity token.
Claim 31
Dependent Claim
35 words
The system according to claim 1, wherein said second processor receives serial streams of tokens derived from plural EOG signal channels and recognizes combinations of tokens received from said channels for generating said command signals.
Claim 32
Dependent Claim
36 words
The system according to claim 1, wherein said second processor comprises a protocol interpreter which may be initialized for a particular user application by accessing a particular protocol for interpreting various tokens and generating command signals.
Claim 33
Dependent Claim
25 words
The system according to claim 1, wherein said second processor includes a rule-based pattern learning component for defining distinct token patterns for generating command signals.
Claim 34
Dependent Claim
29 words
The system according to claim 1, wherein said second processor includes a rule-based pattern learning component such that an operative may define distinct token patterns for generating command signals.
Claim 35
Dependent Claim
24 words
The system according to claim 1, wherein said command signals control a wheelchair, said wheelchair being controlled in response to predefined operator-personalized eye gestures.
Claim 36
Dependent Claim
40 words
The system according to claim 1, including a monitor screen displaying a choice of commands, said commands corresponding to an operation of a machine, so that an operator may select a desired command by providing a predefined operator-personalized eye gesture.
Claim 37
Dependent Claim
9 words
The system according to claim 35, including a keyboard.
Claim 38
Dependent Claim
18 words
The system according to claim 35, wherein a screen cursor tracks the operator's gaze on said monitor screen.
Claim 39
Dependent Claim
23 words
The system according to claim 1, including a monitor screen displaying various objects for interaction with a user based on predefined eye gestures.
Claim 40
Dependent Claim
14 words
The system according to claim 38, wherein said objects correspond to a video game.
Claim 41
Dependent Claim
19 words
The system according to claim 1, wherein control messages are sent from said second processor to said first processor.
Claim 42
Dependent Claim
19 words
The system according to claim 1, wherein control messages are sent from a device interface to said second processor.
Claim 43
Dependent Claim
156 words
In a system having a plurality of channels, each channel detecting electro-oculograph (EOG) signals corresponding to horizontal and vertical movements of the eye, a signal processor comprising: a filter responsive to said EOG signals to provide filtered EOG signals; a position estimator responsive to said filtered EOG signals that uses an estimated position value to produce first smoothed EOG signals; a slope estimator responsive to said first smoothed EOG signals that uses an estimated velocity value to produce second smoothed EOG signals; said signal processor when in a calibration mode, classifying information from at least said second smoothed EOG signals by determining a set of one or more parameters corresponding to a given eye movement, where said set of parameters corresponds to a token; and said signal processor when in interaction mode, assigning a token from a plurality of tokens, when EOG signals resulting from eye movements correspond to the classification attributed to said assigned token.
Claim 44
Dependent Claim
156 words
In a system having a plurality of channels, each channel detecting electro-oculograph (EOG) signals corresponding to horizontal and vertical movements of the eye, a signal processor comprising: a filter responsive to said EOG signals to provide filtered EOG signals; a position estimator responsive to said filtered EOG signals that uses an estimated position value to produce first smoothed EOG signals; a slope estimator responsive to said first smoothed EOG signals that uses an estimated velocity value to produce second smoothed EOG signals; said signal processor when in a calibration mode, classifying information from at least said second smoothed EOG signals by determining a set of one or more parameters corresponding to a given eye movement, where said set of parameters corresponds to a token; and said signal processor when in interaction mode, assigning a token from a plurality of tokens, when EOG signals resulting from eye movements correspond to the classification attributed to said assigned token.
Claim 45
Dependent Claim
25 words
The invention according to claim 42, further including a trajectory model generator coupled to said position and slope estimators for providing position and slope estimates.
Claim 46
Dependent Claim
30 words
The invention according to claim 42, further including an artifact recorder adapted to receive said filtered EOG signals, said artifact recorder capable of detecting and deleting eye movement related artifacts.
Claim 47
Dependent Claim
13 words
The invention according to claim 44, wherein said artifacts are blinks or winks.
Claim 48
Dependent Claim
36 words
The invention according to claim 42, further comprising a mode estimator used during calibration for determining the mode of a plurality of EOG signal samples measured during a particular eye gesture, said mode defining a classification.
Claim 49
Independent Claim
82 words
A method for providing communication or control functions as a result of eye movements, comprising the steps of: detecting bio-electromagnetic signals generated by eye movements; processing said detected bio-electromagnetic signals by assigning, in response to said detected bio-electromagnetic signals, symbolic tokens corresponding to eye movement classifications, thereby generating tokens corresponding to said bio-electromagnetic signals; generating command signals based on a protocol correlating patterns of tokens to a desired command signal; and providing communication or control functions in response to said command signals.
Claim 50
Independent Claim
82 words
A method for providing communication or control functions as a result of eye movements, comprising the steps of: detecting bio-electromagnetic signals generated by eye movements; processing said detected bio-electromagnetic signals by assigning, in response to said detected bio-electromagnetic signals, symbolic tokens corresponding to eye movement classifications, thereby generating tokens corresponding to said bio-electromagnetic signals; generating command signals based on a protocol correlating patterns of tokens to a desired command signal; and providing communication or control functions in response to said command signals.
Claim 51
Dependent Claim
16 words
The method according to claim 47, wherein said step of detecting includes detecting electro-oculograph (EOG) signals.
Claim 52
Dependent Claim
43 words
The method according to claim 48, further comprising the steps of: providing digital data corresponding to sampled signals, said digital samples being transmitted to a processor; and processing drift occurrence for providing an appropriate offset voltage for substantially eliminating the effect of drift.
Claim 53
Dependent Claim
46 words
The method according to claim 49, wherein said step of processing drift further includes a step of data averaging for taking an average value of said digital data, and an offset voltage generating step to generate an offset voltage according to variations in said average value.
Claim 54
Dependent Claim
54 words
The method according to claim 48, wherein during a calibration further comprises the steps of: receiving EOG data resulting from a predetermined eye movement; determining a set of one or more parameters corresponding to a given eye movement classification; wherein said eye movement classification corresponds to a token from a set of defined tokens.
Claim 55
Dependent Claim
52 words
The method according to claim 48, wherein during interaction further comprises the steps of: receiving EOG data resulting from eye movements; and generating a token from a set of defined tokens when said EOG data derived from said eye movements falls within a classified set of parameters corresponding to said generated token.
Claim 56
Dependent Claim
26 words
The method according to claim 48, further including the step of detecting signals associated with head movements and processing said signals in conjunction with EOG signals.
Claim 57
Dependent Claim
39 words
The method according to claim 48, further including the step of receiving tokens corresponding to each eye from EOG signal channels and interpreting the tokens received from each eye, and further interpreting combinations of tokens received from both eyes.
Claim 58
Dependent Claim
17 words
The method according to claim 47, including the step of controlling a wheelchair with said command signals.
Claim 59
Dependent Claim
41 words
The method according to claim 47 including a step of displaying a choice of commands on a monitor screen, said commands corresponding to an operation of a machine, and a user selecting a desired command by providing a predefined eye gesture.
Claim 60
Dependent Claim
46 words
The method according to claim 47, including the steps of determining calibration parameters for said eye movement classifications and transforming said calibration parameters in accordance with optical characteristics where said transformed calibration parameters are used for eye tracking with an optical device having said optical characteristics.
Claim 61
Dependent Claim
50 words
The method according to claim 47, further comprising the steps of: calibrating by determining a ratio of actual distance to number of detected tokens; detecting a given number of tokens generated during an interaction mode: and multiplying said given number of tokens by said ratio to determine an actual distance.
Claim 62
Dependent Claim
20 words
The method according to claim 58, wherein the step of determining said ratio includes a user setting a sensitivity value.
Claim 63
Dependent Claim
20 words
The method according to claim 47, further including the step of providing numerical value tokens associated with said symbolic tokens.
Claim 64
Dependent Claim
22 words
The method according to claim 60, including a step of determining the distance of an object by triangulation using said value tokens.
Claim 65
Dependent Claim
134 words
In a system having a plurality of channels, each channel detecting electro-oculograph (EOG) signals corresponding to horizontal and vertical movements of each eye such that said eye movements can provide control and communication, a signal processing method comprising the steps of: filtering said EOG signals; processing said EOG signals using an estimated position value: processing said EOG signals using an estimated velocity value; classifying said filtered and processed EOG signals by determining a set of one or more parameters corresponding to a given eye movement, where said set of parameters corresponds to a token, such that a plurality of tokens are classified during a calibration mode; and assigning a token from said plurality of tokens, when EOG signal resulting from eye movements fall within the classification attributed to the selected token during interaction mode.
Claim 66
Dependent Claim
134 words
In a system having a plurality of channels, each channel detecting electro-oculograph (EOG) signals corresponding to horizontal and vertical movements of each eye such that said eye movements can provide control and communication, a signal processing method comprising the steps of: filtering said EOG signals; processing said EOG signals using an estimated position value: processing said EOG signals using an estimated velocity value; classifying said filtered and processed EOG signals by determining a set of one or more parameters corresponding to a given eye movement, where said set of parameters corresponds to a token, such that a plurality of tokens are classified during a calibration mode; and assigning a token from said plurality of tokens, when EOG signal resulting from eye movements fall within the classification attributed to the selected token during interaction mode.
Claim 67
Dependent Claim
22 words
The method according to claim 62, further including a step of detecting and deleting blinks or winks from the filtered EOG signals.
Claim 68
Independent Claim
52 words
A method for determining the 3D position and velocity of a gaze point comprising the steps of: detecting signals associated with eye movements from each eye; processing said detected signals from each eye using triangulation to determine the gaze point in 3D and the time rate of change of said gaze point.
Claim 69
Independent Claim
52 words
A method for determining the 3D position and velocity of a gaze point comprising the steps of: detecting signals associated with eye movements from each eye; processing said detected signals from each eye using triangulation to determine the gaze point in 3D and the time rate of change of said gaze point.
Claim 70
Dependent Claim
30 words
The method according to claim 64 wherein said gaze point corresponds to an object that is displayed on a screen as a two dimensional representation of a three dimensional space.
Claim 71
Independent Claim
65 words
A method for disengaging an eye tracking interface comprising the steps of: detecting signals associated with eye movements; calibrating to determine a normative fixated distance for a user's gaze at an object; processing said detected signals to determine the distance of said user's fixated gaze during an interaction period; causing the eye tracking interface to disengage when said distance differs from said normative fixated distance.
Claim 72
Independent Claim
65 words
A method for disengaging an eye tracking interface comprising the steps of: detecting signals associated with eye movements; calibrating to determine a normative fixated distance for a user's gaze at an object; processing said detected signals to determine the distance of said user's fixated gaze during an interaction period; causing the eye tracking interface to disengage when said distance differs from said normative fixated distance.
Claim 73
Independent Claim
80 words
A method for electro-oculographic (EOG) eye tracking or control while a user is looking through an optical device comprising: calibrating an EOG eye tracking system by a user providing predetermined eye movements with reference to calibrating points in said user's field of view as said user looks through said optical device; generating parameter classifications based on said user provided eye movements, so that during an interaction mode, actual eye movements are detected and tokens corresponding to said. classifications are generated.
Claim 74
Independent Claim
80 words
A method for electro-oculographic (EOG) eye tracking or control while a user is looking through an optical device comprising: calibrating an EOG eye tracking system by a user providing predetermined eye movements with reference to calibrating points in said user's field of view as said user looks through said optical device; generating parameter classifications based on said user provided eye movements, so that during an interaction mode, actual eye movements are detected and tokens corresponding to said. classifications are generated.
Claim 75
Dependent Claim
23 words
The method according to claim 67, wherein said optical device is a microscopic device and said calibrating points are on a calibrating plate.
Claim 76
Dependent Claim
26 words
The method according to claim 67, wherein said optical device is a magnifying device and said calibrating points appear on a lens of said magnifying device.
Claim 77
Independent Claim
65 words
A method for electro-oculographic (EOG) eye tracking or control while a user is looking through an optical device comprising: calibrating an EOG eye tracking system with the naked eye to determine naked eye calibration parameters; transforming said naked eye calibration parameters using the optical characteristics of said optical device; where said transformed calibration parameters are used for eye tracking or control with said optical device.
Claim 78
Independent Claim
65 words
A method for electro-oculographic (EOG) eye tracking or control while a user is looking through an optical device comprising: calibrating an EOG eye tracking system with the naked eye to determine naked eye calibration parameters; transforming said naked eye calibration parameters using the optical characteristics of said optical device; where said transformed calibration parameters are used for eye tracking or control with said optical device.
References Cited (Backward Citations)
US4474186A
Cited
WO1983003191A1
Cited
US4561448A
Cited
US4653001A
Cited
US4595017A
Cited
US4651145A
Cited
GB2170910A
Cited
GB2201069A
Cited
US4884219A
Cited
US4984179A
Cited
EP0301790A2
Cited
WO1991013584A1
Cited
EP0468340A2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-10-31 | 1998-05-02 | 1998-11-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-10-31 | 2002-05-02 | 2002-11-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-10-31 | 2006-05-02 | 2006-11-01 | $7700.00 | Window Closed / Lapsed |