US6346940B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Virtualized endoscope system
Assignee: Canon Medical Systems Corp
•
Filing: 1998-02-27
•
Granted: 2002-02-12
•
Expires: 2018-02-27
Abstract
Abstract An image processing system displaying an endoscopic image of a three-dimensional object from a desired viewpoint position and view direction. A three-dimensional model preparation unit prepares a three-dimensional model of the object and an endoscopic image preparation unit prepares a first image of the three-dimensional model as viewed from the viewpoint position and view direction. A simulated endoscopic examination of a virtual subject can be realized by permitting an operator to change the viewpoint position and view direction to coincide with the movement of a virtual endoscope. The usefulness of the virtual endoscope is enhanced with various features of the invention which facilitate control over the virtual endoscope and make the virtual images useful in the insertion of a real endoscope. Such features include: the superimposition of endoscopic images; an indicator image which indicates the orientation of the virtual endoscope relative to the organ being examined; a compass image indicating the orientation of a virtual subject relative to the virtual endoscope tip; guiding markers which indicate the direction in which the virtual or real endoscope is to be advanced; and focus markers which reveal the location of predetermined conditions such as a nidus within the virtual subject. A virtual operation device, modeled after an actual endoscope operating member, is used to control movement of the virtual endoscope tip within the virtual subject.
Inventors
- 👤 Tomohisa Fukunaga
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 07:41
CPC Classifications
G; G06; G06T; G06T15/00; G06T15/10; G06T15/20; G06T19/00; G06T19/003; G06T2210/00; G06T2210/41; G06T2219/00; G06T2219/028
Claims Analysis
Total Claims: 33
Claim 1
Independent Claim
214 words
An image processing system for displaying a three-dimensional object from a viewpoint position and in a view direction, comprising: a three-dimensional model preparation unit configured to construct a three-dimensional model of the three-dimensional object; an input unit configured to change the viewpoint position and the view direction by receiving commands to change the viewpoint position and the view direction from an input device; an endoscopic image preparation unit configured to prepare for displaying an endoscopic image of the three-dimensional object as viewed from the viewpoint position and in the view direction; an endoscopic image display which displays the endoscopic image; an outer shape image preparation unit configured to prepare an outer shape image of the three-dimensional object from the three-dimensional model; an indicator preparation unit configured to prepare for displaying an indicator image based on the viewpoint position, the view direction and a body position reference information, wherein the indicator image indicates the viewpoint position, the view direction and a reference direction; and an outer shape image display which displays the indicator image and the outer shape image simultaneously next to the displayed endoscopic image such that the location and orientation of the indicator image relative to the three-dimensional model indicates at least the viewpoint position and view direction relative to the three-dimensional model.
Claim 2
Dependent Claim
214 words
An image processing system for displaying a three-dimensional object from a viewpoint position and in a view direction, comprising: a three-dimensional model preparation unit configured to construct a three-dimensional model of the three-dimensional object; an input unit configured to change the viewpoint position and the view direction by receiving commands to change the viewpoint position and the view direction from an input device; an endoscopic image preparation unit configured to prepare for displaying an endoscopic image of the three-dimensional object as viewed from the viewpoint position and in the view direction; an endoscopic image display which displays the endoscopic image; an outer shape image preparation unit configured to prepare an outer shape image of the three-dimensional object from the three-dimensional model; an indicator preparation unit configured to prepare for displaying an indicator image based on the viewpoint position, the view direction and a body position reference information, wherein the indicator image indicates the viewpoint position, the view direction and a reference direction; and an outer shape image display which displays the indicator image and the outer shape image simultaneously next to the displayed endoscopic image such that the location and orientation of the indicator image relative to the three-dimensional model indicates at least the viewpoint position and view direction relative to the three-dimensional model.
Claim 3
Dependent Claim
38 words
The image processing system of claim 1 , wherein the indicator image comprises: a first element indicative of the viewpoint position; a second element indicative of the view direction; and a third element indicative of the reference direction.
Claim 4
Dependent Claim
18 words
The image processing system of claim 2 , wherein the first, second, and third elements are different colors.
Claim 5
Dependent Claim
61 words
The image processing system of claim 1 , further comprising: a guiding marker preparation unit configured to prepare for display on the endoscopic image an at least one guiding marker indicative of a direction in which an endoscope tip is to be advanced; and said endoscopic image display configured to display the endoscopic image and the at least one guiding marker.
Claim 6
Independent Claim
117 words
A method for displaying a three-dimensional object from a viewpoint position and in a view direction, said method comprising the steps of: constructing a three-dimensional model of the three-dimensional object; preparing an outer shape image of the three-dimensional object from the three dimensional model and a body position reference information; displaying the outer shape image in an outer shape image display; preparing an indicator image indicating at least the viewpoint position and the view direction; and displaying the indicator image and the outer shape image simultaneously such that the location and orientation of the indicator image relative to the outer shape image indicates at least the viewpoint position and the view direction relative to the three-dimensional model.
Claim 7
Independent Claim
117 words
A method for displaying a three-dimensional object from a viewpoint position and in a view direction, said method comprising the steps of: constructing a three-dimensional model of the three-dimensional object; preparing an outer shape image of the three-dimensional object from the three dimensional model and a body position reference information; displaying the outer shape image in an outer shape image display; preparing an indicator image indicating at least the viewpoint position and the view direction; and displaying the indicator image and the outer shape image simultaneously such that the location and orientation of the indicator image relative to the outer shape image indicates at least the viewpoint position and the view direction relative to the three-dimensional model.
Claim 8
Dependent Claim
37 words
The method of claim 5 further comprising the step of: providing the indicator image with a first element indicating the viewpoint position, a second element indicating the view direction, and a third element indicating a reference direction.
Claim 9
Dependent Claim
33 words
The method of claim 5 , wherein the step of displaying the indicator image further includes the step of: displaying the first, second, and third elements of the indicator image in different colors.
Claim 10
Dependent Claim
25 words
A computer-readable medium having computer-executable instructions for performing the steps in the method recited in any one of claims 5 , 6 or 7 .
Claim 11
Dependent Claim
52 words
The method of claim 5 , further comprising: preparing an at least one guiding marker for display on the endoscopic image, said guiding marker indicating a direction in which an endoscope is to be advanced; and displaying the endoscopic image and the at least one guiding marker in an endoscopic image display.
Claim 12
Dependent Claim
22 words
The method of claim 9 , further comprising the step of: selecting the location of the guiding marker on the endoscopic image.
Claim 13
Dependent Claim
23 words
The method of claim 9 , further comprising the step of: storing the location of the guiding marker relative to the three-dimensional model.
Claim 14
Dependent Claim
55 words
The method of claim 9 , wherein the step of preparing the at least one guiding marker includes the step of: providing the at least one guiding marker with the appearance of at least one of an X-shape, an up arrow, a down arrow, a right arrow, a left arrow, optional direction arrows, and text.
Claim 15
Dependent Claim
23 words
A computer-readable medium having computer-executable instructions for performing the steps in the method recited in any one of claims 9 - 12 .
Claim 16
Dependent Claim
119 words
An image processing system for displaying a three-dimensional object from a viewpoint position and in a view direction, comprising: a three-dimensional model preparation unit configured to construct a three-dimensional model of the three-dimensional object; an endoscopic image preparation unit configured to prepare for displaying an endoscopic image of the three-dimensional model as viewed from the viewpoint position and in the view direction; a compass image preparation unit configured to prepare for displaying a compass image, wherein the compass image comprises projections in the axial direction of a subject and in directions perpendicular to the axial direction of a virtual subject; and an endoscopic image display which displays the endoscopic image and displays the compass image over the endoscopic image.
Claim 17
Dependent Claim
119 words
An image processing system for displaying a three-dimensional object from a viewpoint position and in a view direction, comprising: a three-dimensional model preparation unit configured to construct a three-dimensional model of the three-dimensional object; an endoscopic image preparation unit configured to prepare for displaying an endoscopic image of the three-dimensional model as viewed from the viewpoint position and in the view direction; a compass image preparation unit configured to prepare for displaying a compass image, wherein the compass image comprises projections in the axial direction of a subject and in directions perpendicular to the axial direction of a virtual subject; and an endoscopic image display which displays the endoscopic image and displays the compass image over the endoscopic image.
Claim 18
Dependent Claim
39 words
The image processing system of claim 14 , wherein the compass, image further comprises: labels proximal to each of the projections, each label being indicative of the direction in which the corresponding projection points relative to the virtual subject.
Claim 19
Dependent Claim
33 words
The image processing system of claim 14 , wherein the projections which point in opposite directions have the same color and the projections which do not point in opposite directions have different colors.
Claim 20
Dependent Claim
29 words
The image processing system of claim 14 , wherein the compass image preparation unit comprises: shaping means for providing the compass image with the shape of the three-dimensional object.
Claim 21
Dependent Claim
23 words
The image processing system of claim 14 , wherein said shaping means comprises: means for providing the compass image with a spherical shape.
Claim 22
Dependent Claim
27 words
The image processing system of claim 14 , wherein the compass image preparation unit comprises: pattern forming means for providing the compass image with a network pattern.
Claim 23
Dependent Claim
29 words
The image processing system of claim 14 , wherein the compass image preparation unit comprises: coloring means for providing each half of the compass image with a different color.
Claim 24
Dependent Claim
26 words
The image processing system of claim 17 , wherein said shaping means comprises: means for providing the compass image with the shape of a human body.
Claim 25
Dependent Claim
25 words
The image processing system of claim 17 , wherein said shaping means comprises: means for providing the compass image with the shape of an organ.
Claim 26
Dependent Claim
62 words
The image processing system of claim 14 , further comprising: an operation path history control unit configured to prepare for display a sequence of past images corresponding to a sequence of past viewpoint positions, view directions, and reference directions; wherein said endoscopic image display is further configured to display said past images and to display said compass image over said past images.
Claim 27
Independent Claim
98 words
A method for displaying a three-dimensional object from a viewpoint position and in a view direction, said method comprising the steps of: constructing a three-dimensional model of the three-dimensional object; preparing for display an endoscopic image of the three-dimensional model as viewed from the viewpoint position and in the view direction; displaying the endoscopic image in an endoscopic display; generating for display a compass image including projections in the axial direction of a subject and in directions perpendicular to the axial direction of the subject; and displaying the compass image over the endoscopic image in the endoscopic display.
Claim 28
Independent Claim
98 words
A method for displaying a three-dimensional object from a viewpoint position and in a view direction, said method comprising the steps of: constructing a three-dimensional model of the three-dimensional object; preparing for display an endoscopic image of the three-dimensional model as viewed from the viewpoint position and in the view direction; displaying the endoscopic image in an endoscopic display; generating for display a compass image including projections in the axial direction of a subject and in directions perpendicular to the axial direction of the subject; and displaying the compass image over the endoscopic image in the endoscopic display.
Claim 29
Dependent Claim
41 words
The method of claim 24 , wherein the step of displaying the compass image includes: displaying the projections which point in opposite directions int he same color; and displaying the projections which do not point in opposite directions in different colors.
Claim 30
Dependent Claim
25 words
The method of claim 24 , wherein the step of generating includes the step of: providing the compass image with the shape of a sphere.
Claim 31
Dependent Claim
26 words
The method of claim 24 , wherein the step of generating includes the step of: providing the surface of the compass image with a network pattern.
Claim 32
Dependent Claim
26 words
The method of claim 24 , wherein the step of displaying includes the step of: displaying each half of the compass image in a different color.
Claim 33
Dependent Claim
25 words
A computer-readable medium having computer-executable instructions for performing the steps in the method recited in any one of claim 24 or 25 - 28 .
References Cited (Backward Citations)
US5261404A
Cited
US5458111A
Cited
US5782762A
Cited
US5920319A
Cited
US6083162A
Cited
US5611025A
Cited
US5638819A
Cited
US6139490A
Cited
US6167296A
Cited
US6108005A
Cited
US5986662A
Cited
US6167142A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-02-11 | 2005-08-13 | 2006-02-12 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-02-11 | 2009-08-13 | 2010-02-12 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-02-11 | 2013-08-13 | 2014-02-12 | $7700.00 | Window Closed / Lapsed |