US6169817B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for 4D reconstruction and visualization
Assignee: VirtualScopics LLC
•
Filing: 1998-11-04
•
Granted: 2001-01-02
•
Expires: 2018-11-04
Abstract
Abstract From raw image data obtained through magnetic resonance imaging or the like, an object is reconstructed and visualized in four dimensions (both space and time) by first dividing the first image in the sequence of images into regions through statistical estimation of the mean value and variance of the image data and joining of picture elements (voxels) that are sufficiently similar and then extrapolating the regions to the remainder of the images by using known motion characteristics of components of the image (e.g., spring constants of muscles and tendons) to estimate the rigid and deformational motion of each region from image to image. The object and its regions can be rendered and interacted with in a four-dimensional virtual reality environment.
Inventors
- 👤 Kevin J. Parker
- 👤 Saara Marjatta Sofia Totterman
- 👤 Jose Tamez Pe{tilde over (n)}a
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 06:58
CPC Classifications
G; G06; G06V; G06V10/00; G06V10/20; G06T; G06T7/00; G06T7/0002; G06T7/0012; G06T7/10; G06T7/11; G06T7/143; G06T7/20; G06T7/215; G06T2207/00; G06T2207/10; G06T2207/10072; G06T2207/10088; G06T2207/30; G06T2207/30004; G06T2207/30008
Claims Analysis
Total Claims: 41
Claim 1
Independent Claim
164 words
A method for producing an interactive virtual reality replica of an object, comprising the steps of: (a) forming a sequence of images of an object, the images being separated from one another in time, and each of the images comprising a plurality of image elements; (b) dividing one of said images of said sequence of images into regions, each of said regions corresponding to a component of said object, by (i) estimating local statistical properties for said image in each of said image elements in the image and (ii) Joining said image elements into said regions in accordance with similarities among said local statistical 410 properties of said image elements; and (c) defining said regions in all of said images by (i) providing a database of characteristics of the components of said object, (ii) estimating a movement of each of said regions in accordance with said database, and (iii) determining locations of said regions in all of said images in accordance with said movement.
Claim 2
Independent Claim
164 words
A method for producing an interactive virtual reality replica of an object, comprising the steps of: (a) forming a sequence of images of an object, the images being separated from one another in time, and each of the images comprising a plurality of image elements; (b) dividing one of said images of said sequence of images into regions, each of said regions corresponding to a component of said object, by (i) estimating local statistical properties for said image in each of said image elements in the image and (ii) Joining said image elements into said regions in accordance with similarities among said local statistical 410 properties of said image elements; and (c) defining said regions in all of said images by (i) providing a database of characteristics of the components of said object, (ii) estimating a movement of each of said regions in accordance with said database, and (iii) determining locations of said regions in all of said images in accordance with said movement.
Claim 3
Dependent Claim
24 words
The method of claim 1 , wherein each of said images is a three-dimensional image and each of said image elements is a voxel.
Claim 4
Dependent Claim
17 words
The method of claim 1 , wherein said local statistical properties comprise local mean and variance properties.
Claim 5
Dependent Claim
97 words
The method of claim 1 , wherein step (b) further comprises (iii) testing each of said regions to detect regions corresponding to multiple components of said object and splitting the regions corresponding to said multiple components of said object to produce new regions each corresponding to a single component of said object and (iv) testing each of said regions to detect regions corresponding to parts of components of said object and merging the regions corresponding to the parts of the components of said object to produce new regions each corresponding to an entire component of said object.
Claim 6
Dependent Claim
26 words
The method of claim 4 , wherein the regions corresponding to the parts of the components are detected in accordance with a compactness of each region.
Claim 7
Dependent Claim
27 words
The method of claim 1 , wherein said database comprises internal motion characteristics of the components and characteristics of relative motion between adjacent ones of the components.
Claim 8
Dependent Claim
18 words
The method of claim 6 , wherein the characteristics of the relative motion are expressed as spring constants.
Claim 9
Dependent Claim
25 words
The method of claim 7 , wherein step (c)(ii) comprises modeling said object as a finite element mesh using a subplurality of the image elements.
Claim 10
Dependent Claim
21 words
The method of claim 6 , wherein step (c)(ii) comprises minimizing an energy of each two consecutive images in said sequence.
Claim 11
Dependent Claim
38 words
The method of claim 9 , wherein the movement estimated in step (c)(ii) comprises a rigid movement and a deformational movement, and the energy comprises an energy of the rigid movement and an energy of the deformational movement.
Claim 12
Dependent Claim
26 words
The method of claim 9 , wherein step (c)(ii) further comprises estimating a velocity of each of said image elements in accordance with the minimized energy.
Claim 13
Dependent Claim
41 words
The method of claim 1 , wherein step (b)(ii) comprises (A) joining the images in accordance with at least one threshold value to form iteration regions, (B) deriving a cost functional from the iteration regions, and (C) optimizing the cost functional.
Claim 14
Dependent Claim
30 words
The method of claim 12 , wherein step (C) comprises adjusting the at least one threshold value to decrease the cost functional iteratively until the cost functional no longer decreases.
Claim 15
Independent Claim
204 words
A system for reconstructing an image in both space and time from raw image data, the image data comprising a sequence of images of an object, the images being separated from one another in time, and each of the images comprising a plurality of image elements, the system comprising: input means for receiving an input of the raw image data and of a database of characteristics of components of the object; processing means for (a) dividing an image from among the images into regions, each of the regions corresponding to a component of the object, by (i) estimating local statistical properties for the image in each of the image elements in the image and (ii) joining the image elements into the regions in accordance with similarities among said local statistical properties of the image elements and for (b) defining the regions in all of the images by (i) estimating a movement of each of the regions in accordance with the database and (ii) determining locations of the regions in all of the images in accordance with the movement; and graphical rendering means for providing a virtual reality representation and visualization of all of the images with the regions located in all of the images.
Claim 16
Independent Claim
204 words
A system for reconstructing an image in both space and time from raw image data, the image data comprising a sequence of images of an object, the images being separated from one another in time, and each of the images comprising a plurality of image elements, the system comprising: input means for receiving an input of the raw image data and of a database of characteristics of components of the object; processing means for (a) dividing an image from among the images into regions, each of the regions corresponding to a component of the object, by (i) estimating local statistical properties for the image in each of the image elements in the image and (ii) joining the image elements into the regions in accordance with similarities among said local statistical properties of the image elements and for (b) defining the regions in all of the images by (i) estimating a movement of each of the regions in accordance with the database and (ii) determining locations of the regions in all of the images in accordance with the movement; and graphical rendering means for providing a virtual reality representation and visualization of all of the images with the regions located in all of the images.
Claim 17
Dependent Claim
24 words
The system of claim 14 , wherein each of the images is a three-dimensional image and each of the image elements is a voxel.
Claim 18
Dependent Claim
19 words
The system of claim 14 , wherein said local statistical properties comprise local mean value and local variance properties.
Claim 19
Dependent Claim
98 words
The system of claim 14 , wherein the processing means comprises means for testing each of the regions to detect regions corresponding to multiple components of the object and splitting the regions corresponding to the multiple components of the object to produce new regions, each corresponding to a single component of the object, and for testing each of the regions to detect regions corresponding to parts of components of the object and merging the regions corresponding to the parts of the components of the object to produce new regions each corresponding to an entire component of the object.
Claim 20
Dependent Claim
26 words
The system of claim 17 , wherein the regions corresponding to the parts of the components are detected in accordance with a compactness of each region.
Claim 21
Dependent Claim
27 words
The system of claim 14 , wherein the database comprises internal motion characteristics of the components and characteristics of relative motion between adjacent ones of the components.
Claim 22
Dependent Claim
18 words
The system of claim 19 , wherein the characteristics of the relative motion are expressed as spring constants.
Claim 23
Dependent Claim
28 words
The system of claim 20 , wherein the processing means comprises means for modeling the object as a finite element mesh using a subplurality of the image elements.
Claim 24
Dependent Claim
24 words
The system of claim 19 , wherein the processing means comprises means for minimizing an energy of each two consecutive images in said sequence.
Claim 25
Dependent Claim
36 words
The system of claim 22 , wherein said estimated movement comp rises a rigid movement and a deformational movement, and the energy comprises an energy of the rigid movement and an energy of the deformational movement.
Claim 26
Dependent Claim
28 words
The system of claim 22 , wherein the processing means comprises means for estimating a velocity of each of said image elements in accordance with the minimized energy.
Claim 27
Dependent Claim
44 words
The system of claim 14 , wherein the processing means comprises means for (A) joining the images in accordance with at least one threshold value to form iteration regions, (B) deriving a cost functional from the iteration regions, and (C) optimizing the cost functional.
Claim 28
Dependent Claim
33 words
The system of claim 25 , wherein the cost functional is optimized by adjusting the at least one threshold value to decrease the cost functional iteratively until the cost functional no longer decreases.
Claim 29
Independent Claim
187 words
A method for producing, in a computing device, a virtual reality replica of a complex entity, comprising the steps of: (a) forming a sequence of images of said complex entity, the images being separated from one another in time, and each of said images comprising a plurality of image elements; (b) dividing one of said images of said sequence of images into regions, each of said regions corresponding to a component of said complex entity, by (i) estimating local statistical properties for said image in each of said image elements in the image and (ii) joining said image elements into said regions in accordance with similarities among said local statistical properties of said image elements; (c) defining said regions in all of said images by (i) providing a database of characteristics of the components of said complex entity, (ii) estimating a movement of each of said regions in accordance with said database, and (iii) determining locations of said regions in all of said images in accordance with said movement; and (d) rendering said regions in three spatial dimensions and one time dimension in a virtual reality environment.
Claim 30
Independent Claim
187 words
A method for producing, in a computing device, a virtual reality replica of a complex entity, comprising the steps of: (a) forming a sequence of images of said complex entity, the images being separated from one another in time, and each of said images comprising a plurality of image elements; (b) dividing one of said images of said sequence of images into regions, each of said regions corresponding to a component of said complex entity, by (i) estimating local statistical properties for said image in each of said image elements in the image and (ii) joining said image elements into said regions in accordance with similarities among said local statistical properties of said image elements; (c) defining said regions in all of said images by (i) providing a database of characteristics of the components of said complex entity, (ii) estimating a movement of each of said regions in accordance with said database, and (iii) determining locations of said regions in all of said images in accordance with said movement; and (d) rendering said regions in three spatial dimensions and one time dimension in a virtual reality environment.
Claim 31
Dependent Claim
15 words
The method of claim 2 , wherein each of said regions is a three-dimensional region.
Claim 32
Dependent Claim
20 words
The method of claim 28 , wherein said interactive virtual reality replica is rendered at least in three spatial dimensions.
Claim 33
Dependent Claim
15 words
The system of claim 15 , wherein each of said regions is a three-dimensional region.
Claim 34
Dependent Claim
20 words
The system of claim 30 , wherein said interactive virtual reality replica is rendered at least in three spatial dimensions.
Claim 35
Dependent Claim
24 words
The method of claim 27 , wherein each of said images is a three-dimensional image, and each of the image elements is a voxel.
Claim 36
Dependent Claim
15 words
The method of claim 32 , wherein each of said regions is a three-dimensional region.
Claim 37
Independent Claim
123 words
A method for producing an interactive virtual reality replica of an object, comprising the steps of: a) forming an image of an object, the image comprising a plurality of image elements; b) dividing said image into regions, each of said regions corresponding to a component of said object, by i) estimating local statistical properties for said image in each of said image elements in the image; and ii) joining said image elements into said regions in accordance with similarities among said local statistical properties of said image elements; and (c) defining said regions in said image by i) estimating statistical properties of each region; and ii) joining and splitting said regions in accordance with the similarities among said statistical properties of said regions.
Claim 38
Independent Claim
123 words
A method for producing an interactive virtual reality replica of an object, comprising the steps of: a) forming an image of an object, the image comprising a plurality of image elements; b) dividing said image into regions, each of said regions corresponding to a component of said object, by i) estimating local statistical properties for said image in each of said image elements in the image; and ii) joining said image elements into said regions in accordance with similarities among said local statistical properties of said image elements; and (c) defining said regions in said image by i) estimating statistical properties of each region; and ii) joining and splitting said regions in accordance with the similarities among said statistical properties of said regions.
Claim 39
Dependent Claim
22 words
The method of claim 34 , wherein said image is a three-dimensional image and each of said image elements is a voxel.
Claim 40
Dependent Claim
15 words
The method of claim 35 , wherein each of said regions is a three-dimensional region.
Claim 41
Dependent Claim
20 words
The method of claim 36 , wherein said interactive virtual reality replica is rendered at least in three spatial dimensions.
References Cited (Backward Citations)
US5442733A
Cited
US5818231A
Cited
US5633951A
Cited
US5412563A
Cited
US5839440A
Cited
US5825909A
Cited
US5891030A
Cited
US5926568A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-01-02 | 2004-07-03 | 2005-01-02 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-01-02 | 2008-07-03 | 2009-01-02 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-01-02 | 2012-07-03 | 2013-01-02 | $7700.00 | Window Closed / Lapsed |