US5508734A — Method and apparatus for hemispheric imaging whic…

Claim 1

Independent Claim 229 words

A system for electronic imaging and manipulation of a hemispheric field of view, comprising: a camera for receiving optical images of a hemispheric field of view and for producing output signals or affecting photographic film-based materials corresponding to the optical images: an optical imaging device associated with said camera for producing optical images throughout the hemispheric field of view for optical conveyance to said camera, said optical system having a configuration adapted to capture and enhance an image of peripheral regions of the hemispheric field of view and for magnifying a portion of the field of view within a range of approximately one to forty-five degrees above the horizon of a captured image of a hemispheric field of view; an image processing device associated with said camera and said optical imaging system for receiving optical images from said lens and for providing digitized output signals representative of the received optical images: input image memory for receiving the digitized output signals from said imager device and for storing the digitized output signals; image transform processing circuitry for selectively accessing and processing the digitized output signals from said input image memory according to user defined criteria; output image memory for receiving the processed signals from the image transform processor, and an output display or recording device connected to said output image memory for recording the signals in said output image memory.

Claim 2

Independent Claim 229 words

A system for electronic imaging and manipulation of a hemispheric field of view, comprising: a camera for receiving optical images of a hemispheric field of view and for producing output signals or affecting photographic film-based materials corresponding to the optical images: an optical imaging device associated with said camera for producing optical images throughout the hemispheric field of view for optical conveyance to said camera, said optical system having a configuration adapted to capture and enhance an image of peripheral regions of the hemispheric field of view and for magnifying a portion of the field of view within a range of approximately one to forty-five degrees above the horizon of a captured image of a hemispheric field of view; an image processing device associated with said camera and said optical imaging system for receiving optical images from said lens and for providing digitized output signals representative of the received optical images: input image memory for receiving the digitized output signals from said imager device and for storing the digitized output signals; image transform processing circuitry for selectively accessing and processing the digitized output signals from said input image memory according to user defined criteria; output image memory for receiving the processed signals from the image transform processor, and an output display or recording device connected to said output image memory for recording the signals in said output image memory.

Claim 3

Dependent Claim 15 words

The system as in claim 1, wherein said image processing device is an electronic imager.

Claim 4

Dependent Claim 15 words

The system as in claim 2, wherein said image processing device is a charge-coupled device.

Claim 5

Dependent Claim 34 words

The system as in claim 1, wherein said optical system has a configuration which images a peripheral portion of the hemispheric scene onto at least 50% of an imaging area of an imaging device.

Claim 6

Dependent Claim 27 words

The system as in claim 4, wherein said optical system includes a wide field multi-element lens positioned to direct an image to a light transmitting fiber array.

Claim 7

Dependent Claim 26 words

The system as in claim 5 wherein the fiber array is geometrically arranged to have a generally annular input end and a generally rectangular output end.

Claim 8

Dependent Claim 26 words

The system as in claim 5, wherein the fiber array is geometrically arranged to have a generally annular input end and a generally circular output end.

Claim 9

Dependent Claim 22 words

The system of claim 5 wherein the fibers of the fiber array have an imaging accuracy on the order of three microns.

Claim 10

Dependent Claim 28 words

The system as in claim 5 wherein the focal length of the wide field lens is scaled to match a desired magnification of the peripheral field of view.

Claim 11

Independent Claim 217 words

A system for electronic imaging and manipulation of a hemispheric field of view, comprising: a camera for receiving optical images of a hemispheric field of view and for producing output signals or affecting photographic film-based materials corresponding to the optical images: an optical imaging device associated with said camera for producing optical images throughout the hemispheric field of view for optical conveyance to said camera, said optical system having a configuration adapted to capture and enhance an image of peripheral regions of the hemispheric field of view, said optical imaging device including a color-aberrated multiple element wide field lens in combination with a gradient index hemispheric lens; an image processing device associated with said camera and said optical imaging system for receiving optical images from said lens and for providing digitized output signals representative of the received optical images; input image memory for receiving the digitized output signals from said imager device and for storing the digitized output signals; image transform processing circuitry for selectively accessing and processing the digitized output signals from said input image memory according to user defined criteria; output image memory for receiving the processed signals from the image transform processor, and an output display or recording device connected to said output image memory for recording the signals in said output image memory.

Claim 12

Independent Claim 217 words

A system for electronic imaging and manipulation of a hemispheric field of view, comprising: a camera for receiving optical images of a hemispheric field of view and for producing output signals or affecting photographic film-based materials corresponding to the optical images: an optical imaging device associated with said camera for producing optical images throughout the hemispheric field of view for optical conveyance to said camera, said optical system having a configuration adapted to capture and enhance an image of peripheral regions of the hemispheric field of view, said optical imaging device including a color-aberrated multiple element wide field lens in combination with a gradient index hemispheric lens; an image processing device associated with said camera and said optical imaging system for receiving optical images from said lens and for providing digitized output signals representative of the received optical images; input image memory for receiving the digitized output signals from said imager device and for storing the digitized output signals; image transform processing circuitry for selectively accessing and processing the digitized output signals from said input image memory according to user defined criteria; output image memory for receiving the processed signals from the image transform processor, and an output display or recording device connected to said output image memory for recording the signals in said output image memory.

Claim 13

Independent Claim 253 words

A system for electronic imaging and manipulation of a hemispheric field of view, comprising; a camera for receiving optical images of a hemispheric field of view and for producing output signals or affecting photographic film-based materials corresponding to the optical images; an optical imaging device associated with said camera for producing optical images throughout the hemispheric field of view for optical conveyance to said camera, said optical system having a configuration adapted to capture and enhance an image of peripheral regions of the hemispheric field of view and for magnifying a portion of the field of view within a range of approximately one to forty-five degrees above the horizon of a captured image of a hemispheric field of view and imaging the magnified portion of the hemispheric scene onto at least 50% of an imaging area of an imaging device; an image processing device including photographic film associated with said camera and said optical imaging system for receiving optical images from said lens and for providing digitized output signals representative of the received optical images; input image memory for receiving the digitized output signals from said imager device and for storing the digitized output signals; image transform processing circuitry for selectively accessing and processing the digitized output signals from said input image memory according to user defined criteria: output image memory for receiving the processed signals from the image transform processor, and an output display or recording device connected to said output image memory for recording the signals in said output image memory.

Claim 14

Independent Claim 253 words

A system for electronic imaging and manipulation of a hemispheric field of view, comprising; a camera for receiving optical images of a hemispheric field of view and for producing output signals or affecting photographic film-based materials corresponding to the optical images; an optical imaging device associated with said camera for producing optical images throughout the hemispheric field of view for optical conveyance to said camera, said optical system having a configuration adapted to capture and enhance an image of peripheral regions of the hemispheric field of view and for magnifying a portion of the field of view within a range of approximately one to forty-five degrees above the horizon of a captured image of a hemispheric field of view and imaging the magnified portion of the hemispheric scene onto at least 50% of an imaging area of an imaging device; an image processing device including photographic film associated with said camera and said optical imaging system for receiving optical images from said lens and for providing digitized output signals representative of the received optical images; input image memory for receiving the digitized output signals from said imager device and for storing the digitized output signals; image transform processing circuitry for selectively accessing and processing the digitized output signals from said input image memory according to user defined criteria: output image memory for receiving the processed signals from the image transform processor, and an output display or recording device connected to said output image memory for recording the signals in said output image memory.

Claim 15

Dependent Claim 33 words

The system as in claim 11, further including a capture and conversion device that converts the optical images on said photographic film into digital output signals for input to said input image memory.

Claim 16

Dependent Claim 16 words

The system as in claim 12, wherein the capture and conversion device is an NTSC-to-digital converter.

Claim 17

Dependent Claim 22 words

The system as in claim 12, wherein data from the capture and conversion device is input to a source image frame buffer.

Claim 18

Dependent Claim 17 words

The system as in claim 14, wherein the image transform processing circuitry comprises an image re-sampling sequencer.

Claim 19

Dependent Claim 22 words

The system as in claim 15, wherein the image re-sampling sequencer controls address sequencing of pixels in the source image frame buffer.

Claim 20

Dependent Claim 19 words

The system as in claim 16, wherein the image transform processing circuitry further comprises row and column warp engines.

Claim 21

Dependent Claim 36 words

The system as in claim 17, wherein the image transform processing circuitry further comprises a warped image buffer connected to the warp engines and to which an output of the source image frame buffer is input.

Claim 22

Dependent Claim 29 words

The system as in claim 18, wherein the image transform processing circuitry further comprises a look-up table containing transformation parameters for perspective correction of hemispheric field of view images.

Claim 23

Dependent Claim 34 words

The system as in claim 18, wherein the image transform processing circuitry further comprises an interpolation coefficient buffer connected to said look-up table to update said transformation parameters, and connected to a multiply/accumulate unit.

Claim 24

Dependent Claim 48 words

The system as in one of claim 1 or claim 10 or claim 11, wherein said output display is worn on or attached to a viewer's head, so that the orientation of the viewer with respect to the imaged surroundings is electronically conveyed and interpreted as user controls.

Claim 25

Independent Claim 228 words

A system for imaging and manipulation of a hemispheric field of view comprising: (i) an optical system for producing an optical image of a hemispherical field of view, said optical system having a central lens axis coaxial with a central axis of the hemispherical field of view and a configuration which emphasizes through differential magnification of peripheral content of the hemispherical field of view, said optical image having a defined usable image area when projected onto a plane; (ii) a camera optically coupled to said optical system for receiving optical images of the hemispherical field of view and for producing an output corresponding to the optical images; (iii) input image memory coupled to said camera for receiving and storing the output from said camera; (iv) a processor coupled to said input image memory for selectively accessing from said input image memory and processing output from said camera, said processor for transforming the output from the camera according to user defined criteria into a processor output which has a peripheral image content emphasis which differs from that of said optical system; (v) output image memory coupled to said processor for receiving and storing the processor output; and (vi) an output device coupled to said output image memory for rendering the stored processor output into a visual image transformed from the optical image in accordance with the user defined criteria.

Claim 26

Independent Claim 228 words

A system for imaging and manipulation of a hemispheric field of view comprising: (i) an optical system for producing an optical image of a hemispherical field of view, said optical system having a central lens axis coaxial with a central axis of the hemispherical field of view and a configuration which emphasizes through differential magnification of peripheral content of the hemispherical field of view, said optical image having a defined usable image area when projected onto a plane; (ii) a camera optically coupled to said optical system for receiving optical images of the hemispherical field of view and for producing an output corresponding to the optical images; (iii) input image memory coupled to said camera for receiving and storing the output from said camera; (iv) a processor coupled to said input image memory for selectively accessing from said input image memory and processing output from said camera, said processor for transforming the output from the camera according to user defined criteria into a processor output which has a peripheral image content emphasis which differs from that of said optical system; (v) output image memory coupled to said processor for receiving and storing the processor output; and (vi) an output device coupled to said output image memory for rendering the stored processor output into a visual image transformed from the optical image in accordance with the user defined criteria.

Claim 27

Dependent Claim 47 words

A system according to claim 22 wherein said optical system has a configuration that images the peripheral portion of a hemispherical scene onto a portion of the optical image usable image area which is no more than about ninety percent of the optical image usable image area.

Claim 28

Dependent Claim 36 words

A system according to claim 22 wherein said optical system comprises: a wide field multi-element lens; and a coordinated fiber array geometrically arranged to have a generally annular input end and a generally rectangular output end.

Claim 29

Dependent Claim 36 words

A system according to claim 22 wherein said optical system comprises: a wide field multi-element lens; and a coordinated fiber array geometrically arranged to have a generally annular input end and a generally annular output end.

Claim 30

Dependent Claim 22 words

A system according to claim 22 wherein said optical system comprises: a color-aberrated wide field lens; and a gradient index hemispheric lens.

Claim 31

Dependent Claim 27 words

A system according to claim 22 wherein said output device comprises a visual display device for displaying a visual image closely adjacent the eyes of an observer.

Claim 32

Dependent Claim 72 words

A system according to claim 27 wherein said processor generates processor output which represents a selected portion of the hemispherical field of view, and said system further comprises: sensors for detecting the orientation of the head or eyes of an observer, and a link between said sensors to said processor for modifying the generation of processor output as a function of the detected orientation of the head or eyes of an observer.

Claim 33

Dependent Claim 46 words

A system according to claim 22 wherein said optical system has a configuration that images the peripheral portion of a hemispherical scene onto a portion of the optical image usable image area which is at least about fifty percent of the optical image usable image area.

Claim 34

Dependent Claim 49 words

A system according to claim 29 wherein said optical system has a configuration that images the peripheral portion of a hemispherical scene onto a portion of the optical image usable image area which ranges from about fifty percent to about ninety percent of the optical image usable image area.

Claim 35

Dependent Claim 96 words

A system according to claim 29 wherein said optical system has a configuration which emphasizes through differential magnification at least a portion of that content of the hemispherical field of view which lies between a base plane of the hemispherical field of view and a right cone defined about said central lens axis, said cone having an included angle of forty five degrees between said central lens axis and a line generating said cone and with said line generating said cone passing through the point of intersection of said central lens axis with said base plane.

Claim 36

Dependent Claim 54 words

A system according to claim 22 further comprising an imager device interposed between said camera and said input image memory for receiving said output from said camera and for generating a digitized output, and further wherein said input image memory, said processor, and said output image memory receive, store and process said digitized output.

Claim 37

Dependent Claim 26 words

A system according to claim 32 wherein said camera comprises a light sensitive electronic image capture element and said imager device comprises an electronic digitizer circuit.

Claim 38

Dependent Claim 43 words

A system according to claim 32 further comprising photographic film for photographically capturing said output from said camera and further wherein said imager device comprises a capture and conversion device which converts the photographically captured output from said camera into said digitized output.

Claim 39

Dependent Claim 45 words

A system according to claim 22 wherein said processor comprises image processing and warping circuitry for transforming the output from the camera according to user defined criteria into a processor output which has a peripheral content emphasis which differs from that of said optical system.

Claim 40

Dependent Claim 99 words

A system according to claim 35 wherein said image processing and warping circuit comprises an arithmetic logic unit (ALU), and further wherein said processor comprises a storage memory device coupled to said ALU for receiving and storing control programs for determining the functions served by said ALU, and a control program stored in said storage memory device and accessible to said ALU for controlling the operation of said ALU to transform the output from the camera according to user defined criteria into a processor output which has a peripheral/central content emphasis which differs from that of said optical system.

Claim 41

Dependent Claim 23 words

A system according to claim 35 wherein said processor generates processor output which represents a selected portion of the hemispherical field of view.

Claim 42

Independent Claim 125 words

A method for electronically capturing, storing, and manipulating a hemispheric field of view, comprising the steps of: providing an optical system having a configuration that enhances the peripheral portion of the field of view, capturing the hemispheric field of view with the periphery-enhancing optical system and imaging the field of view onto an imager device while enhancing the peripheral field of view by selectively magnifying the visual content within an arc of between 10 and 45 degrees up from the horizon storing the captured image as a single image, selectively accessing a portion of the stored image to user-defined criteria, transforming the stored image so that the stored image can be displayed as a perspective-correct image, and displaying the perspective-correct image in a user-defined format.

Claim 43

Independent Claim 125 words

A method for electronically capturing, storing, and manipulating a hemispheric field of view, comprising the steps of: providing an optical system having a configuration that enhances the peripheral portion of the field of view, capturing the hemispheric field of view with the periphery-enhancing optical system and imaging the field of view onto an imager device while enhancing the peripheral field of view by selectively magnifying the visual content within an arc of between 10 and 45 degrees up from the horizon storing the captured image as a single image, selectively accessing a portion of the stored image to user-defined criteria, transforming the stored image so that the stored image can be displayed as a perspective-correct image, and displaying the perspective-correct image in a user-defined format.

Claim 44

Dependent Claim 19 words

The method as in claim 38, wherein said transforming step comprises manipulating the peripheral-enhanced image into a perspective-correct image.

Claim 45

Dependent Claim 18 words

The method as in claim 38, wherein the storage step comprises storing the captured image in electronic storage.

Claim 46

Independent Claim 122 words

A method for electronically capturing, storing, and manipulating a hemispheric field of view, comprising the steps of: providing an optical system having a configuration that enhances the peripheral portion of the field of view, capturing the hemispheric field of view with the periphery-enhancing optical system and imaging the field of view onto an imager device by enhancing the peripheral field of view, storing the captured image onto photographic film as a single image; selectively accessing a portion of the stored image according to user-defined criteria including converting the image from the photographic film into digital output format, transforming the stored image so that the stored image can be displayed as a perspective-correct image, and displaying the perspective-correct image in a user-defined format.

Claim 47

Independent Claim 122 words

A method for electronically capturing, storing, and manipulating a hemispheric field of view, comprising the steps of: providing an optical system having a configuration that enhances the peripheral portion of the field of view, capturing the hemispheric field of view with the periphery-enhancing optical system and imaging the field of view onto an imager device by enhancing the peripheral field of view, storing the captured image onto photographic film as a single image; selectively accessing a portion of the stored image according to user-defined criteria including converting the image from the photographic film into digital output format, transforming the stored image so that the stored image can be displayed as a perspective-correct image, and displaying the perspective-correct image in a user-defined format.

Claim 48

Independent Claim 85 words

A method for electronically manipulating a hemispheric scene having an enhanced peripheral field of view stored as an image on photographic film, comprising the steps of: converting the image on the photographic film into electronic output signals, selectively accessing a portion of the output signals according to user-defined criteria, transforming the accessed portion of the output signals by manipulating the peripheral-enhanced field of view so that the stored image can be displayed as a perspective-correct image, and displaying the perspective-correct image in the user-defined format.

Claim 49

Independent Claim 85 words

A method for electronically manipulating a hemispheric scene having an enhanced peripheral field of view stored as an image on photographic film, comprising the steps of: converting the image on the photographic film into electronic output signals, selectively accessing a portion of the output signals according to user-defined criteria, transforming the accessed portion of the output signals by manipulating the peripheral-enhanced field of view so that the stored image can be displayed as a perspective-correct image, and displaying the perspective-correct image in the user-defined format.

Claim 50

Independent Claim 114 words

A method for generating image sequences over physical distances from a reduced set of enhanced-periphery hemispheric images, wherein intermediate images are interpolated from a combination of adjacent hemispheric images, the method comprising the steps of: defining how many intermediate images are needed to satisfy the simulation of motion-video or film-based movie cameras; interpolating needed intermediate images from a combination of adjacent hemispheric images; identifying or electronically tagging interpolated images, then storing or recording them for later introduction to the image processing subsystem; loading original and interpolated image data sets in appropriate sequence to the image processing subsystem at rates sufficient to simulate real-time motion video, and displaying the perspective-correct image in the user-defined format.

Claim 51

Independent Claim 114 words

A method for generating image sequences over physical distances from a reduced set of enhanced-periphery hemispheric images, wherein intermediate images are interpolated from a combination of adjacent hemispheric images, the method comprising the steps of: defining how many intermediate images are needed to satisfy the simulation of motion-video or film-based movie cameras; interpolating needed intermediate images from a combination of adjacent hemispheric images; identifying or electronically tagging interpolated images, then storing or recording them for later introduction to the image processing subsystem; loading original and interpolated image data sets in appropriate sequence to the image processing subsystem at rates sufficient to simulate real-time motion video, and displaying the perspective-correct image in the user-defined format.

Claim 52

Independent Claim 200 words

A system for electronic manipulation of a hemispheric scene, comprising: a camera imaging system for imaging a hemispheric field of view; an optical system associated with said camera imaging system for producing the optical images throughout the field of view for optical conveyance to said camera imaging system; an imager device associated with said camera for receiving the optical images from said lens and for providing digitized output signals; input image memory for receiving the digitized output signals from said imaging device and for storing the digitized output signals; image transform processor circuitry for selectively accessing and processing the digitized output signals from said input image memory according to user-defined criteria; output image memory for receiving the processed signals from the image transform processor means; and an output display device or electronic recording device connected to said output image memory for displaying or recording the signals in said output image memory according to user-defined criteria; said optical system having a configuration that emphasizes the peripheral content of the field of view of a hemispheric scene as compared to the central content, such that said imager device receives magnified optical images of the peripheral portion of the hemispheric field of view.

Claim 53

Independent Claim 200 words

A system for electronic manipulation of a hemispheric scene, comprising: a camera imaging system for imaging a hemispheric field of view; an optical system associated with said camera imaging system for producing the optical images throughout the field of view for optical conveyance to said camera imaging system; an imager device associated with said camera for receiving the optical images from said lens and for providing digitized output signals; input image memory for receiving the digitized output signals from said imaging device and for storing the digitized output signals; image transform processor circuitry for selectively accessing and processing the digitized output signals from said input image memory according to user-defined criteria; output image memory for receiving the processed signals from the image transform processor means; and an output display device or electronic recording device connected to said output image memory for displaying or recording the signals in said output image memory according to user-defined criteria; said optical system having a configuration that emphasizes the peripheral content of the field of view of a hemispheric scene as compared to the central content, such that said imager device receives magnified optical images of the peripheral portion of the hemispheric field of view.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	1999-04-16	1999-10-16	2000-04-16	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	2003-04-16	2003-10-16	2004-04-16	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	2007-04-16	2007-10-16	2008-04-16	$7700.00	Window Closed / Lapsed

Method and apparatus for hemispheric imaging which emphasizes peripheral content

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag