US6285398B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Charge-coupled device video camera with raw data format output and software implemented camera signal processing
Assignee: Sony Corp
•
Filing: 1998-04-21
•
Granted: 2001-09-04
•
Expires: 2018-04-21
Abstract
Abstract A CCD video camera is coupled to a host system. The CCD video camera captures image data representing elements in its field of view. The video camera does not include a digital signal processing circuit for processing the raw video data into the appropriate video format. The raw video data is processed and converted into the appropriate video format for display by the host computer system after it is received from the video camera. Necessary gain adjustments and control signals are calculated within the host computer and provided to the video camera or used during the digital signal processing of the video data to adjust the parameters of the data before the video images are displayed. A histogram is generated in order to continually monitor and adjust the exposure and gain of the system and thereby appropriately change the necessary control signals for optimal performance. Through a graphical user interface a user can view the video images, set a proper white balance for the images by selecting a white area within the picture and view the histogram. A higher resolution scan mode is also used when capturing still images.
Inventors
- 👤 Michael Shinsky
- 👤 Michael Yukelson
- 👤 Leonid Milenky
- 👤 Ken Carter
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 16:48
CPC Classifications
H; H04; H04N; H04N23/00; H04N23/70; H04N23/72
Claims Analysis
Total Claims: 39
Claim 1
Independent Claim
144 words
A video camera for capturing and transmitting raw video data to a receiving device comprising: a. an imaging device to capture frame images; and b. an interface circuit coupled to the imaging device to receive the frame images and configured for coupling to the receiving device to transmit the frame images to the receiving device, wherein the receiving device is separate from the video camera and the frame images are transmitted as raw data from the interface circuit and processing of the frame images into a video format is performed by the receiving device, the interface circuit further configured to receive control signals from the receiving device, wherein the receiving device is configured to calculate values for control signals and to transmit the control signals to the video camera wherein the control signals include a shutter control signal and an automatic gain control signal.
Claim 2
Dependent Claim
144 words
A video camera for capturing and transmitting raw video data to a receiving device comprising: a. an imaging device to capture frame images; and b. an interface circuit coupled to the imaging device to receive the frame images and configured for coupling to the receiving device to transmit the frame images to the receiving device, wherein the receiving device is separate from the video camera and the frame images are transmitted as raw data from the interface circuit and processing of the frame images into a video format is performed by the receiving device, the interface circuit further configured to receive control signals from the receiving device, wherein the receiving device is configured to calculate values for control signals and to transmit the control signals to the video camera wherein the control signals include a shutter control signal and an automatic gain control signal.
Claim 3
Dependent Claim
16 words
The video camera as claimed in claim 1 wherein the imaging device is a charge-coupled device.
Claim 4
Dependent Claim
23 words
The video camera according to claim 1 wherein the values calculated by the receiving device comprise data calculated through an automatic exposure algorithm.
Claim 5
Dependent Claim
29 words
The video camera according to claim 1 wherein the calculated values for the control signals are derived from information being transmitted from the video camera to the receiving device.
Claim 6
Dependent Claim
15 words
The video camera according to claim 1 wherein the receiving device is a computer system.
Claim 7
Dependent Claim
138 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a video camera including: i. an imaging device to capture frame images; and ii. a camera interface circuit coupled to the imaging device to receive the frame images; and b. a host receiving device not included within the video camera including: i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera; and ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals wherein the control signals include a shutter control signal and an automatic gain control signal.
Claim 8
Dependent Claim
138 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a video camera including: i. an imaging device to capture frame images; and ii. a camera interface circuit coupled to the imaging device to receive the frame images; and b. a host receiving device not included within the video camera including: i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera; and ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals wherein the control signals include a shutter control signal and an automatic gain control signal.
Claim 9
Dependent Claim
31 words
The video image capturing apparatus as claimed in claim 6 further comprising a display device coupled to the processing circuit to receive and display the video format of the frame images.
Claim 10
Dependent Claim
49 words
The video image capturing apparatus as claimed in claim 7 wherein the video camera has a high resolution still picture mode used when capturing still images and further wherein the video camera transmits frame images one vertical line at a time when in the high resolution still picture mode.
Claim 11
Dependent Claim
27 words
The video image capturing apparatus as claimed in claim 7 wherein a histogram is developed by the processing circuit in order to continually adjust the control signals.
Claim 12
Dependent Claim
21 words
The video image capturing apparatus as claimed in claim 9 wherein the histogram is used to determine a gain change ratio.
Claim 13
Dependent Claim
35 words
The video image capturing apparatus as claimed in claim 10 wherein the gain change ratio is multiplied by a current total gain value to derive appropriate shutter control, automatic gain control and gain adjustment signals.
Claim 14
Dependent Claim
41 words
The video image capturing apparatus as claimed in claim 7 further comprising a graphical user interface displayed on the display device, wherein the graphical user interface includes a video window through which the video format of the frame images is displayed.
Claim 15
Dependent Claim
39 words
The video image capturing apparatus as claimed in claim 12 wherein the graphical user interface further includes a histogram window through which a histogram developed by the processing circuit in order to continually adjust the control signals is displayed.
Claim 16
Dependent Claim
36 words
The video image capturing apparatus as claimed in claim 13 wherein contrast, brightness and hue of the video format of the frame images displayed on the display device through the graphical user interface can be adjusted.
Claim 17
Dependent Claim
40 words
The video image capturing apparatus as claimed in claim 14 wherein a white balance of the video format of the frame images displayed on the display can be set by selection of a desired white object within the video window.
Claim 18
Dependent Claim
48 words
The video image capturing apparatus as claimed in claim 15 wherein the processing circuit adjusts the video format to display the desired white object as white, and further wherein the processing circuit also scales contrasting color components according to the desired white object, using a color adjustment matrix.
Claim 19
Dependent Claim
24 words
The video image capturing apparatus as claimed in claim 16 wherein the processing circuit adjusts the control signals according to the color adjustment matrix.
Claim 20
Dependent Claim
118 words
A graphical user interface including a video window for displaying video images and a white balance control wherein color and contrast of the video images is controlled by selection of a desired white object within the video window, wherein the video window is displayed on a host system including a display and an input device, wherein raw data representing the video images is received from a video camera, and wherein the host system further includes a processing circuit which processes the raw data and adjust the video images to display the desired white object as white and further wherein the processing circuit also scales contrasting color components according to the desired white object, using a color adjustment matrix.
Claim 21
Dependent Claim
118 words
A graphical user interface including a video window for displaying video images and a white balance control wherein color and contrast of the video images is controlled by selection of a desired white object within the video window, wherein the video window is displayed on a host system including a display and an input device, wherein raw data representing the video images is received from a video camera, and wherein the host system further includes a processing circuit which processes the raw data and adjust the video images to display the desired white object as white and further wherein the processing circuit also scales contrasting color components according to the desired white object, using a color adjustment matrix.
Claim 22
Dependent Claim
27 words
The graphical user interface as claimed in claim 18 wherein the processing circuit provides control signals to the video camera adjusted according to the color adjustment matrix.
Claim 23
Dependent Claim
182 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a video camera including: i. an imaging device to capture frame images; and ii. a camera interface circuit coupled to the imaging device to receive the frame images; and b. a host receiving device separate from the video camera including: i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera; ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals; iii. a display device coupled to the processing circuit to receive and display the video format of the frame images; and iv. a graphical user interface displayed on the display device including a video window through which the video format of the frame images is displayed wherein the control signals include a shutter control signal and an automatic gain control signal.
Claim 24
Dependent Claim
182 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a video camera including: i. an imaging device to capture frame images; and ii. a camera interface circuit coupled to the imaging device to receive the frame images; and b. a host receiving device separate from the video camera including: i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera; ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals; iii. a display device coupled to the processing circuit to receive and display the video format of the frame images; and iv. a graphical user interface displayed on the display device including a video window through which the video format of the frame images is displayed wherein the control signals include a shutter control signal and an automatic gain control signal.
Claim 25
Dependent Claim
44 words
The video image capturing apparatus as claimed in claim 20 wherein a histogram is developed by the processing circuit in order to continually adjust the control signals and further wherein the graphical user interface includes a histogram window through which the histogram is displayed.
Claim 26
Dependent Claim
21 words
The video image capturing apparatus as claimed in claim 21 wherein the histogram is used to determine a gain change ratio.
Claim 27
Dependent Claim
38 words
The video image capturing apparatus as claimed in claim 22 wherein a user can manually adjust contrast, brightness and hue of the video format of the frame images displayed on the display device through the graphical user interface.
Claim 28
Dependent Claim
38 words
The video image capturing apparatus as claimed in claim 23 wherein a white balance of the video format of the frame images displayed on the display is set by selecting a desired white object within the video window.
Claim 29
Dependent Claim
53 words
The video image capturing apparatus as claimed in claim 24 wherein the processing circuit adjusts the video format to display the desired white object as white, and further wherein the processing circuit also scales contrasting color components and adjusts the control signals according to the desired white object, using a color adjustment matrix.
Claim 30
Dependent Claim
191 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a video camera including: i. an imaging device to capture frame images; and ii. a camera interface circuit coupled to the imaging device to receive the frame images; and b. a host receiving device not included within the video camera including: i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera, wherein the control signals include a shutter control signal and an automatic gain control signal; ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals; and iii. a display device coupled to the processing circuit to receive and display the video format of the frame images and to determine appropriate vales of the control signals; wherein a histogram is developed by the processing circuit in order to continually adjust the control signals and to determine a gain change ratio.
Claim 31
Dependent Claim
191 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a video camera including: i. an imaging device to capture frame images; and ii. a camera interface circuit coupled to the imaging device to receive the frame images; and b. a host receiving device not included within the video camera including: i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera, wherein the control signals include a shutter control signal and an automatic gain control signal; ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals; and iii. a display device coupled to the processing circuit to receive and display the video format of the frame images and to determine appropriate vales of the control signals; wherein a histogram is developed by the processing circuit in order to continually adjust the control signals and to determine a gain change ratio.
Claim 32
Dependent Claim
35 words
The image video capturing apparatus as claimed in claim 26 wherein the gain change ratio is multiplied by a current total gain value to derive appropriate shutter control, automatic gain control and gain adjustment signals.
Claim 33
Dependent Claim
205 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a video camera including: i. an imaging device to capture frame images; and ii. a camera interface circuit coupled to the imaging device to receive the frame images; and b. a host receiving device separate from the video camera including: i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera; ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals; iii. a display device coupled to the processing circuit to receive and display the video of the frame images; and iv. a graphical user interface displayed on the display device including a video window through which the video format of the frame images is displayed; wherein a histogram is developed by the processing circuit to determine a gain change ratio and to continually adjust the control signals and further wherein the graphical user interface includes a histogram window through which the histogram is displayed.
Claim 34
Dependent Claim
205 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a video camera including: i. an imaging device to capture frame images; and ii. a camera interface circuit coupled to the imaging device to receive the frame images; and b. a host receiving device separate from the video camera including: i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera; ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals; iii. a display device coupled to the processing circuit to receive and display the video of the frame images; and iv. a graphical user interface displayed on the display device including a video window through which the video format of the frame images is displayed; wherein a histogram is developed by the processing circuit to determine a gain change ratio and to continually adjust the control signals and further wherein the graphical user interface includes a histogram window through which the histogram is displayed.
Claim 35
Dependent Claim
38 words
The video image capturing apparatus as claimed in claim 28 wherein a user can manually adjust contrast, brightness and hue of the video format of the frame images displayed on the display device through the graphical user interface.
Claim 36
Dependent Claim
54 words
The video image capturing apparatus as claimed in claim 28 wherein a white balance of the video format of the frame images displayed on the display is set by selecting a desired white object within the video window wherein the processing circuit adjusts the video format to display the desired white object as white.
Claim 37
Dependent Claim
35 words
The video image capturing apparatus as claimed in claim 28 wherein the processing circuit also scales contrasting color components and adjusts the control signals according to the desired white object, using a color adjustment matrix.
Claim 38
Dependent Claim
135 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a histogram used to determine a gain change ratio; and b. a current total gain value multiplied by the gain change ratio to derive appropriate shutter control, automatic gain control and gain adjustment signals; wherein a user can manually adjust contrast, brightness and hue of a video format of frame images displayed on a display device through a graphical user interface, and further wherein a white balance of the video format of the frame images displayed on the display device is set by selecting a desired white object within a video window of the display device, and a processing circuit also scales contrasting color components and adjusts the control signals according to the desired white object, using a color adjustment matrix.
Claim 39
Dependent Claim
135 words
A video image capturing apparatus for capturing, processing and displaying video images comprising: a. a histogram used to determine a gain change ratio; and b. a current total gain value multiplied by the gain change ratio to derive appropriate shutter control, automatic gain control and gain adjustment signals; wherein a user can manually adjust contrast, brightness and hue of a video format of frame images displayed on a display device through a graphical user interface, and further wherein a white balance of the video format of the frame images displayed on the display device is set by selecting a desired white object within a video window of the display device, and a processing circuit also scales contrasting color components and adjusts the control signals according to the desired white object, using a color adjustment matrix.
References Cited (Backward Citations)
US5457494A
Cited
US5012333A
Cited
US5016107A
Cited
US5650775A
Cited
US5253047A
Cited
US5420573A
Cited
US5627603A
Cited
US5402171A
Cited
US5426517A
Cited
US5557724A
Cited
US5585856A
Cited
US5493332A
Cited
US5781599A
Cited
US5486853A
Cited
US5758094A
Cited
US5568192A
Cited
US5668596A
Cited
US5818975A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-09-03 | 2005-03-05 | 2005-09-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-09-03 | 2009-03-05 | 2009-09-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-09-03 | 2013-03-05 | 2013-09-04 | $7700.00 | Window Closed / Lapsed |