Patent US5631697A successfully refreshed from Google Patents.
US5631697A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Video camera capable of automatic target tracking
Assignee: Hitachi Consumer Electronics Co Ltd
•
Filing: 1995-06-02
•
Granted: 1997-05-20
•
Expires: 2015-06-02
Abstract
Abstract An image signal provided by an image pickup device, such as a CCD, is converted into a video signal by a signal processor. An extraction means extracts a candidate object region from the current video signal and an object region determined a certain time before by a decision means is read from a memory. For example, the decision means compares an overlapping region in which the candidate object region and the object region read from the memory overlap each other and provides a new object region a size larger than the overlapping region and replace the object region with the new object region to update the contents of the memory. On the other hand, a calculating means calculates the features of the object region including the position of the centroid of the object region on a screen. A control means, such as a microcomputer, controls the image pick up device on the basis of information about the features so that a region including the target object substantially in its central part is cut out as a video signal. Consequently, the target object can be surely tracked regardless of objects other than the target object included in a scene.
Inventors
- 👤 Ryuji Nishimura
- 👤 Mayuko Oda
- 👤 Takuya Imaide
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-07 14:12
CPC Classifications
G; G01; G01S; G01S3/00; G01S3/78; G01S3/782; G01S3/785; G01S3/786; G01S3/7864; G01S3/7865; H; H04; H04N; H04N23/00; H04N23/60; H04N23/69
Claims Analysis
Total Claims: 45
Claim 1
Independent Claim
232 words
A video camera comprising: an image pickup device having a plurality of light receiving elements in a two-dimensional arrangement on an imaging surface thereof for producing an image signal through the photoelectric conversion of an optical image focused on the imaging surface by a lens unit; a driver which drives the image pickup device to read the image signal from a part of the light receiving elements located in a specified region of the imaging surface; a signal processor which produces a video signal indicating the luminance and chrominance on the basis of the image signal; a target tracking processor which processes the video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a controller which continuously determines a location of the specified region of the imaging surface representing the current object region, so that the object region is located substantially in the center of the specified region, the controller providing an output to the driver for specifying the location of the specified region; wherein the target tracking processor is provided with an extractor which makes a decision as to whether or not the video signal meets the predetermined conditions and generates an extraction signal representing an extracted region meeting the predetermined conditions; and wherein the predetermined conditions require that the luminance and chrominance of the video signal are within fixed ranges, respectively.
Claim 2
Dependent Claim
232 words
A video camera comprising: an image pickup device having a plurality of light receiving elements in a two-dimensional arrangement on an imaging surface thereof for producing an image signal through the photoelectric conversion of an optical image focused on the imaging surface by a lens unit; a driver which drives the image pickup device to read the image signal from a part of the light receiving elements located in a specified region of the imaging surface; a signal processor which produces a video signal indicating the luminance and chrominance on the basis of the image signal; a target tracking processor which processes the video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a controller which continuously determines a location of the specified region of the imaging surface representing the current object region, so that the object region is located substantially in the center of the specified region, the controller providing an output to the driver for specifying the location of the specified region; wherein the target tracking processor is provided with an extractor which makes a decision as to whether or not the video signal meets the predetermined conditions and generates an extraction signal representing an extracted region meeting the predetermined conditions; and wherein the predetermined conditions require that the luminance and chrominance of the video signal are within fixed ranges, respectively.
Claim 3
Dependent Claim
34 words
A video camera according to claim 1, wherein the predetermined conditions require that the luminance and chrominance of the video signal are within ranges of luminance and chrominance corresponding to those of flesh color.
Claim 4
Dependent Claim
81 words
A video camera according to claim 1, wherein the target tracking processor is further provided with a memory for storing the object region determined a certain time before and a comparator which compares the contents of the memory and the extraction signal and generates a signal representing an overlapping region in a region represented by the extraction signal overlapping a region represented by the contents of the memory, and the object region is determined on the basis of the overlapping region.
Claim 5
Dependent Claim
55 words
A video camera according to claim 3, wherein the target tracking processor is provided further with a region enlarging means which receives the signal representing the overlapping region and generates a signal representing an enlarged region obtained by enlarging the overlapping region at a fixed enlargement ratio, and the objective region is the enlarged region.
Claim 6
Dependent Claim
38 words
A Video camera according to claim 1, wherein the target tracking processor is provided with a calculating means for calculating the features of the object region, and provides a feature signal representing the features of the object region.
Claim 7
Dependent Claim
27 words
A video camera according to claim 5, wherein the features of the object region are the size and the position of the centroid of the object region.
Claim 8
Dependent Claim
70 words
A video camera according to claim 6, further comprising a zoom processor for processing the video signal provided by the signal processor to change the size of a specified part of an image formed on the imaging surface, wherein the controller controls the zoom processor so that the specified part of the image formed on the imaging surface is reduced or enlarged according to the size of the object region.
Claim 9
Dependent Claim
55 words
A video camera according to claim 6, further comprising a zoom lens unit and a zooming motor for driving the zoom lens unit, wherein the controller controls the zooming motor so that the specified part of the image formed on the imaging surface is enlarged or reduced according to the size of the object region.
Claim 10
Dependent Claim
47 words
A video camera according to claim 6, further comprising a zoom lens unit and an automatic focusing motor for driving the zoom lens unit, wherein the controller calculates the subject distance on the basis of the size of the object region and controls the automatic zooming motor.
Claim 11
Dependent Claim
71 words
A video camera according to claim 1, further comprising an optical axis shifting means for shifting the optical axis of the image focused by the lens unit, and a second driver for driving the optical axis shifting means, wherein the controller controls the second driver on the basis of the signal representing the object region so that the object region is displayed in the substantially central region of the monitor screen.
Claim 12
Dependent Claim
82 words
A video camera according to claim 1, further comprising a zoom processor for processing the video signal provided by the signal processor to change the size of a specified part of the image formed on the imaging surface, and a memory storing algorithms defining procedures for automatic panning, zooming and focusing according to the condition of the scene, wherein the controller controls the zoom processor according to the algorithms stored in the memory and signals given thereto by the target tracking processor.
Claim 13
Dependent Claim
47 words
A video camera according to claim 1, further comprising a zoom lens unit and a zooming motor for driving the zoom lens unit, wherein the controller controls the zooming motor according to the algorithms stored in a memory and signals given thereto by the target tracking processor.
Claim 14
Dependent Claim
44 words
A video camera according to claim 1, further comprising a region specifying means to be operated by the operator to specify a region on the monitor screen and a sampling circuit for sampling video signals representing a region specified by the region specifying means.
Claim 15
Dependent Claim
46 words
A video camera according to claim 13, wherein the region specifying means comprises a push button and a marker displaying means for displaying a marker on the monitor screen, and a region corresponding to the marker when the push button is pushed is the specified region.
Claim 16
Dependent Claim
48 words
A video camera according to claim 1, further comprising a mechanism for moving a range on the imaging surface on which the image is focused by the lens unit, wherein the controller controls the mechanism so that the object region will be always included in the imaging surface.
Claim 17
Dependent Claim
30 words
A video camera according to claim 15, wherein the mechanism is an electrically powered pedestal mounted with the video camera and capable of changing the direction of the video camera.
Claim 18
Dependent Claim
24 words
A video camera according to claim 15, wherein the mechanism is an active prism interposed between the lens unit and the image pickup device.
Claim 19
Dependent Claim
68 words
A video camera according to claim 15, wherein the controller controls the mechanism so that the object region is located substantially in the central region of the monitor screen with respect to the horizontal direction, and controls the driver so that the object region including the image of the target object is located substantially in the central region of the monitor screen with respect to the vertical direction.
Claim 20
Dependent Claim
67 words
A video camera according to claim 15, wherein the controller controls the mechanism so that the object region is substantially in the central region of the monitor screen with respect to the vertical direction, and controls the driver so that the object region including the image of the target object is located substantially in the central region of the monitor screen with respect to the horizontal direction.
Claim 21
Dependent Claim
38 words
A video camera according to claim 1, wherein the driver drives the image pickup device to read the image signal only from a part of the light receiving elements located in a specified region of the imaging surface.
Claim 22
Dependent Claim
148 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; wherein the predetermined conditions require that the luminance and chrominance of the video signal are in fixed ranges respectively.
Claim 23
Dependent Claim
148 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; wherein the predetermined conditions require that the luminance and chrominance of the video signal are in fixed ranges respectively.
Claim 24
Dependent Claim
156 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; wherein the predetermined conditions require that the luminance and chrominance of the video signal are in ranges of luminance and chrominance corresponding to those of flesh color.
Claim 25
Dependent Claim
156 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; wherein the predetermined conditions require that the luminance and chrominance of the video signal are in ranges of luminance and chrominance corresponding to those of flesh color.
Claim 26
Dependent Claim
244 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; wherein the target tracking processor means is provided with an extraction means which makes a decision as to whether or not the video signal meets the predetermined conditions; and generates an extraction signal representing an extracted region meeting the predetermined conditions, and the target tracking processor means is further provided with a second storage means for storing the object region determined a certain time before and a compactor means which compares the contents of the second storage means and the extraction signal and generates a signal representing an overlapping region in a region represented by the contents of the second storage means, and the object region is determined on the basis of the overlapping region.
Claim 27
Dependent Claim
244 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; wherein the target tracking processor means is provided with an extraction means which makes a decision as to whether or not the video signal meets the predetermined conditions; and generates an extraction signal representing an extracted region meeting the predetermined conditions, and the target tracking processor means is further provided with a second storage means for storing the object region determined a certain time before and a compactor means which compares the contents of the second storage means and the extraction signal and generates a signal representing an overlapping region in a region represented by the contents of the second storage means, and the object region is determined on the basis of the overlapping region.
Claim 28
Dependent Claim
56 words
A video camera according to claim 23, wherein the target tracking processor means is provided further with a region enlarging means which receives the signal representing the overlapping region and generates a signal representing an enlarged region obtained by enlarging the overlapping region at a fixed enlargement ratio, and the object region is the enlarged region.
Claim 29
Dependent Claim
181 words
A video camera comprising; an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; wherein the image pickup means and the storage means are comprised of an image pickup device of a CCD type or a MOS type, capable of photoelectric signal conversion and storage, the control means controls the driving of the image pickup device to control the read operation of the signal processing means.
Claim 30
Dependent Claim
181 words
A video camera comprising; an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; and a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; wherein the image pickup means and the storage means are comprised of an image pickup device of a CCD type or a MOS type, capable of photoelectric signal conversion and storage, the control means controls the driving of the image pickup device to control the read operation of the signal processing means.
Claim 31
Dependent Claim
234 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; and a mechanism for moving a range of the imaging surface on which the image is focused by the lens unit; wherein the control means controls the mechanism so that the object region will be always included in the imaging surface and so that the object region is located substantially in the central region of the monitor screen with respect to the horizontal direction, and controls the operation of the signal processing means for reading data from the storage means so that the object region including the extracted object is located substantially in the central region of the monitor screen with respect to the vertical direction.
Claim 32
Dependent Claim
234 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; and a mechanism for moving a range of the imaging surface on which the image is focused by the lens unit; wherein the control means controls the mechanism so that the object region will be always included in the imaging surface and so that the object region is located substantially in the central region of the monitor screen with respect to the horizontal direction, and controls the operation of the signal processing means for reading data from the storage means so that the object region including the extracted object is located substantially in the central region of the monitor screen with respect to the vertical direction.
Claim 33
Dependent Claim
208 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; and a mechanism for moving a range of the imaging surface on which the image focused by the lens unit; wherein the control means controls the mechanism so that the object region will be always included in the imaging surface and so that the object region is located substantially in the central region of the monitor screen with respect to the vertical direction and controls the operation of the signal processing means for reading the contents of the storage means.
Claim 34
Dependent Claim
208 words
A video camera comprising: an image pickup means capable of producing image data through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a storage means for temporarily storing the image data produced by the image pickup means; a signal processing means for producing a video signal indicating the luminance and chrominance on the basis of the image data; a target tracking processor means which processes the current video signal on the basis of predetermined conditions and continuously provides a signal representing a current object region; a control means which determines at all times, on the basis of the signal representing the current object region, so that the object region is located in the substantially central region of a monitor screen; and a mechanism for moving a range of the imaging surface on which the image focused by the lens unit; wherein the control means controls the mechanism so that the object region will be always included in the imaging surface and so that the object region is located substantially in the central region of the monitor screen with respect to the vertical direction and controls the operation of the signal processing means for reading the contents of the storage means.
Claim 35
Dependent Claim
190 words
A video camera comprising: an image pickup means capable of producing an image signal through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a signal processing means which produces a video signal indicating the luminance and chrominance on the basis of the image signal; a storage means for storing an object region which has previously been determined; an extraction means which receives the video signal, and provides a signal representing an extracted region in which the video signal satisfies predetermined conditions; a comparator means which receives a signal read from the storage means and the output signal of the extraction means, and provides a signal representing an overlapping region in which the object region and the extracted region overlap each other; a region enlarging means which receives the output signal of the comparator means and gives a signal representing a new object region determined by enlarging the overlapping region at a predetermined enlargement ratio; and a control means which functions for target tracking control operation to keep the new object region within a monitor screen on which the video signal is displayed.
Claim 36
Dependent Claim
190 words
A video camera comprising: an image pickup means capable of producing an image signal through the photoelectric conversion of an optical image focused on its imaging surface by a lens unit; a signal processing means which produces a video signal indicating the luminance and chrominance on the basis of the image signal; a storage means for storing an object region which has previously been determined; an extraction means which receives the video signal, and provides a signal representing an extracted region in which the video signal satisfies predetermined conditions; a comparator means which receives a signal read from the storage means and the output signal of the extraction means, and provides a signal representing an overlapping region in which the object region and the extracted region overlap each other; a region enlarging means which receives the output signal of the comparator means and gives a signal representing a new object region determined by enlarging the overlapping region at a predetermined enlargement ratio; and a control means which functions for target tracking control operation to keep the new object region within a monitor screen on which the video signal is displayed.
Claim 37
Dependent Claim
26 words
A video camera according to claim 28, wherein the predetermined conditions require that the luminance and chrominance of the video signal are within fixed ranges, respectively.
Claim 38
Dependent Claim
34 words
A video camera according to claim 28, wherein the predetermined conditions require that the luminance and chrominance of the video signal are within ranges of luminance and chrominance corresponding to those of flesh color.
Claim 39
Dependent Claim
38 words
A video camera according to claim 28, further comprising a calculating means for calculating the features of the object region, wherein the control means carries out target tracking control operations according to the features of the object region.
Claim 40
Dependent Claim
23 words
A video camera according to claim 31, wherein the features are the size and the position of the centroid of the object region.
Claim 41
Dependent Claim
39 words
A video camera according to claim 28, further comprising an image memory for temporarily storing the image signal, wherein the control means reads the image signal from a specified area of the image memory for target tracking control operation.
Claim 42
Dependent Claim
45 words
A video camera according to claim 28, wherein the image pickup means is comprised of an image pickup device of a CCD type of a MOS type, the control means controls the image pickup device by specifying a read position for target tracking control operation.
Claim 43
Dependent Claim
44 words
A video camera according to claim 28, further comprising a mechanism for moving a range on the imaging surface on which the image is focused by the lens unit, wherein the control means controls the driving of the mechanism for target tracking control operation.
Claim 44
Dependent Claim
29 words
A video camera according to claim 35, wherein the mechanism is an electrically powered pedestal supporting the video camera and capable of changing the direction of the video camera.
Claim 45
Dependent Claim
24 words
A video camera according to claim 35, wherein the mechanism is an active prism interposed between the lens unit and the image pickup means.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-05-19 | 2000-11-18 | 2001-05-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-05-19 | 2004-11-18 | 2005-05-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-05-19 | 2008-11-18 | 2009-05-20 | $7700.00 | Window Closed / Lapsed |