Patent US5987154A successfully refreshed from Google Patents.
US5987154A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and means for detecting people in image sequences
Assignee: Nokia of America Corp
•
Filing: 1996-11-22
•
Granted: 1999-11-16
•
Expires: 2016-11-22
Abstract
Abstract The head in a series of video images is identified by digitizing sequential images, subtracting a previous image from an input image to determine moving objects, calculating boundary curvature extremes of regions in the subtracted image, comparing the extremes with a stored model of a human head to find regions shaped like a human head, and identifying the head with a surrounding shape.
Inventors
- 👤 David C. Gibbon
- 👤 Jakub Segen
- 👤 Behzad Shahraray
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 20:06
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/14; H04N7/15; G; G06; G06V; G06V40/00; G06V40/10; G06T; G06T7/00; G06T7/20; G06T7/246; G06T7/251; G06T7/254; G06V40/103; G06V40/16; G06V40/161; G06V40/167; H04N7/18; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/30; G06T2207/30196; G06T2207/30201; H04N19/00; H04N19/20
Claims Analysis
Total Claims: 52
Claim 1
Independent Claim
132 words
A method of locating a person in a video picture, comprising the steps of: forming a differential image from time displaced video images to extract differential figures from the video images; comparing local boundary curvature extremes of outlines of the differential figures with outlines of a stored model of at least a part of a human body which includes a head and a portion of the body immediately below the head; and in response to the comparing step identifying a region in the video picture from the step of comparing the local boundary curvature extremes of outlines of the differential figures with outlines of the stored model of the head and the portion of the body immediately below the head; the portion of the body immediately below the head being a neck.
Claim 2
Independent Claim
132 words
A method of locating a person in a video picture, comprising the steps of: forming a differential image from time displaced video images to extract differential figures from the video images; comparing local boundary curvature extremes of outlines of the differential figures with outlines of a stored model of at least a part of a human body which includes a head and a portion of the body immediately below the head; and in response to the comparing step identifying a region in the video picture from the step of comparing the local boundary curvature extremes of outlines of the differential figures with outlines of the stored model of the head and the portion of the body immediately below the head; the portion of the body immediately below the head being a neck.
Claim 3
Dependent Claim
28 words
A method as in claim 1, wherein the step of forming the differential image includes digitizing the video images and subtracting one image from another time displaced image.
Claim 4
Dependent Claim
33 words
A method as in claim 1, wherein the forming step includes digitizing the video images to form two dimensional arrays of digital image data and subtracting one image from another time displaced image.
Claim 5
Dependent Claim
31 words
A method as in claim 3, wherein the forming step includes forming a threshold and taking absolute values of the digital image data and comparing the absolute values with a threshold.
Claim 6
Dependent Claim
39 words
A method as in claim 1, wherein the step of comparing the local boundary curvature extremes includes calculating outlines of the local boundary curvature extremes before comparing the outlines of the curvature extremes with outlines of the stored model.
Claim 7
Independent Claim
138 words
An apparatus for locating a person in a video picture, comprising: a video device containing video images of a scene; a processor responsive to said video device for forming a differential image from a time displaced video images to extract differential figures; comparing local boundary curvature extremes of outlines of the differential figures with outlines of a stored model of at least a part of a human body which includes a head and a portion of the body immediately below said head; and identifying a region in the video picture in response to the comparing of the local boundary curvature extremes of outlines of the differential figures with outlines of the stored model of the head and the portion of the body immediately below the head; the portion of the body immediately below the head being a neck.
Claim 8
Independent Claim
138 words
An apparatus for locating a person in a video picture, comprising: a video device containing video images of a scene; a processor responsive to said video device for forming a differential image from a time displaced video images to extract differential figures; comparing local boundary curvature extremes of outlines of the differential figures with outlines of a stored model of at least a part of a human body which includes a head and a portion of the body immediately below said head; and identifying a region in the video picture in response to the comparing of the local boundary curvature extremes of outlines of the differential figures with outlines of the stored model of the head and the portion of the body immediately below the head; the portion of the body immediately below the head being a neck.
Claim 9
Dependent Claim
38 words
A method as in claim 1, wherein the step of identifying includes the step of fitting a surrounding band to the portion of the region of the outlines of the differential figures corresponding to outlines of the head.
Claim 10
Dependent Claim
13 words
A method as in claim 7, wherein the surrounding band is an annulus.
Claim 11
Dependent Claim
48 words
A method as in claim 1, further comprising the step of responding to the identifying step and sensing data from a subregion of one of the video images corresponding to the outlines of a pattern of a head for display of at least a portion of the subregion.
Claim 12
Dependent Claim
27 words
A method as in claim 9, wherein the display of at least a portion of the subregion includes display of outlines of a pattern of a head.
Claim 13
Dependent Claim
31 words
A method as in claim 9, further comprising the step of responding to the step of selecting includes the step of transmitting data of outlines of the head within said subregion.
Claim 14
Dependent Claim
59 words
A method as in claim 1, further comprising responding to the identifying step and then performing the step of sensing data from a subregion of one of the video images corresponding to a pattern of a head to transmit outlines of a pattern of a head and achieve the effect of a camera being manually pointed at the head.
Claim 15
Dependent Claim
34 words
A method as in claim 12, wherein the sensing of the region includes controlling a mechanical system for pointing a camera to keep the pattern of the head within one of the video images.
Claim 16
Dependent Claim
22 words
A method as in claim 9, wherein the step of sensing includes allocating a greater portion of transmission bandwidth to same subregion.
Claim 17
Dependent Claim
49 words
A method as in claim 9, wherein the step of sensing includes the step of selecting one of several cameras in a system on a basis of the sensing so as to display the camera with the subregion with the pattern of said head in its field of view.
Claim 18
Dependent Claim
28 words
A method as in claim 9, wherein the step of sensing a subregion includes the step of forming a computer input to permit rendering a three dimensional representation.
Claim 19
Dependent Claim
38 words
A method as in claim 9, wherein the step of sensing includes the step of limiting an area of the sensing to the subregion to permit increase of speed and efficiency of recognizing a face on said head.
Claim 20
Dependent Claim
24 words
A method as in claim 9, wherein the step of sensing includes storing statistical data about motion and presence of heads in a scene.
Claim 21
Dependent Claim
19 words
A method as in claim 1, wherein the step of identifying includes centering the head in a video image.
Claim 22
Dependent Claim
33 words
A method as in claim 1, wherein the step of identifying includes the step of placing a pattern of a head at a predetermined position in at least one of the video images.
Claim 23
Dependent Claim
25 words
A method as in claim 1, wherein the step of forming a differential image from video images includes the step of subtracting immediately successive images.
Claim 24
Dependent Claim
34 words
A method as in claim 1, wherein the step of forming includes the step of subtracting images separated from each other by a time τ and varying the time τ to adjust the figures.
Claim 25
Dependent Claim
16 words
A as in claim 22, wherein the step of varying the time τ is done manually.
Claim 26
Independent Claim
155 words
An apparatus for locating a person in a video picture, comprising: a video device containing video images of a scene; a processor responsive to said video device for forming a differential image from a time displaced video images to extract differential figures; comparing local boundary curvature extremes of outlines of the differential figures with outlines of a stored model of at least a part of a human body which includes a head and a portion of the body immediately below said head; and identifying a region in the video picture in response to the comparing of the local boundary curvature extremes of outlines of the differential figures with outlines of the stored model of the head and the portion of the body immediately below the head; wherein said processor fits a surrounding shape to the portion of the region boundary corresponding to the head in the video images and the surrounding shape is an annulus.
Claim 27
Independent Claim
155 words
An apparatus for locating a person in a video picture, comprising: a video device containing video images of a scene; a processor responsive to said video device for forming a differential image from a time displaced video images to extract differential figures; comparing local boundary curvature extremes of outlines of the differential figures with outlines of a stored model of at least a part of a human body which includes a head and a portion of the body immediately below said head; and identifying a region in the video picture in response to the comparing of the local boundary curvature extremes of outlines of the differential figures with outlines of the stored model of the head and the portion of the body immediately below the head; wherein said processor fits a surrounding shape to the portion of the region boundary corresponding to the head in the video images and the surrounding shape is an annulus.
Claim 28
Dependent Claim
24 words
An apparatus as in claim 24, wherein the processor digitizes the video images and subtracts a video image from a time displaced video image.
Claim 29
Dependent Claim
33 words
An apparatus as in claim 24, wherein the processor digitizes the images to form two dimensional arrays of digital data and subtracts one of said video images from a time displaced video image.
Claim 30
Dependent Claim
29 words
An apparatus as in claim 26, wherein the processor forms a threshold and takes absolute values of the digital image data and compares the absolute values with a threshold.
Claim 31
Dependent Claim
33 words
An apparatus as in claim 24, wherein said processor calculates outlines of the local boundary curvature extremes before comparing the outlines of the local boundary curvature extremes with outlines of the stored model.
Claim 32
Dependent Claim
50 words
An apparatus as in claim 24, wherein said processor determines in the model normals to the outlines of the head and the portion of the body immediately below the head to identify the regions of a neck; and compares the outlines in the model with outlines in the differential figures.
Claim 33
Dependent Claim
29 words
An apparatus as in claim 24, wherein said device is a video display responsive to said processor for electronically placing the region in a desired position of an image.
Claim 34
Dependent Claim
18 words
An apparatus as in claim 24, wherein the portion of the body below the head is a neck.
Claim 35
Dependent Claim
52 words
An apparatus as in claim 24, wherein said device is a video display, said processor detects data from a subregion of a differential image corresponding a pattern of the human head and a portion of a body immediately below the head and transmits the data from the subregion to said video display.
Claim 36
Dependent Claim
13 words
An apparatus as in claim 32, wherein the video display displays said head.
Claim 37
Dependent Claim
19 words
An apparatus as in claim 32, further comprising a recorder for recording data of the head in said subregion.
Claim 38
Dependent Claim
56 words
An apparatus as in claim 24, said processor senses data from a subregion of one of said video images corresponding to a pattern of a human head and the portion of a body immediately below the head to transmit a human head and electronically produces the effect of a camera being manually pointed at the head.
Claim 39
Dependent Claim
38 words
An apparatus as in claim 35, wherein the device is a video camera responsive to said processor, and the processor in sensing the region points the camera to keep the head within the one of the video images.
Claim 40
Dependent Claim
25 words
An apparatus as in claim 32, said processor allocates a greater portion of transmission bandwidth to the subregion that contains the pattern of the head.
Claim 41
Dependent Claim
47 words
An apparatus as in claim 32, wherein the device includes a plurality of cameras and said processor when sensing selects one of said cameras on a basis of the sensing so as to use the camera with the pattern of the head in its field of view.
Claim 42
Dependent Claim
20 words
An apparatus as in claim 32, wherein the processor forms a computer input to permit rendering a three dimensional representation.
Claim 43
Dependent Claim
33 words
An apparatus as in claim 32, wherein the processor limits areas of the sensing to the subregion to permit increase of speed and efficiency of recognizing faces on the pattern of said head.
Claim 44
Dependent Claim
23 words
An apparatus as in claim 32, wherein the processor stores statistical data about motion and presence of patterns of heads in a scene.
Claim 45
Dependent Claim
19 words
An apparatus as in claim 24, wherein the processor centers the pattern of a head in a video picture.
Claim 46
Dependent Claim
28 words
An apparatus as in claim 24, wherein the processor places an image of the pattern of the head at a predetermined position in one of the video pictures.
Claim 47
Dependent Claim
19 words
An apparatus as in claim 24, wherein the processor subtracts immediately successive ones of said time displaced video images.
Claim 48
Dependent Claim
30 words
An apparatus as in claim 24, wherein the processor subtracts time displaced images separated from each other by a time τ and varies the time τ to adjust the figures.
Claim 49
Dependent Claim
18 words
An Apparatus as in claim 45, wherein said processor varies the time τ in response to manual operation.
Claim 50
Dependent Claim
31 words
A method as in claim 1, further comprising controlling a camera on the basis of said identifying step so as to place the head within a desired part of the image.
Claim 51
Dependent Claim
32 words
A method as in claim 1, further comprising electronically controlling a display on a basis of said identifying step so as to place the head within a desired part of the display.
Claim 52
Dependent Claim
27 words
An apparatus as in claim 24, wherein said device is a camera responsive to said processor for placing the region in a desired position in an image.
References Cited (Backward Citations)
US4581760A
Cited
US5086480A
Cited
US4975969A
Cited
EP0330455A2
Cited
US5012522A
Cited
US5245329A
Cited
US5187574A
Cited
US5258836A
Cited
US5283644A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-11-15 | 2003-05-17 | 2003-11-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-11-15 | 2007-05-17 | 2007-11-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-11-15 | 2011-05-17 | 2011-11-16 | $7700.00 | Window Closed / Lapsed |