US5867386A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Morphological pattern recognition based controller system
Assignee: STEVEN M HOFFBERG 2004-1 GRAT
•
Filing: 1995-06-06
•
Granted: 1999-02-02
•
Expires: 2015-06-06
Abstract
Abstract The need for a more-readily usable interface for programmable devices is widely recognized. The present invention relates to programmable sequencing devices, or, more particularly, the remote controls for consumer electronic devices. The present invention provides an enhanced interface for facilitating human input of a desired control sequence in a programmable device by employing specialized visual feedback. The present invention also relates to a new interface and method of interfacing with a programmable device, which is usable as an interface for a programmable video cassette recorder.
Inventors
- 👤 Steven M. Hoffberg
- 👤 Linda I. Hoffberg-Borghesani
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-26 12:14
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/103; G06F; G06F3/00; G06F3/01; G06F3/048; G06F3/0481; G06F3/0482; G06F9/00; G06F9/06; G06F9/44; G06F9/451; G06F9/453; G06Q; G06Q30/00; G06Q30/02; G06Q30/0241; G06Q30/0251; G06Q30/0261; G16; G16H; G16H40/00; G16H40/60; G16H40/63; G16H40/67; H; H04; H04N; H04N21/00; H04N21/20; H04N21/25; H04N21/251; H04N21/252; H04N21/40; H04N21/41; H04N21/422; H04N21/42201; H04N21/43; H04N21/442; H04N21/44213; H04N21/44222; H04N21/45; H04N21/4508; H04N21/4532; H04N21/454; H04N21/466; H04N21/47; H04N21/482; H04N7/00; H04N7/16; H04N7/162; H04N7/163; G06N; G06N20/00; G06N99/00; H04L; H04L67/00; H04L67/2866; H04L67/30; H04L67/306
Claims Analysis
Total Claims: 32
Claim 1
Independent Claim
199 words
A method for identifying image data comprising the steps of: processing the image data to identify an image of an object represented therein; creating, from the processed object image data, a plurality of accessible mapped ranges corresponding to different subsets of the processed object image data; assigning at least one identifier to corresponding ones of the mapped ranges, each of the identifiers specifying for the corresponding mapped range a procedure and a corresponding subset of the processed object image data; executing, for a plurality of the mapped ranges, a corresponding procedure upon a subset of the processed object image data which corresponds to the mapped ranges; selecting at least one of the mapped ranges corresponding to a portion of the processed obiect image data; representing the processed object image data as a set of the identifiers of the selected mapped ranges; providing data relating to a plurality of templates, said template data being processed analogously to the processed object image data and being represented as a set of identifiers of selected mapped ranges and corresponding procedures; and matching the represented set of identifiers with it least one of said plurality of templates based on a processed object image-to-template correspondence.
Claim 2
Independent Claim
199 words
A method for identifying image data comprising the steps of: processing the image data to identify an image of an object represented therein; creating, from the processed object image data, a plurality of accessible mapped ranges corresponding to different subsets of the processed object image data; assigning at least one identifier to corresponding ones of the mapped ranges, each of the identifiers specifying for the corresponding mapped range a procedure and a corresponding subset of the processed object image data; executing, for a plurality of the mapped ranges, a corresponding procedure upon a subset of the processed object image data which corresponds to the mapped ranges; selecting at least one of the mapped ranges corresponding to a portion of the processed obiect image data; representing the processed object image data as a set of the identifiers of the selected mapped ranges; providing data relating to a plurality of templates, said template data being processed analogously to the processed object image data and being represented as a set of identifiers of selected mapped ranges and corresponding procedures; and matching the represented set of identifiers with it least one of said plurality of templates based on a processed object image-to-template correspondence.
Claim 3
Dependent Claim
110 words
The method according to claim 1, further comprising the steps of: generating a plurality of addressable domains from the image data, each of the domains representing a portion of the image information; subjecting a domain to one or more transforms selected from the group consisting of a null transformation, a predetermined rotation, an inversion, a predetermined scaling, and a predetermined frequency domain preprocessing; said selecting step comprising selecting, for each of the transformed domains, at least one of the mapped ranges which most closely corresponds according to predetermined criteria; and said matching step comprising selecting a template which most closely corresponds to the set of identifiers representing the image information.
Claim 4
Dependent Claim
81 words
The method according to claim 2 wherein the step of selecting the most closely corresponding one of the mapped ranges comprises the step of selecting, for each domain, the mapped range which is the most similar, by a method selected from at least one of the group consisting of selecting a minimum Hausdorff distance from the domain, selecting the highest cross-correlation with the domain and selecting the lowest mean square error of the difference between the mapped range and the domain.
Claim 5
Dependent Claim
84 words
The method according to claim 3 wherein the step of selecting the most closely corresponding one of mapped ranges includes the step of selecting, for each domain, the mapped range with the minimum modified Hausdorff distance calculated as D db,mrb!+D 1-db,1-mrb!, where D is a distance calculated between a pair of sets of data each representative of an image, db is a domain, mrb is a mapped range, 1-db is the inverse of a domain, and 1-mrb is an inverse of a mapped range.
Claim 6
Dependent Claim
191 words
The method according to claim 2, wherein the digital image data consists of a plurality of pixels each having one of a plurality of associated color map values, further comprising the steps of: optionally transforming the color map values of the pixels of each domain by a function including at least one scaling function for each axis of the color map, each of which may be the same or different, and selected to maximize the correspondence between the domains and ranges to which they are to be matched; selecting, for each of the domains, the one of the mapped ranges having color map pixel values which most closely correspond to the color map pixel values of the domain according to a predetermined criteria, wherein the step of representing the image color map information includes the substep of representing the image color map information as a set of values each including an identifier of the selected mapped range and the scaling functions; and selecting a most closely corresponding stored template, based on the identifier of the color map mapped range, the scaling functions and the set of identifiers representing the image information.
Claim 7
Dependent Claim
353 words
The method according to claim 2, further comprising the steps of: storing delayed image data, which represents an image of a moving object differing in time from the image data in the data processor; generating a plurality of addressable further domains from the stored delayed image data, each of the further domains representing a portion of the delayed image information, and corresponding to a domain; creating, from the stored delayed image data, a plurality of addressable mapped ranges corresponding to different subsets of the stored delayed image data; matching the further domain and the domain by subjecting a further domain to one or both of a corresponding transform selected from the group consisting of a null transform, a predetermined rotation, an inversion, a predetermined scaling, and a predetermined frequency domain preprocessing, which corresponds to a transform applied to a corresponding domain, and a noncorresponding transform selected from the group consisting of a predetermined rotation, an inversion, a predetermined scaling, a translation and a predetermined frequency domain preprocessing, which does not correspond to a transform applied to a corresponding domain; computing a motion vector between one of the domain and the further domain, or the set of identifiers representing the image information and the set of identifiers representing the delayed image information, and storing the motion vector; compensating the further domain with the motion vector and computing a difference between the compensated further domain and the domain; selecting, for each of the delayed domains, the one of the mapped ranges which most closely corresponds according to predetermined criteria; representing the(difference between the compensated further domain and the domain as a set of difference identifiers of a set of selected mapping ranges and an associated motion vector and representing the further domain as a set of identifiers of the selected mapping ranges; determining a complexity of the difference based on a density of representation; and when the difference has a complexity below a predetermined threshold, selecting, from the stored templates, a template which most closely corresponds to the set of identifiers of the image data and the set of identifiers of the delayed image data.
Claim 8
Dependent Claim
72 words
The method according to claim 1, wherein said representing step further comprises the steps of determining a feature of interest of the image data, selecting a mapped range corresponding to the feature of interest, storing the identifiers of the selected mapped range, selecting a further mapped range corresponding to a portion of image data having a predetermined relationship to the feature of interest and storing the identifiers of the further mapped range.
Claim 9
Dependent Claim
78 words
The method according to claim 1, wherein said image data comprises data having three associated dimensions obtained by a method selected from the group consisting of synthesizing a three dimensional representation based on a machine based prediction derived from two dimensional image data, synthesizing a three dimensional representation derived from a time series of pixel images, and synthesizing a three dimensional representation based on a image data representing a plurality of parallax views having at least two dimensions.
Claim 10
Independent Claim
127 words
A method for identifying an image content, based on information relating to a plurality of image feature types, comprising the steps of: receiving a representation of an image including a representation of least one object; processing the representation of the image to reduce a data storage requirement, as compared to the receiving representation of the image, and to describe morphological feature attributes of a significant object represented in the image, the morphological feature attributes comprising at least one non-planar coordinate system object descriptor; comparing the attributes of the object, including the nonplanar coordinate system descriptor, with information relating to a plurality of image feature types; and identifying a relation between the representation of the image and at least one of the database records based on said comparison.
Claim 11
Independent Claim
127 words
A method for identifying an image content, based on information relating to a plurality of image feature types, comprising the steps of: receiving a representation of an image including a representation of least one object; processing the representation of the image to reduce a data storage requirement, as compared to the receiving representation of the image, and to describe morphological feature attributes of a significant object represented in the image, the morphological feature attributes comprising at least one non-planar coordinate system object descriptor; comparing the attributes of the object, including the nonplanar coordinate system descriptor, with information relating to a plurality of image feature types; and identifying a relation between the representation of the image and at least one of the database records based on said comparison.
Claim 12
Dependent Claim
21 words
The method according to claim 9, wherein said processing step comprises modeling the extracted object in at least three independent dimensions.
Claim 13
Dependent Claim
35 words
The method according to claim 9, wherein said data relating to the plurality of image feature types comprise models each having at least three dimensions, said comparing step comprising projecting said exemplar into two dimensions.
Claim 14
Dependent Claim
72 words
The method according to claim 9, further comprising the steps of: inputting a search criteria relating to image morphology; comparing the attributes of the object to the search criteria; and selectively processing the representation of the image based on said comparison of the attributes of the object with the stored data relating to a plurality of image feature types and said comparison of the attributes of the object to the search criteria.
Claim 15
Dependent Claim
55 words
The method according to claim 12, further comprising the steps of: receiving a user input; predicting a most probable user intent based on said input; presenting to the user with a predicted instruction based on said predicted most probable user intent; and receiving feedback from the user to determine an agreement with said predicted instruction.
Claim 16
Dependent Claim
12 words
The method according to claim 13, wherein said predicting step is adaptive.
Claim 17
Dependent Claim
16 words
The method according to claim 12, wherein said search criteria is input as an image pattern.
Claim 18
Dependent Claim
19 words
The method according to claim 12, wherein said search criteria is an identifier of an object or an image.
Claim 19
Dependent Claim
31 words
The method according to claim 9, wherein said processing step further comprises deriving a mathematical expression relating to a self-similarity of at least a portion of the image of the object.
Claim 20
Dependent Claim
18 words
The method according to claim 9, further comprising the step of selectively storing a temporal sequence of images.
Claim 21
Dependent Claim
24 words
The method according to claim 9, further comprising the step of selectively processing a scene including the image from a stored sequence if images.
Claim 22
Dependent Claim
44 words
The method according to claim 9, wherein the representation of the image comprises a video signal, the morphological feature comprising a three-dimensional shape, further comprising the step of outputting the identified relation, and selectively processing the video signal based on the outputted identified relation.
Claim 23
Dependent Claim
17 words
The method according to claim 9, wherein the plurality of image feature types comprise human anatomical characteristics.
Claim 24
Dependent Claim
31 words
The method according to claim 9, wherein said processing the representation of the image to reduce a data storage requirement step comprises representing mathematical relationships of self-similar portions of the image.
Claim 25
Independent Claim
133 words
An apparatus for identifying a relation of an image with information relating to a plurality of image feature types, comprising: an input, receiving a representation of an image including a representation of least one object; means for processing the representation of the image to reduce a data storage requirement, as compared to the receiving representation of the image, and to describe morphological feature attributes of a significant object represented in the image, the morphological feature attributes comprising at least one non-planar coordinate system object descriptor; means for comparing attributes of the object, including the non-planar coordinate system descriptor, with information relating to a plurality of image feature types; and means for identifying a relation between the representation of the image and at least one of the image feature types based on said comparison.
Claim 26
Independent Claim
133 words
An apparatus for identifying a relation of an image with information relating to a plurality of image feature types, comprising: an input, receiving a representation of an image including a representation of least one object; means for processing the representation of the image to reduce a data storage requirement, as compared to the receiving representation of the image, and to describe morphological feature attributes of a significant object represented in the image, the morphological feature attributes comprising at least one non-planar coordinate system object descriptor; means for comparing attributes of the object, including the non-planar coordinate system descriptor, with information relating to a plurality of image feature types; and means for identifying a relation between the representation of the image and at least one of the image feature types based on said comparison.
Claim 27
Dependent Claim
25 words
The apparatus according to claim 23, wherein said means for processing comprises means for determining motion planes from a sequence of representations of the image.
Claim 28
Dependent Claim
31 words
The apparatus according to claim 23, wherein said received representation of an image comprises a video signal, further comprising means for selectively recording the video signal based on said identified relation.
Claim 29
Dependent Claim
17 words
The apparatus according to claim 23, wherein the plurality of image feature types comprise human anatomical characteristics.
Claim 30
Dependent Claim
31 words
The apparatus according to claim 23, wherein said means for processing the representation of the image to reduce a data storage requirement determines mathematical relationships of self-similar portions of the image.
Claim 31
Dependent Claim
41 words
The apparatus according to claim 23, further comprising an input for receiving a selected image feature type, and means for selectively processing the image based on the identified relation between the representation of the image and the input image feature type.
Claim 32
Dependent Claim
42 words
The apparatus according to claim 23, wherein the representation of the image is a motion-vector compressed digital video image stream, said means for processing modeling said significant object as a three dimensional construct, based on said motion-vector compressed digital video image stream.
References Cited (Backward Citations)
US4208652A
Cited
US4908713A
Cited
US4963994A
Cited
US5508815A
Cited
US4697209A
Cited
US5067161A
Cited
US5046113A
Cited
US5031228A
Cited
US5067166A
Cited
US5347600A
Cited
US5065447A
Cited
US5214504A
Cited
US5255386A
Cited
US5128525A
Cited
US5103498A
Cited
US5280530A
Cited
US5192999A
Cited
US5283819A
Cited
US5396546A
Cited
US5583966A
Cited
US5384867A
Cited
US5430812A
Cited
US5412773A
Cited
US5436653A
Cited
US5572246A
Cited
US5477447A
Cited
US5390281A
Cited
US5544358A
Cited
US5586317A
Cited
US5500920A
Cited
US5560011A
Cited
US5584050A
Cited
US5450490A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-02-01 | 2002-08-03 | 2003-02-02 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-02-01 | 2006-08-03 | 2007-02-02 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-02-01 | 2010-08-03 | 2011-02-02 | $7700.00 | Window Closed / Lapsed |