Patent US7403224B2 successfully refreshed from Google Patents.
US7403224B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Embedded metadata engines in digital capture devices
Assignee: Micro Focus LLC
•
Filing: 2004-09-10
•
Granted: 2008-07-22
•
Expires: 2024-09-10
Abstract
Abstract A digital capture system, such as a digital still camera or digital video recorder, has an embedded real-time content-based analysis function in the capture device to extract metadata from the digital signals. In one embodiment, metadata (descriptive information about the digital content) is formatted and stored separately from the content. In another embodiment, the metadata may be formatted and combined with the digital content in a container format such as MPEG-7, QuickTime, or FlashPix.
Inventors
- 👤 Charles Fuller
- 👤 Mojgan Monika Gorkani
- 👤 Richard D. Humphrey
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 14:08
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/40; H04N21/41; H04N21/418; H04N21/4184; G; G06; G06F; G06F16/00; G06F16/50; G06F16/58; G06F16/583; G06F16/587; G06F16/70; G06F16/78; G06F16/783; G06F16/7844; G06F16/787; H04N1/00; H04N1/00127; H04N1/00326; H04N1/00328; H04N1/00331; H04N1/32; H04N1/32101; H04N21/422; H04N21/4223; H04N21/43; H04N21/433; H04N21/4334; H04N21/80; H04N21/83; H04N21/84; H04N5/00; H04N5/76; H04N5/765; H04N5/77; H04N5/772; H04N9/00; H04N9/79; H04N9/80; H04N9/82; H04N9/8205; H04N9/8233; H04N1/32106; H04N1/32128; H04N2101/00; H04N2201/00; H04N2201/32; H04N2201/3201; H04N2201/3212; H04N2201/3214; H04N2201/3215; H04N2201/3225; H04N2201/3226; H04N2201/3232; H04N2201/3252; H04N2201/3253
Claims Analysis
Total Claims: 47
Claim 1
Independent Claim
91 words
An integrated data and real-time metadata capture system, comprising: a digital capture device producing a digital representation of one or more forms of media content; a feature extraction engine integrated with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata in real-time from the digital content simultaneously with encoding of the content; and a storage device capable of storing the encoded media content and the metadata, wherein selected portions of the metadata are associated with selected portions of the encoded media content.
Claim 2
Dependent Claim
91 words
An integrated data and real-time metadata capture system, comprising: a digital capture device producing a digital representation of one or more forms of media content; a feature extraction engine integrated with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata in real-time from the digital content simultaneously with encoding of the content; and a storage device capable of storing the encoded media content and the metadata, wherein selected portions of the metadata are associated with selected portions of the encoded media content.
Claim 3
Dependent Claim
26 words
The system defined in claim 1 , additionally comprising at least one collateral metadata source, wherein the collateral metadata is simultaneously captured with the media content.
Claim 4
Dependent Claim
26 words
The system defined in claim 2 , wherein the collateral metadata source includes at least one of the following: user input, device properties, and external sensors.
Claim 5
Dependent Claim
36 words
The system defined in claim 2 , wherein the digital capture device comprises a digital video camera capable of marking a video clip, wherein the marking is automatically triggered by a recording process of the camera.
Claim 6
Dependent Claim
27 words
The system defined in claim 4 , wherein the collateral metadata is associated with the video clip and is stored on the storage device with the metadata.
Claim 7
Dependent Claim
22 words
The system defined in claim 5 , wherein the collateral metadata includes at least one of the following: time/date, location, or scene/take.
Claim 8
Dependent Claim
44 words
The system defined in claim 1 , additionally comprising an output interface in data communication with the storage device and generating output data, wherein the output interface is capable of preserving a temporal relationship between a sequence of the metadata and the digital content.
Claim 9
Dependent Claim
36 words
The system defined in claim 7 , wherein the digital capture device comprises a digital still camera, and the output data comprises a FlashPix image containing image feature vectors as auxiliary metadata within an image file.
Claim 10
Dependent Claim
22 words
The system defined in claim 7 , wherein the digital capture device comprises a digital video camera including an audio capture capability.
Claim 11
Dependent Claim
31 words
The system defined in claim 7 , wherein the output data comprises an MPEG-7 digital video file containing a plurality of metadata tracks as embedded metadata within an MPEG-7 metadata framework.
Claim 12
Dependent Claim
16 words
The system defined in claim 7 , wherein the output data is transmitted to a computer.
Claim 13
Dependent Claim
15 words
The system defined in claim 11 , wherein the computer executes a media processing function.
Claim 14
Dependent Claim
17 words
The system defined in claim 1 , wherein the digital capture device comprises a digital still camera.
Claim 15
Dependent Claim
16 words
The system defined in claim 13 , wherein the metadata comprises a plurality of feature vectors.
Claim 16
Dependent Claim
26 words
The system defined in claim 1 , additionally comprising a format module configured to associate a time code with the encoded media content and the metadata.
Claim 17
Dependent Claim
29 words
The system defined in claim 1 , additionally comprising a time code module configured to provide a time code for association with the encoded media content and the metadata.
Claim 18
Dependent Claim
77 words
An integrated data and real-time metadata capture method, comprising: sensing analog signals; converting the analog signals to a digital representation of one or more forms of media content; compressing the digital media content; automatically extracting metadata in real-time from the digital media content simultaneously with the compressing of the digital media content; and storing the digital media content and the metadata, wherein selected portions of the metadata are associated with selected portions of the digital media content.
Claim 19
Dependent Claim
77 words
An integrated data and real-time metadata capture method, comprising: sensing analog signals; converting the analog signals to a digital representation of one or more forms of media content; compressing the digital media content; automatically extracting metadata in real-time from the digital media content simultaneously with the compressing of the digital media content; and storing the digital media content and the metadata, wherein selected portions of the metadata are associated with selected portions of the digital media content.
Claim 20
Dependent Claim
25 words
The method defined in claim 17 , wherein automatically extracting metadata in real-time includes extracting a plurality of feature vectors from the digital media content.
Claim 21
Dependent Claim
21 words
The method defined in claim 17 , additionally comprising associating a time code with the digital media content and the metadata.
Claim 22
Dependent Claim
23 words
The method defined in claim 17 , additionally comprising generating a time code for association with the digital media content and the metadata.
Claim 23
Dependent Claim
25 words
The method defined in claim 17 , wherein the storing includes storing to a single storage device for the digital media content and the metadata.
Claim 24
Dependent Claim
105 words
An integrated data and real-time metadata capture system, comprising: a digital capture device producing a digital representation of one or more forms of media content; a frame buffer storing a frame of the digital content; a feature extraction engine integrated with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata in real-time from the digital content stored in the frame buffer simultaneously with encoding of the digital content; and a storage device capable of storing the digital content and the metadata, wherein selected portions of the metadata are associated with selected portions of the digital content.
Claim 25
Dependent Claim
105 words
An integrated data and real-time metadata capture system, comprising: a digital capture device producing a digital representation of one or more forms of media content; a frame buffer storing a frame of the digital content; a feature extraction engine integrated with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata in real-time from the digital content stored in the frame buffer simultaneously with encoding of the digital content; and a storage device capable of storing the digital content and the metadata, wherein selected portions of the metadata are associated with selected portions of the digital content.
Claim 26
Dependent Claim
26 words
The system defined in claim 22 , additionally comprising at least one collateral metadata source, wherein the collateral metadata is simultaneously captured with the media content.
Claim 27
Dependent Claim
25 words
The system defined in claim 22 , additionally comprising a format module configured to associate a time code with the digital content and the metadata.
Claim 28
Dependent Claim
28 words
The system defined in claim 22 , additionally comprising a time code module configured to provide a time code for association with the digital content and the metadata.
Claim 29
Dependent Claim
25 words
The system defined in claim 22 , wherein the feature extraction engine generates a plurality of time-based tracks of metadata that index the digital content.
Claim 30
Dependent Claim
107 words
An integrated data and real-time metadata capture system, comprising: a digital capture device producing a digital representation of one or more forms of media content; a compressor integrated with the digital capture device, the compressor configured to encode the media content; a feature extraction engine integrated with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata in real-time from the digital content simultaneously with encoding of the content; and a storage device capable of storing the encoded media content and the metadata, wherein selected portions of the metadata are associated with selected portions of the encoded media content.
Claim 31
Dependent Claim
107 words
An integrated data and real-time metadata capture system, comprising: a digital capture device producing a digital representation of one or more forms of media content; a compressor integrated with the digital capture device, the compressor configured to encode the media content; a feature extraction engine integrated with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata in real-time from the digital content simultaneously with encoding of the content; and a storage device capable of storing the encoded media content and the metadata, wherein selected portions of the metadata are associated with selected portions of the encoded media content.
Claim 32
Dependent Claim
26 words
The system defined in claim 27 , additionally comprising at least one collateral metadata source, wherein the collateral metadata is simultaneously captured with the media content.
Claim 33
Dependent Claim
26 words
The system defined in claim 28 , wherein the collateral metadata source includes at least one of the following: user input, device properties, and external sensors.
Claim 34
Dependent Claim
36 words
The system defined in claim 28 , wherein the digital capture device comprises a digital video camera capable of marking a video clip, wherein the marking is automatically triggered by a recording process of the camera.
Claim 35
Dependent Claim
27 words
The system defined in claim 30 , wherein the collateral metadata is associated with the video clip and is stored on the storage device with the metadata.
Claim 36
Dependent Claim
22 words
The system defined in claim 31 , wherein the collateral metadata includes at least one of the following: time/date, location, or scene/take.
Claim 37
Dependent Claim
44 words
The system defined in claim 27 , additionally comprising an output interface in data communication with the storage device and generating output data, wherein the output interface is capable of preserving a temporal relationship between a sequence of the metadata and the digital content.
Claim 38
Dependent Claim
17 words
The system defined in claim 27 , wherein the digital capture device comprises a digital still camera.
Claim 39
Dependent Claim
16 words
The system defined in claim 31 , wherein the metadata comprises a plurality of feature vectors.
Claim 40
Dependent Claim
26 words
The system defined in claim 27 , additionally comprising a format module configured to associate a time code with the encoded media content and the metadata.
Claim 41
Dependent Claim
29 words
The system defined in claim 27 , additionally comprising a time code module configured to provide a time code for association with the encoded media content and the metadata.
Claim 42
Dependent Claim
100 words
An integrated data and real-time metadata capture system, comprising: a digital capture device producing a digital representation of one or more forms of media content including at least video content; a feature extraction engine integrated with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata via feature identification in real-time from the video content simultaneously with encoding of the video content; and a storage device capable of storing the encoded video content and the metadata, wherein selected portions of the metadata are associated with selected portions of the encoded video content.
Claim 43
Dependent Claim
100 words
An integrated data and real-time metadata capture system, comprising: a digital capture device producing a digital representation of one or more forms of media content including at least video content; a feature extraction engine integrated with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata via feature identification in real-time from the video content simultaneously with encoding of the video content; and a storage device capable of storing the encoded video content and the metadata, wherein selected portions of the metadata are associated with selected portions of the encoded video content.
Claim 44
Dependent Claim
13 words
The system of claim 38 , wherein the feature identification includes speaker identification.
Claim 45
Dependent Claim
13 words
The system of claim 38 , wherein the feature identification includes face identification.
Claim 46
Dependent Claim
15 words
The system of claim 38 , wherein the feature identification includes optical character recognition (OCR).
Claim 47
Dependent Claim
13 words
The system of claim 38 , wherein the video content includes audio content.
References Cited (Backward Citations)
US4115805A
Cited
US4334241A
Cited
US4574319A
Cited
US5027400A
Cited
US5045940A
Cited
US5136655A
Cited
US5335072A
Cited
US5307456A
Cited
WO1992022983A2
Cited
EP0545727A2
Cited
US5467288A
Cited
US5946445A
Cited
US5566290A
Cited
US5506644A
Cited
US5692104A
Cited
US5657077A
Cited
US5745637A
Cited
US5680639A
Cited
US5561457A
Cited
US5481296A
Cited
US5649060A
Cited
US5796428A
Cited
US5889578A
Cited
US5485553A
Cited
US5664218A
Cited
US5701153A
Cited
US5508940A
Cited
US5521841A
Cited
US5606655A
Cited
US5677994A
Cited
US5682458A
Cited
US5613032A
Cited
US5664227A
Cited
WO1996012239A1
Cited
US5835667A
Cited
US5926205A
Cited
US5574845A
Cited
US5706290A
Cited
US5826102A
Cited
US5818512A
Cited
US5557320A
Cited
US5642285A
Cited
US5872865A
Cited
US5815201A
Cited
US5982979A
Cited
US5777612A
Cited
US5930446A
Cited
US5706457A
Cited
US6009507A
Cited
US5898441A
Cited
US6505160B1
Cited
US5809512A
Cited
US5751280A
Cited
US5963702A
Cited
US20030122941A1
Cited
US5633678A
Cited
US5794249A
Cited
US5884056A
Cited
WO1997026758A1
Cited
US5822024A
Cited
US6061056A
Cited
US5893095A
Cited
US5918012A
Cited
US6034942A
Cited
US5852435A
Cited
US20020191087A1
Cited
US5870754A
Cited
US5740388A
Cited
US5903892A
Cited
US6370543B2
Cited
US5977964A
Cited
US5903261A
Cited
US5953005A
Cited
US5813014A
Cited
US5969716A
Cited
US5890175A
Cited
US5828809A
Cited
US6094671A
Cited
US5872565A
Cited
US6205260B1
Cited
US6259828B1
Cited
US6115717A
Cited
US6006241A
Cited
US6211869B1
Cited
US5920856A
Cited
US5987454A
Cited
US6285788B1
Cited
US6356658B1
Cited
US6317885B1
Cited
US6169573B1
Cited
US6167404A
Cited
US6014183A
Cited
US6360234B2
Cited
US6877134B1
Cited
US20010018693A1
Cited
US6567980B1
Cited
US6463444B1
Cited
US6606117B1
Cited
US5990955A
Cited
US6526215B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2011-07-22 | 2012-01-21 | 2012-07-22 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2015-07-22 | 2016-01-21 | 2016-07-22 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2019-07-22 | 2020-01-21 | 2020-07-22 | $7700.00 | Window Closed / Lapsed |