Patent US6408028B1 successfully refreshed from Google Patents.
Patent EP0982947A2 successfully refreshed from Google Patents.
← Back to Patent Explorer
EP0982947A2 Expired / Lapsed EP ⏱️ 0.0 years remaining

Audio video encoding system with enhanced functionality

Assignee: Sharp Corp
•
Filing: 1999-08-23
•
Granted: —
•
Expires: 2019-08-23
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A system includes additional information (18) together with a video stream, where the additional information (18) is related to at least one of the frames (16). Preferably the additional information (18) is related to an object (17a, 17b) within the frame (16). A receiver (82) receives the video and additional information (18) and decodes the video in the same manner independently of whether the additional information (18) is provided. The additional information (18) is selectively presented to a viewer (238) at approximately the time of receiving the frames (16). The system may also present information to a viewer (238) from a unitary file (232,332) containing an image and additional information (18) associated with the image. A selection mechanism permits the selection of objects (17a, 17b) in the image for which the additional information (18) is related thereto. A presentation mechanism provides the additional information (18) to a viewer (238) in response to selecting the object (17a, 17b).

Inventors

  • 👤 George Borden
  • 👤 Richard Junqiang Qian
  • 👤 Muhammed Ibrahim Sezan

Bibliographic Details

Application Number —
Jurisdiction EP
Data Source google_patents
Last Synchronized 2026-11-09 11:09
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/80; H04N21/85; H04N21/858; H04N21/8586; H04N21/20; H04N21/23; H04N21/234; H04N21/23412; H04N21/2343; H04N21/234318; H04N21/235; H04N21/40; H04N21/43; H04N21/431; H04N21/4312; H04N21/4316; H04N21/435; H04N21/44; H04N21/44012; H04N21/47; H04N21/472; H04N21/47205; H04N21/4722; H04N21/4725; H04N21/854; H04N21/8545; H04N21/8583

Claims Analysis

Total Claims: 61
Claim 1
Independent Claim 87 words
A method of associating additional information (18) with a video including a plurality of frames (16) comprising: (a) identifying at least one of said frames (16); (b) providing a descriptive stream (12) separate from said video; (c) including said additional information (18) in said descriptive stream (12) related to said at least one of said frames (16); (d) providing said video for displaying on a display (84); and (e) selectively providing said additional information (18) to a viewer (238) approximately the time of said providing said video.
Claim 2
Dependent Claim 46 words
The method of claim 1 characterized in that said additional information (18) includes at least one of an object index (30), a textual description (32), a voice annotation (34), an image feature (36), an object link (38), a URL link (40), and a Java applet (42).
Claim 3
Dependent Claim 19 words
The method of claim 1 characterized in that said identifying is an object (17a, 17b) within said frame (16).
Claim 4
Dependent Claim 19 words
The method of claim 1 where said descriptive stream (12) is related to a plurality of said frames (16).
Claim 5
Dependent Claim 23 words
The method of claim 4 characterized in that said at least one of said frames (16) are in sequential order in said video.
Claim 6
Dependent Claim 23 words
The method of claim 4 characterized in that said at least one of said frames (16) are in nonsequential order in said video.
Claim 7
Dependent Claim 19 words
A method of claim 3 characterized in that said additional information (18) is related to said object (17a, 17b).
Claim 8
Dependent Claim 23 words
The method of claim 1 characterized in that said descriptive stream (12) includes an index synchronizing said video with said descriptive stream (12).
Claim 9
Dependent Claim 15 words
The method of claim 1 characterized in that said descriptive stream (12) includes copyright information.
Claim 10
Dependent Claim 18 words
The method of claim 1 characterized in that said descriptive stream (12) is encoded separately from said video.
Claim 11
Dependent Claim 25 words
The method of claim 10 characterized in that said video is decoded in the same manner independently of whether said descriptive stream (12) is provided.
Claim 12
Dependent Claim 20 words
The method of claim 11 characterized in that said video is at least one of MPEG-2 and television broadcast format.
Claim 13
Dependent Claim 22 words
The method of claim 1 characterized in that said additional information (18) is presented to said viewer (238) on a remote control.
Claim 14
Dependent Claim 19 words
The method of claim 1 characterized in that an audible signal indicates the availability of said additional information (18).
Claim 15
Dependent Claim 19 words
The method of claim 1 characterized in that a visual signal indicates the availability of said additional information (18).
Claim 16
Dependent Claim 22 words
The method of claim 7 characterized in that said additional information (18) includes textual based information related to said object (17a, 17b).
Claim 17
Dependent Claim 22 words
The method of claim 7 characterized in that said additional information (18) includes textual based information related to said object (17a, 17b).
Claim 18
Dependent Claim 35 words
The method of claim 7 characterized in that said additional information (18) includes image features (36) comprising at least one of texture, shape, dominant color, and a motion model related to said object (17a, 17b).
Claim 19
Dependent Claim 29 words
The method of claim 7 characterized in that said additional information (18) includes links to at least one of other objects (17a, 17b) and frames (16) within said video.
Claim 20
Dependent Claim 21 words
The method of claim 7 characterized in that said additional information (18) includes program instructions related to said object (17a, 17b).
Claim 21
Dependent Claim 112 words
A video system comprising: (a) an encoder (74) that includes additional information (18) within a video stream including a video including a plurality of frames (16), where said additional information (18) is related to at least one of said frames (16); (b) a receiver (82) that receives said video and said additional information (18), and said receiver (82) decodes said video in the same manner independently of whether said additional information (18) is provided; (c) a display (84) for displaying said video; and (d) a trigger mechanism (86) for selectively presenting said additional information (18) to a viewer (238) at approximately the time of presenting said frames (16) to said viewer (238).
Claim 22
Dependent Claim 36 words
The system of claim 21, further comprising: (a) a transmitter (80) for transmitting said video signal and said additional information (18); and (b) a receiver (82) for receiving said video signal and said additional information (18).
Claim 23
Dependent Claim 22 words
The system of claim 22 characterized in that said encoder (74) is at least one of a video camera and a computer.
Claim 24
Dependent Claim 19 words
The system of claim 21 characterized in that said trigger mechanism (86) is located in a remote control device.
Claim 25
Dependent Claim 19 words
The system of claim 21 characterized in that said additional information (18) is provided by a remote control device.
Claim 26
Dependent Claim 41 words
The method of claim 21 characterized in that said additional information (18) is related to an object (17a, 17b) within said frame (16) and includes links to at least one of other objects (17a, 17b) and frames (16) within said video.
Claim 27
Dependent Claim 33 words
The method of claim 21 characterized in that said additional information (18) is related to an object (17a, 17b) within said frame (16) and includes program instructions related to said object (17a, 17b).
Claim 28
Dependent Claim 34 words
The method of claim 21 characterized in that said additional information (18) is related to an object (17a, 17b) within said frame (16) and includes textual based information related to said object (17a, 17b).
Claim 29
Dependent Claim 33 words
The method of claim 21 characterized in that said additional information (18) is related to an object (17a, 17b) within said frame (16) and includes audible information related to said object (17a, 17b).
Claim 30
Dependent Claim 47 words
The method of claim 21 characterized in that said additional information (18) is related to an object (17a, 17b) within said frame (16) and includes image features (36) comprising at least one of texture, shape, dominant color, and a motion model related to said object (17a, 17b).
Claim 31
Independent Claim 70 words
A system for presenting information comprising: (a) a unitary file (232, 332) containing an image and additional information (18) associated with said image; (b) a selection mechanism that permits the selection of objects (17a, 17b) in said image for which said additional information (18) is related thereto; and (c) a presentation mechanism that provides said additional information (18) to a viewer (238) in response to selecting said object (17a, 17b).
Claim 32
Dependent Claim 21 words
The system of claim 31 characterized in that said file (232, 332) includes said image followed by said additional information (18).
Claim 33
Dependent Claim 27 words
The system of claim 32 characterized in that said image and said additional information (18) are separated by a marker (194) indicating the end of said image.
Claim 34
Dependent Claim 37 words
The system of claim 33 characterized in that an image viewer (340) which does not recognize said additional information (18) will display said image properly and recognize said marker (194) as indicating the end of said image.
Claim 35
Dependent Claim 15 words
The system of claim 34 characterized in that said image is in a JPEG format.
Claim 36
Dependent Claim 64 words
The system of claim 31 characterized in that said additional information (18) is organized in at least two layers comprising: (a) a first layer containing information describing the location of objects (17a, 17b) within said image; and (b) a second layer containing additional information (18) regarding said objects (17a, 17b) within said image, where said first layer contains fewer bytes than said second layer.
Claim 37
Dependent Claim 24 words
The system of claim 36 characterized in that said second layer follows said first layer, which in turn follows said image file (232, 332).
Claim 38
Dependent Claim 22 words
The system of claim 36 characterized in that said first layer contains a length identifier describing the length of said first layer.
Claim 39
Dependent Claim 27 words
The system of claim 36 characterized in that said first layer contains a number of objects identifier describing the number of objects identified by said first layer.
Claim 40
Dependent Claim 31 words
The system of claim 36 characterized in that said first layer contains a number of data identifier describing the number of data items associated with a particular said object (17a, 17b).
Claim 41
Dependent Claim 26 words
The system of claim 36 characterized in that said first layer contains a first definition of the outline of an object (17a, 17b) of said image.
Claim 42
Dependent Claim 22 words
The system of claim 36 characterized in that said second layer contains a length identifier describing the length of said second layer.
Claim 43
Dependent Claim 24 words
The system of claim 36 characterized in that said second layer contains an array of offsets that identify the start of each data item.
Claim 44
Dependent Claim 44 words
The system of claim 41 characterized in that said second layer contains a second definition of the outline of said object (17a, 17b) of said image, where said second definition more closely approximates the outline of said object (17a, 17b) than said first definition.
Claim 45
Dependent Claim 37 words
The system of claim 41 characterized in that said second layer contains a second definition of the outline of said object (17a, 17b) of said image, where said second definition contains more bytes than said first definition.
Claim 46
Dependent Claim 20 words
The system of claim 36 characterized in that said second layer includes sound data related to said object (17a, 17b).
Claim 47
Dependent Claim 21 words
The system of claim 36 characterized in that said second layer includes HTML meta tags related to said object (17a, 17b).
Claim 48
Dependent Claim 20 words
The system of claim 36 characterized in that said second layer includes textual annotations related to said object (17a, 17b).
Claim 49
Dependent Claim 18 words
The system of claim 36 characterized in that said second layer includes an HTML page to be rendered.
Claim 50
Dependent Claim 21 words
The system of claim 36 characterized in that said second layer includes a Java applet related to said object (17a, 17b).
Claim 51
Dependent Claim 15 words
The system of claim 36 characterized in that said second layer includes a color histogram.
Claim 52
Dependent Claim 35 words
The system of claim 36 characterized in that said second layer includes data related to the conditions under which said image was created including at least one of lighting, camera settings, and time of acquisition.
Claim 53
Dependent Claim 35 words
The system of claim 36 characterized in that said second layer includes data related to information for reproducing said image including at least one of cropping information, paper type, camera settings, and image production settings.
Claim 54
Dependent Claim 20 words
The system of claim 36 characterized in that said second layer includes another image to be superimposed upon said image.
Claim 55
Dependent Claim 19 words
The system of claim 36 characterized in that said second layer includes data regarding the author of said image.
Claim 56
Dependent Claim 20 words
The system of claim 36 characterized in that said second layer includes copyright data regarding the copyright of said image.
Claim 57
Dependent Claim 10 words
The system of claim 56 said copyright data is encoded.
Claim 58
Dependent Claim 20 words
The system of claim 36 characterized in that said second layer includes information regarding how said image should be viewed.
Claim 59
Dependent Claim 25 words
The system of claim 36 characterized in that said first layer is transmitted from a first computer to a second computer together with said image.
Claim 60
Dependent Claim 29 words
The system of claim 59 characterized in that portions of said second layer are transmitted from said first computer to said second computer upon request by said first computer.
Claim 61
Dependent Claim 22 words
The system of claim 60 characterized in that said request is in response to a user selecting an object within said image.

References Cited (Backward Citations)

US5708845A Cited

USPTO Annuity & Maintenance Windows

Maintenance schedule is calculated for granted US utility patents.

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag