US5600775A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for annotating full motion video and other indexed data structures
Assignee: CINEBASE SOFTWARE Inc
•
Filing: 1994-08-26
•
Granted: 1997-02-04
•
Expires: 2014-08-26
Abstract
Abstract Full motion digital video frames, or other indexed data structures, are annotated with text, graphics, and digital audio without modifications to the original video information. The video and annotations are stored separately. An indexing scheme relates the annotations to the video frames. On full motion video playback, the annotations are displayed on the originally annotated frames. The technique involves displaying the file of indexed data structures using a file display routine, and selecting in response to user input an indexed data structure to be annotated from the file of indexed data structures being displayed. Next, an annotation data structure is created in response to user input using an annotation routine without modifying the selected data structure. The annotation data structure includes a graphical element for display overlaying the selected data structure and an indication of an index value for the selected data structure. The annotation data structure is stored in an annotation memory apart from the file of indexed data structures. During playback, the annotation memory is monitored to detect annotation data structure for indexed data structures currently being displayed. If an annotation data structure is detected for the current indexed data structure, a graphical element overlies the indexed data structure on the display without modifying the indexed data structure. Text process documents can be handled much in the same manner. Also, annotation from several users may be merged and viewed in one batch.
Inventors
- 👤 Philip S. King
- 👤 Hendrik W. Nelis
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 13:31
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/14; H04N7/15; G; G06; G06F; G06F16/00; G06F16/70; G06F16/71; G06F16/78
Claims Analysis
Total Claims: 52
Claim 1
Independent Claim
160 words
A method of annotation for a file of indexed data structures, data structures in the file having an index value, comprising: displaying the file of indexed data structures using a file display routine; selecting, in response to user input, an indexed data structure to be annotated from the file of indexed data structures being displayed; creating, in response to user input, an annotation data structure using an annotation routine without modifying the selected data structure, the annotation data structure including a graphical element for display overlaying the selected data structure and an indication of an index value for the selected data structure; storing the annotation data structure in an annotation memory; monitoring the annotation memory while displaying the file of indexed data structures to detect annotation data structures for indexed data structures currently being displayed; and overlaying the indexed data structure on the display with the graphical element of the detected annotation data structure without modifying the indexed data structure.
Claim 2
Independent Claim
160 words
A method of annotation for a file of indexed data structures, data structures in the file having an index value, comprising: displaying the file of indexed data structures using a file display routine; selecting, in response to user input, an indexed data structure to be annotated from the file of indexed data structures being displayed; creating, in response to user input, an annotation data structure using an annotation routine without modifying the selected data structure, the annotation data structure including a graphical element for display overlaying the selected data structure and an indication of an index value for the selected data structure; storing the annotation data structure in an annotation memory; monitoring the annotation memory while displaying the file of indexed data structures to detect annotation data structures for indexed data structures currently being displayed; and overlaying the indexed data structure on the display with the graphical element of the detected annotation data structure without modifying the indexed data structure.
Claim 3
Dependent Claim
22 words
The method of claim 1, wherein the indexed data structures comprise video frames, and the index value identifies an individual video frame.
Claim 4
Dependent Claim
30 words
The method of claim 1, wherein the file of indexed data structures comprises a full motion video file including video frames, and the index value identifies an individual video frame.
Claim 5
Dependent Claim
23 words
The method of claim 3, wherein the step of displaying the file of indexed data structures includes playing the full motion video file.
Claim 6
Dependent Claim
25 words
The method of claim 4, including stopping the playing of the full motion video file at the current video frame during the step of overlaying.
Claim 7
Dependent Claim
51 words
The method of claim 1, including providing a graphical user interface having a window for displaying the indexed data structures, and an annotation control window, the annotation control window including graphical input elements providing access to tools for providing user input in the step of selecting and the step of creating.
Claim 8
Dependent Claim
31 words
The method of claim 1, wherein the step of creating includes inputting bitmap drawing data to the annotation data structure, the bitmap drawing data to be used in the graphical element.
Claim 9
Dependent Claim
29 words
The method of claim 1, wherein the step of creating includes inputting text data to the annotation data structure, the text data to be used in the graphical element.
Claim 10
Dependent Claim
41 words
The method of claim 1, wherein the step of creating includes inputting audio data to the annotation data structure, and providing an icon to be used in the graphical element indicating presence of the audio data in the annotation data structure.
Claim 11
Dependent Claim
42 words
The method of claim 1, wherein the step of creating includes inputting coordinate data to the annotation data structure, the coordinate data indicating a position on the selected data structure at which the graphical element overlies the data structure on the display.
Claim 12
Dependent Claim
74 words
The method of claim 1, wherein the annotation memory stores a plurality of independently created files of annotation data structures, and the step of monitoring includes scanning the annotation data structures from plurality of independently created files to detect annotation data structures for the indexed data structures currently being displayed, and the step of overlaying includes overlaying the current indexed data structure with detected annotation data structures from the plurality of independently created files.
Claim 13
Dependent Claim
49 words
The method of claim 1, wherein the annotation memory stores a plurality of independently created files of annotation data structures, and further including merging the independently created files in the annotation memory to form a merged annotation document for the indexed data structure prior to the step of displaying.
Claim 14
Dependent Claim
73 words
The method of claim 1, including establishing in the annotation memory an annotation document for the indexed data file, the annotation document including a list of annotations indexed to corresponding indexed data structures, the annotations including one or more annotation data structures for the corresponding indexed data structure, and wherein the step of storing the annotation data structure in an annotation memory includes adding the annotation data structure to the list of annotations.
Claim 15
Dependent Claim
47 words
The method of claim 13, wherein the annotation memory stores a plurality of independently created annotation documents, and further including merging the independently created annotation documents in the annotation memory to form a merged annotation document for the indexed data structure prior to the step of displaying.
Claim 16
Independent Claim
204 words
A method of annotation for a file of full motion video having indexed frames of video data, frames in the file having an index value, comprising: playing the file of full motion video on a display using a display routine; selecting, in response to user input, a video frame to be annotated from the file being played; creating, in response to user input, an annotation data structure using an annotation routine without modifying the video frame, the annotation data structure including a graphical element for display overlaying the selected video frame and an indication of an index value for the selected video frame; storing the annotation data structure in an annotation memory; monitoring the annotation memory while playing the file of full motion video to detect annotation structures for indexed video frames currently being displayed; overlaying the video frame on the display with the graphical element of the annotation data structure without modifying the video frame; and providing a graphical user interface having a window for displaying the full motion video being played, and an annotation control window, the annotation control window including graphical input elements providing access to tools for providing user input in the step of selecting and the step of creating.
Claim 17
Independent Claim
204 words
A method of annotation for a file of full motion video having indexed frames of video data, frames in the file having an index value, comprising: playing the file of full motion video on a display using a display routine; selecting, in response to user input, a video frame to be annotated from the file being played; creating, in response to user input, an annotation data structure using an annotation routine without modifying the video frame, the annotation data structure including a graphical element for display overlaying the selected video frame and an indication of an index value for the selected video frame; storing the annotation data structure in an annotation memory; monitoring the annotation memory while playing the file of full motion video to detect annotation structures for indexed video frames currently being displayed; overlaying the video frame on the display with the graphical element of the annotation data structure without modifying the video frame; and providing a graphical user interface having a window for displaying the full motion video being played, and an annotation control window, the annotation control window including graphical input elements providing access to tools for providing user input in the step of selecting and the step of creating.
Claim 18
Dependent Claim
33 words
The method of claim 15, wherein the tools include a drawing tool for inputting bitmap drawing data to the annotation data structure, the bitmap drawing data to be used in the graphical element.
Claim 19
Dependent Claim
32 words
The method of claim 15, wherein the tools include a text input tool for inputting text data to the annotation data structure, the text data to be used in the graphical element.
Claim 20
Dependent Claim
44 words
The method of claim 15, wherein the tools include an audio input tool for inputting audio data to the annotation data structure, and providing an icon to be used in the graphical element indicating presence of the audio data in the annotation data structure.
Claim 21
Dependent Claim
44 words
The method of claim 15, wherein the tools include a pointer tool for inputting coordinate data to the annotation data structure, the coordinate data indicating a position on the selected video frame at which the graphical element overlies the video frame on the display.
Claim 22
Dependent Claim
25 words
The method of claim 15, including stopping the playing of the full motion video file at the current video frame during the step of overlaying.
Claim 23
Dependent Claim
73 words
The method of claim 15, wherein the annotation memory stores a plurality of independently created files of annotation data structures, and the step of monitoring includes scanning the annotation data structures from plurality of independently created files to detect annotation data structures for the indexed video frames currently being displayed, and the step of overlaying includes overlaying the current video frame with detected annotation data structures from the plurality of independently created files.
Claim 24
Dependent Claim
51 words
The method of claim 15, wherein the annotation memory stores a plurality of independently created files of annotation data structures, and further including merging the independently created files in the annotation memory to form a merged annotation document for the file of full motion video prior to the step of displaying.
Claim 25
Dependent Claim
75 words
The method of claim 15, including establishing in the annotation memory an annotation document for the file of full motion video, the annotation document including a list of annotations indexed to corresponding indexed video frames, the annotations including one or more annotation data structures for the corresponding indexed video frame, and wherein the step of storing the annotation data structure in an annotation memory includes adding the annotation data structure to the list of annotations.
Claim 26
Dependent Claim
50 words
The method of claim 23, wherein the annotation memory stores a plurality of independently created annotation documents, and further including merging the independently created annotation documents in the annotation memory to form a merged annotation document for the indexed file of full motion video prior to the step of displaying.
Claim 27
Independent Claim
199 words
An apparatus for display and annotation of a file of indexed data structures, data structures in the file having an index value, comprising: a display; a media manager, including resources to display the file of indexed data structures on the display; a device for user input; an annotation manager, including resources to select, in response to user input, an indexed data structure to be annotated from the file of indexed data structures being displayed, and resources to create, in response to user input, an annotation data structure without modifying the selected data structure and to store the annotation data structure in an annotation memory, the annotation data structure including a graphical element for display overlaying the selected data structure and an indication of an index value for the selected data structure; and play back resources, coupled with the media manager and the annotation manager, to monitor the annotation memory while the file of indexed data structures is displayed by the media manager to detect annotation data structures for indexed data structures currently being displayed, and to overlay the indexed data structure on the display with the graphical element of the annotation data structure without modifying the indexed data structure.
Claim 28
Independent Claim
199 words
An apparatus for display and annotation of a file of indexed data structures, data structures in the file having an index value, comprising: a display; a media manager, including resources to display the file of indexed data structures on the display; a device for user input; an annotation manager, including resources to select, in response to user input, an indexed data structure to be annotated from the file of indexed data structures being displayed, and resources to create, in response to user input, an annotation data structure without modifying the selected data structure and to store the annotation data structure in an annotation memory, the annotation data structure including a graphical element for display overlaying the selected data structure and an indication of an index value for the selected data structure; and play back resources, coupled with the media manager and the annotation manager, to monitor the annotation memory while the file of indexed data structures is displayed by the media manager to detect annotation data structures for indexed data structures currently being displayed, and to overlay the indexed data structure on the display with the graphical element of the annotation data structure without modifying the indexed data structure.
Claim 29
Dependent Claim
20 words
The apparatus of claim 25,, wherein the indexed data structures comprise video frames, and the index identifies individual video frames.
Claim 30
Dependent Claim
28 words
The apparatus of claim 25, wherein the file of indexed data structures comprises a full motion video file including video frames, and the index identifies individual video frames.
Claim 31
Dependent Claim
18 words
The apparatus of claim 25, wherein the media manager comprises resources to play the full motion video file.
Claim 32
Dependent Claim
48 words
The apparatus of claim 28, wherein the play back resources include resources to signal the media manager to stop the playing of the full motion video file at the current indexed data structure in response to detection of an annotation data structure for the current indexed data structure.
Claim 33
Dependent Claim
59 words
The apparatus of claim 25, wherein the user input includes a graphical user interface having a window for displaying the indexed data structures by the media manager, and an annotation control window, the annotation control window including graphical input elements providing access to tools, responsive to the device for user input, for providing user input to the annotation manager.
Claim 34
Dependent Claim
30 words
The apparatus of claim 25, including a drawing tool for inputting bitmap drawing data for the annotation data structure, the bitmap drawing data to be used in the graphical element.
Claim 35
Dependent Claim
29 words
The apparatus of claim 25, including a text input tool for inputting text data for the annotation data structure, the text data to be used in the graphical element.
Claim 36
Dependent Claim
47 words
The apparatus of claim 25, including an audio input tool for inputting audio data for the annotation data structure, and the annotation manager includes resources to provide a icon to be used in the graphical element indicating presence of the audio data in the annotation data structure.
Claim 37
Dependent Claim
43 words
The apparatus of claim 25, including a pointer tool for inputting coordinate data to the annotation data structure, the coordinate data indicating a position on the selected indexed data structure at which the graphical element overlies the indexed data structure on the display.
Claim 38
Dependent Claim
72 words
The apparatus of claim 25, wherein the annotation memory stores a plurality of independently created files of annotation data structures, and the playback resources include a routine to scan the annotation data structures from plurality of independently created files to detect annotation data structures for the indexed data structures currently being displayed, and to overlay the current indexed data structure with detected annotation data structures from the plurality of independently created files.
Claim 39
Dependent Claim
44 words
The apparatus of claim 25, wherein the annotation memory stores a plurality of independently created files of annotation data structures, and further including resources merge the independently created files in the annotation memory to form a merged annotation document for the indexed data structure.
Claim 40
Dependent Claim
75 words
The apparatus of claim 25, including resources coupled with the annotation memory to establish an annotation document for the indexed data file, the annotation document including a list of annotations indexed to corresponding indexed data structures, the annotations including one or more annotation data structures for the corresponding indexed data structure, and wherein the resources which store the annotation data structure in an annotation memory add the annotation data structure to the list of annotations.
Claim 41
Dependent Claim
44 words
The method of claim 37, wherein the annotation memory stores a plurality of independently created annotation documents, and further including a routine to merge the independently created annotation documents in the annotation memory to form a merged annotation document for the indexed data structure.
Claim 42
Independent Claim
254 words
An apparatus for display and annotation of a file of full motion video, frames of video data in the file having an index value, comprising: a display; a media manager, including resources to display the file of full motion video on the display; an annotation manager, including resources to select, in response to user input, an indexed frame of video data to be annotated from the file of full motion video being displayed, and resources to create, in response to user input, an annotation data structure without modifying the selected frame and to store the annotation data structure in an annotation memory, the annotation data structure including a graphical element for display overlaying the selected frame and an indication of an index value for the selected frame; a user input device, coupled with the annotation manager, including tools for providing user input to the annotation manager, and a graphical user interface having a window for displaying the file of full motion video by the media manager, and an annotation control window, the annotation control window including graphical input elements providing access to the tools for providing user input to the annotation manager; and play back resources, coupled with the media manager and the annotation manager, to monitor the annotation memory while the file of full motion video is displayed by the media manager to detect annotation data structures for flames currently being displayed, and to overlay the frame on the display with the graphical element of the annotation data structure without modifying the frame.
Claim 43
Independent Claim
254 words
An apparatus for display and annotation of a file of full motion video, frames of video data in the file having an index value, comprising: a display; a media manager, including resources to display the file of full motion video on the display; an annotation manager, including resources to select, in response to user input, an indexed frame of video data to be annotated from the file of full motion video being displayed, and resources to create, in response to user input, an annotation data structure without modifying the selected frame and to store the annotation data structure in an annotation memory, the annotation data structure including a graphical element for display overlaying the selected frame and an indication of an index value for the selected frame; a user input device, coupled with the annotation manager, including tools for providing user input to the annotation manager, and a graphical user interface having a window for displaying the file of full motion video by the media manager, and an annotation control window, the annotation control window including graphical input elements providing access to the tools for providing user input to the annotation manager; and play back resources, coupled with the media manager and the annotation manager, to monitor the annotation memory while the file of full motion video is displayed by the media manager to detect annotation data structures for flames currently being displayed, and to overlay the frame on the display with the graphical element of the annotation data structure without modifying the frame.
Claim 44
Dependent Claim
33 words
The apparatus of claim 39, wherein the tools include a drawing tool for inputting bitmap drawing data to the annotation data structure, the bitmap drawing data to be used in the graphical element.
Claim 45
Dependent Claim
32 words
The apparatus of claim 39, wherein the tools include a text input tool for inputting text data to the annotation data structure, the text data to be used in the graphical element.
Claim 46
Dependent Claim
49 words
The apparatus of claim 39, wherein the tools include an audio input tool for inputting audio data the annotation data structure, and the annotation manager includes resources to provide a icon to be used in the graphical element indicating presence of the audio data in the annotation data structure.
Claim 47
Dependent Claim
44 words
The apparatus of claim 39, wherein the tools include a pointer tool for inputting coordinate data to the annotation data structure, the coordinate data indicating a position on the selected data structure at which the graphical element overlies the data structure on the display.
Claim 48
Dependent Claim
44 words
The apparatus of claim 39, wherein the play back resources include resources to signal the media manager to stop the playing of the full motion video file at the current frame in response to detection of an annotation data structure for the current frame.
Claim 49
Dependent Claim
71 words
The apparatus of claim 39, wherein the annotation memory stores a plurality of independently created files of annotation data structures, and the playback resources include a routine to scan the annotation data structures from plurality of independently created files to detect annotation data structures for the indexed video frames currently being displayed, and to overlay the current video frame with detected annotation data structures from the plurality of independently created files.
Claim 50
Dependent Claim
47 words
The apparatus of claim 39, wherein the annotation memory stores a plurality of independently created files of annotation data structures, and further including resources to merge the independently created files in the annotation memory to form a merged annotation document for the file of full motion video.
Claim 51
Dependent Claim
80 words
The apparatus of claim 39, including resources coupled with the annotation memory to establish an annotation document for the file of full motion video, the annotation document including a list of annotations indexed to corresponding indexed video frames, the annotations including one or more annotation data structures for the corresponding indexed video frame, and the resources which store the annotation data structure in an annotation memory includes a routine to add the annotation data structure to the list of annotations.
Claim 52
Dependent Claim
47 words
The apparatus of claim 47, wherein the annotation memory stores a plurality of independently created annotation documents, and further including a routine to merge the independently created annotation documents in the annotation memory to form a merged annotation document for the indexed file of full motion video.
References Cited (Backward Citations)
US4616336A
Cited
US5517652A
Cited
US5513306A
Cited
US5309359A
Cited
US5404295A
Cited
US5524193A
Cited
US5428774A
Cited
US5442744A
Cited
US5502727A
Cited
US5550965A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-02-04 | 2000-08-05 | 2001-02-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-02-04 | 2004-08-05 | 2005-02-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-02-04 | 2008-08-05 | 2009-02-04 | $7700.00 | Window Closed / Lapsed |