US5963203A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Interactive video icon with designated viewing position
Assignee: Sony Corp
•
Filing: 1997-07-03
•
Granted: 1999-10-05
•
Expires: 2017-07-03
Abstract
Abstract Interactive interfaces to video information provide a displayed view of a quasi-object called a root image. The root image consists of a plurality of basic frames selected from the video information, arranged such that their respective x and y directions are aligned with the x and y directions in the root image and the z direction in the root image corresponds to time, such that base frames are spaced apart in the z direction of the root image in accordance with their time separation. The displayed view of the root image changes in accordance with a designated viewing position, as if the root image were a three-dimensional object. The user can manipulate the displayed image by designating different viewing positions, selecting portions of the video information for playback and by special effects, such as cutting open the quasi-object for a better view. A toolkit permits interface designers to design such interfaces, notably so as to control the types of interaction which will be possible between the interface and an end user. Implementations of the interfaces may include editors and viewers.
Inventors
- 👤 Cihl Mozest Goldberg
- 👤 Nabil Madrane
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 22:22
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/70; G06F16/78; G06F16/783; G06F16/7834; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/034; G06F16/74; G06F16/745; G06F16/7837; G06F16/7847; G06F16/786; G11B27/10; G11B27/102; G11B27/105; G11B27/19; G11B27/28; G11B27/34; G11B2220/00; G11B2220/20; G11B2220/21; G11B2220/213; G11B2220/25; G11B2220/2537; G11B2220/2545; Y; Y10; Y10S; Y10S715/00; Y10S715/976
Claims Analysis
Total Claims: 45
Claim 1
Independent Claim
160 words
An interface to an associated video sequence, the interface comprising: a) information defining a three-dimensional root image, the root image consisting of a plurality of basic frames selected from said video sequence, and/or a plurality of portions of video frames corresponding to selected objects represented in the video sequence, x and y directions in the root image corresponding, to x and y directions in the video frames and the z direction in the root image corresponding to the time axis whereby the basic frames are spaced apart from one another in the z direction of the root image by distances corresponding to the time separation between the respective video frames; b) means for displaying views of the root image; c) means for designating a viewing position relative to said root image; and d) means for calculating image data representing said three-dimensional root image viewed from the designated viewing, position, and for outputting said calculated image data to the displaying means.
Claim 2
Dependent Claim
160 words
An interface to an associated video sequence, the interface comprising: a) information defining a three-dimensional root image, the root image consisting of a plurality of basic frames selected from said video sequence, and/or a plurality of portions of video frames corresponding to selected objects represented in the video sequence, x and y directions in the root image corresponding, to x and y directions in the video frames and the z direction in the root image corresponding to the time axis whereby the basic frames are spaced apart from one another in the z direction of the root image by distances corresponding to the time separation between the respective video frames; b) means for displaying views of the root image; c) means for designating a viewing position relative to said root image; and d) means for calculating image data representing said three-dimensional root image viewed from the designated viewing, position, and for outputting said calculated image data to the displaying means.
Claim 3
Dependent Claim
28 words
An interactive interface according to claim 1, wherein the designating means is user-operable means for designating a viewing position relative to a displayed representation of the root image.
Claim 4
Dependent Claim
52 words
An interactive interface according to claim 1 wherein the means for calculating image data for display is adapted to include in the calculated output image data, dependent upon the designated viewing position, image data corresponding to portions of basic frames which are not visible in the reference view of the root image.
Claim 5
Dependent Claim
50 words
An interface according to claim 1 wherein the means for calculating image data for display is adapted to include in the calculated image data, dependent upon the distance between the designated viewing position and the root image, image data from frames of the video sequence additional to the basic frames.
Claim 6
Dependent Claim
46 words
An interactive interface according to claim 4 wherein the means for calculating image data for display is adapted to select for use in calculating the image for display additional frames chosen based upon criteria specified in additional information stored in association with the root image definition.
Claim 7
Dependent Claim
51 words
An interface according to claim 1, wherein the means for calculating image data for display is adapted to calculate output image data corresponding to a different number of frames and/or a displayed image of enlarged or reduced size, dependent upon the distance between the user-designated viewing position and the root image.
Claim 8
Dependent Claim
68 words
An interface according to any previous claim, wherein the video sequence includes image data representing one or more selected objects, the means for calculating image data for display being adapted, for each displayed frame containing a respective selected object, selectively to output image data causing display of only that image data which corresponds to the selected object(s), causing, the remainder of the respective displayed frame to appear transparent.
Claim 9
Dependent Claim
55 words
An interface according to claim 7, wherein there is provided means for the user to select objects represented in the displayed image, and wherein the means for calculating image data for display is adapted to output image data causing portions of frames to appear transparent in response to the selection of objects by the user.
Claim 10
Dependent Claim
110 words
An interface according to any one of claims 1-5 or 8 for a video sequence comprising a main sequence of video frames and at least one additional subsequence of video frames constituting an alternative path to or from a particular video frame in the main sequence, wherein the user can access image information relating to an alternative sub-sequence by designating a viewing position close to a point in the root image corresponding to said particular video frame, the means for calculating image data for display being adapted to graft on to the displayed view of the root image, at the branching point, a secondary root image representing said alternative sub-sequence.
Claim 11
Dependent Claim
38 words
An interactive interface according to claim 9, wherein by operation of the viewing position designating means the user can navigate through root images and secondary root images corresponding to the different possible scenarios contained in the video sequence.
Claim 12
Dependent Claim
125 words
Apparatus for creation of an interface to a video sequence, the apparatus comprising: a) means for accessing image information in digital form representing a video sequence; b) means for creating a root image representing the video sequence, the root image creation means comprising: i) means for selecting a sub-set of frames from the video sequence, or portions of said sub-set which correspond to objects represented in the video sequence, to serve as basic frames of the root image; and ii) means for setting the relative placement positions of the basic frames in the root image, and c) means for associating with the root image routines for changing the displayed view of the root image depending upon a designated viewing position relative to the root image.
Claim 13
Dependent Claim
125 words
Apparatus for creation of an interface to a video sequence, the apparatus comprising: a) means for accessing image information in digital form representing a video sequence; b) means for creating a root image representing the video sequence, the root image creation means comprising: i) means for selecting a sub-set of frames from the video sequence, or portions of said sub-set which correspond to objects represented in the video sequence, to serve as basic frames of the root image; and ii) means for setting the relative placement positions of the basic frames in the root image, and c) means for associating with the root image routines for changing the displayed view of the root image depending upon a designated viewing position relative to the root image.
Claim 14
Dependent Claim
32 words
Apparatus according to claim 11 and further comprising means for identification of objects represented in the image information of the video sequence and for designating objects as selectable by an end user.
Claim 15
Dependent Claim
45 words
Apparatus according to claim 11 wherein the means for setting the relative placement positions of the basic frames in the root image comprises means for accessing stored information representing a plurality of templates and means for inputting selection information designating one of the stored templates.
Claim 16
Dependent Claim
53 words
Apparatus according to claim 11 wherein the means for setting the relative placement positions of the basic frames in the root image comprises means for detecting motion in the video sequence and means for placing the basic frames within the root image in relative positions which provide a visual representation of said motion.
Claim 17
Dependent Claim
45 words
Apparatus according to claim 14 wherein the means for placing the basic frames within the root image is adapted to effect a progressive change in the dimensions of the basic frames in the root image in order to visually represent a zoom-in or zoom-out operation.
Claim 18
Dependent Claim
46 words
Apparatus according to claim 11, wherein the means for selecting a sub-set of frames from the video sequence to serve as basic frames of the root image is adapted to select frames as a function of the rate of change of back-round information in the image.
Claim 19
Dependent Claim
49 words
Apparatus according to claim 11, and comprising means for inputting parameters constraining the ways in which the displayed view of the root image can be changed depending upon a user-designated viewing position, the constraint parameters being assimilated into the routines associated with the root image by the associating means.
Claim 20
Dependent Claim
43 words
Apparatus according to claim 17 wherein the constraint parameter inputting means is adapted to input data identifying the rate at which additional frames should be included in a displayed view of the root image when a user-designated viewing position approaches the root image.
Claim 21
Dependent Claim
35 words
Apparatus according to claim 11, and comprising means for creating secondary root images corresponding to additional sub-sequences of video frames constituting alternative paths to or from a particular video frame in the main video sequence.
Claim 22
Dependent Claim
105 words
A process for creating an interface corresponding to a predetermined video sequence, comprising the steps of: a) retrieving the video sequence from a data store; b) analyzing data corresponding to at least some frames of the video sequence based upon at least one predetermined algorithm; c) selecting at least some frames from the video sequence based at least in part on frame ranking measure parameters stored in a frame ranking template store; d) arranging the selected frames to form a succession of frames defining at least in part the interface; and e) transferring data corresponding to said selected and arranged frames to an interface store.
Claim 23
Dependent Claim
105 words
A process for creating an interface corresponding to a predetermined video sequence, comprising the steps of: a) retrieving the video sequence from a data store; b) analyzing data corresponding to at least some frames of the video sequence based upon at least one predetermined algorithm; c) selecting at least some frames from the video sequence based at least in part on frame ranking measure parameters stored in a frame ranking template store; d) arranging the selected frames to form a succession of frames defining at least in part the interface; and e) transferring data corresponding to said selected and arranged frames to an interface store.
Claim 24
Dependent Claim
15 words
A process according to claim 20 in which said step of selection is conducted automatically.
Claim 25
Dependent Claim
19 words
A process according to claim 20 in which said step of selection is conducted at least in part manually.
Claim 26
Dependent Claim
28 words
A process according to claim 20 in which said step of selection is based at least in part on the degree of motion of objects in the frames.
Claim 27
Dependent Claim
31 words
A process according to claim 20 in which said step of selection is based at least in part on estimating camera motion by separating foreground and background portions of the images.
Claim 28
Dependent Claim
30 words
A process according to claim 20 in which said step of selection is based at least in part on vector data in the digital representation of images in the frames.
Claim 29
Dependent Claim
93 words
A process according to claim 20 further comprising the steps of: a) analyzing data corresponding to at least some frames of the video sequence in order to evaluate objects within said frames; b) selecting at least one object from a plurality of the frames; c) selecting at least some frames from the video sequence based at least in part on said at least one object; d) tracking said at least one object through the selected frames; and e) arranging the selected frames based at least in part on said at least one object.
Claim 30
Dependent Claim
20 words
A process according to claim 26 in which said step of selecting said at least one object is conducted automatically.
Claim 31
Dependent Claim
24 words
A process according to claim 26 in which said step of selecting said at least one object is conducted at least in part manually.
Claim 32
Dependent Claim
87 words
A process according to claim 20 further comprising the steps of: a) arranging the selected frames to form a succession of frames defining at least in part the interface; b) selecting at least one additional frame to add to the succession of frames corresponding to a new viewing position based at least in part on certain predetermined factors; and c) selecting at least one frame to remove from the succession of frames corresponding to a new viewing position based at least in part on certain predetermined factors.
Claim 33
Dependent Claim
22 words
A process according to claim 29 in which said step of selecting at least one additional frame to add is conducted automatically.
Claim 34
Dependent Claim
26 words
A process according to claim 29 in which said step of selecting at least one additional frame to add is conducted at least in part manually.
Claim 35
Dependent Claim
22 words
A process according to claim 29 in which said step of selecting at least one additional frame to remove is conducted automatically.
Claim 36
Dependent Claim
26 words
A process according to claim 29 in which said step of selecting at least one additional frame to remove is conducted at least in part manually.
Claim 37
Dependent Claim
42 words
A process according to claim 20 further comprising the steps of: a) arranging the selected frames based at least in part on user specified criteria; and b) calculating the arrangement of the selected frames based at least in part on predetermined algorithms.
Claim 38
Dependent Claim
39 words
A process according to claim 20 further comprising the steps of: a) creating an interface data file which contains data corresponding at least in part to said interface; and b) storing said interface data file in a data store.
Claim 39
Dependent Claim
42 words
A process according to claim 20 comprising the further steps of: a) creating a effects detail file which contains data corresponding to the said selection and arrangement of the selected frames; and b) storing said effects detail file in a data store.
Claim 40
Dependent Claim
36 words
A process according to claim 20 comprising the further steps of: a) creating a video sequence file which contains data corresponding to the selected frames; and b) storing said video sequence file in a data store.
Claim 41
Dependent Claim
49 words
A process according to claim 20 comprising the further steps of: a) extracting a predetermined set of information from the said interface; b) creating a script file consisting at least in part of said predetermined set of information; and c) storing the said script file in a data store.
Claim 42
Independent Claim
137 words
A method for processing an interface corresponding to a predetermined video sequence, comprising the steps of: a) retrieving the video sequence from a data store; b) analyzing data corresponding to at least some frames of the video sequence based upon at least one predetermined algorithm; c) selecting at least some frames from the video sequence based at least in part on frame ranking measure parameters stored in a frame ranking template store; d) arranging the selected frames to form a succession of frames defining at least in part the interface; and e) transferring data capable of generating at least one image corresponding to said succession of frames to a viewer; f) generating an image from a desired perspective using said data capable of generating at least one image; and g) displaying said image on a display device.
Claim 43
Independent Claim
137 words
A method for processing an interface corresponding to a predetermined video sequence, comprising the steps of: a) retrieving the video sequence from a data store; b) analyzing data corresponding to at least some frames of the video sequence based upon at least one predetermined algorithm; c) selecting at least some frames from the video sequence based at least in part on frame ranking measure parameters stored in a frame ranking template store; d) arranging the selected frames to form a succession of frames defining at least in part the interface; and e) transferring data capable of generating at least one image corresponding to said succession of frames to a viewer; f) generating an image from a desired perspective using said data capable of generating at least one image; and g) displaying said image on a display device.
Claim 44
Dependent Claim
39 words
A method according to claim 39 further comprising the steps of: a) generating an image from a second desired perspective using said data capable of generating at least one image; and b) displaying said image on a display device.
Claim 45
Dependent Claim
76 words
A method according to claim 39 in which the step of generating an image from a desired perspective using said data capable of generating at least one image comprises the steps of: a) determining frames in the interface to dropped or added; b) calculating the position of all frames relative to each other; and c) generating an image that renders said frames positioned appropriately relative to each other and that takes into account the predetermined perspective.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-10-04 | 2003-04-05 | 2003-10-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-10-04 | 2007-04-05 | 2007-10-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-10-04 | 2011-04-05 | 2011-10-05 | $7700.00 | Window Closed / Lapsed |