US5748499A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Computer graphics data recording and playback system with a VCR-based graphic user interface
Assignee: Sony Corp
•
Filing: 1995-09-19
•
Granted: 1998-05-05
•
Expires: 2015-09-19
Abstract
Abstract A method and apparatus for recording and playing back computer graphics data, including cursor movement data, and audio data which requires no X-Window command extensions. During recording, the command data stream to a display controller is intercepted, time stamped at regular intervals, and sent to and stored in a first file in a mass storage device. Cursor movement and operation data also is intercepted, time stamped and stored in a second file. During recording, display state data is generated and recorded into a third file at specified intervals. For playback, the system operator is presented with a graphic user interface resembling the control panel of a video cassette recorder. The system operator can play back the recorded information starting from a designated instant by operating the "buttons" on the control panel. For playback, the third file is read and forwarded to the display controller. The first and second files are then merged utilizing the time stamps to ensure synchronization and forwarded in a stream to the display controller for playing back the recorded events.
Inventors
- 👤 John Trueblood
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 18:41
CPC Classifications
G; G06; G06F; G06F9/00; G06F9/06; G06F9/44; G06F9/451
Claims Analysis
Total Claims: 39
Claim 1
Independent Claim
161 words
A method of recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said method comprising the steps of: storing X-Window commands sent from said client program to said display device in a first memory file; time stamping said X-Window commands in said first memory file with a first set of time stamps, at fixed intervals, storing state information in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; time stamping said state information in said second memory file with a second set of time stamps; storing in a third memory file X-Window events generated by a pointer device, said pointer device for graphically interacting with said client program and said display; and time stamping said X-Window events in said third file with a third set of time stamps.
Claim 2
Independent Claim
161 words
A method of recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said method comprising the steps of: storing X-Window commands sent from said client program to said display device in a first memory file; time stamping said X-Window commands in said first memory file with a first set of time stamps, at fixed intervals, storing state information in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; time stamping said state information in said second memory file with a second set of time stamps; storing in a third memory file X-Window events generated by a pointer device, said pointer device for graphically interacting with said client program and said display; and time stamping said X-Window events in said third file with a third set of time stamps.
Claim 3
Dependent Claim
15 words
A method as set forth in claim 1 wherein said pointer device is a mouse.
Claim 4
Dependent Claim
62 words
A method as set forth in claim 1 wherein said step of time stamping said X-Window commands in said first memory file comprises the step of: for each time interval during which at least one command was stored, storing in said first memory file, before all X-Window commands which were recorded during said interval, a time stamp identifying said predetermined time interval.
Claim 5
Dependent Claim
58 words
A method as set forth in claim 3 wherein said step of time stamping said X-Window events in said third file comprises the step of: for each event recorded in said third memory file, storing in said third memory file, at a position preceding said event, a time stamp indicating said predetermined interval within which said event occurred.
Claim 6
Dependent Claim
169 words
A method as set forth in claim 4 wherein said method further comprises playing back a recorded X-Window session, said method further comprising the steps of: (a) determining a start time for said playback; (b) determining the first time stamp in said event file subsequent to said start time; (c) determining the first time stamp in said X-command file subsequent to said start time; (d) synchronizing said time stamps to a clock of a host processor; (e) whenever said clock reaches a time corresponding to a determined time stamp in said third memory file, reading out said event which corresponds to said time stamp to said display device; (f) determining the time stamp in said event file of a next event in said file; (g) when said clock reaches a time corresponding to a determined time stamp in said X-command file, reading out all X-commands corresponding to said time stamp to said display device; (h) determining a next time stamp in said X-command file; and (i) repeating steps (e)-(h).
Claim 7
Dependent Claim
101 words
A method as set forth in claim 1 wherein said method further comprises playing back a recorded X-Windows session, said method further comprising the steps of: reading out to said display device said X-Window commands stored in said first memory file using said first set of time stamps to read out said commands with a relative timing corresponding to a relative timing at which they were stored; and reading out to said display device said X-Window events stored in said second memory file using said time stamps to synchronize to said reading out of X-Window commands from said first memory file.
Claim 8
Dependent Claim
48 words
A method as set forth in claim 6 further comprising the steps of providing a graphic user interface in the form of a video cassette recorder face plate as a display on said display device for initiating said playing back of a recording session and setting playback parameters.
Claim 9
Independent Claim
198 words
A method of recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said method comprising the steps of: storing X-Window commands sent from said client program to said display device in a first memory file; time stamping said X-Window commands in said first memory file with a first set of time stamps, at fixed intervals, storing state information in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; time stamping said state information in said second memory file with a second set of time stamps; wherein said step of storing state information comprises storing X-Window CREATE commands; and further wherein said step of storing state information further comprises: intercepting each X-Window command and event directed to said display device; determining which, if any, of said stored CREATE commands have parameters which are affected by said intercepted command or event; and modifying said parameters of said stored CREATE commands which are affected by said intercepted command or event in accordance with said intercepted command or event.
Claim 10
Independent Claim
198 words
A method of recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said method comprising the steps of: storing X-Window commands sent from said client program to said display device in a first memory file; time stamping said X-Window commands in said first memory file with a first set of time stamps, at fixed intervals, storing state information in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; time stamping said state information in said second memory file with a second set of time stamps; wherein said step of storing state information comprises storing X-Window CREATE commands; and further wherein said step of storing state information further comprises: intercepting each X-Window command and event directed to said display device; determining which, if any, of said stored CREATE commands have parameters which are affected by said intercepted command or event; and modifying said parameters of said stored CREATE commands which are affected by said intercepted command or event in accordance with said intercepted command or event.
Claim 11
Independent Claim
173 words
A method of recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said method comprising the steps of: storing X-Window commands sent from said client program to said display device in a first memory file; time stamping said X-Window commands in said first memory file with a first set of time stamps, at fixed intervals, storing state information in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; time stamping said state information in said second memory file with a second set of time stamps; wherein said work station further comprises audio means for providing audio data corresponding to said display on said display device, said method further comprising the steps of: storing in a fourth memory file said audio data; and storing in a fifth memory file time stamps corresponding to said audio data in said fourth memory file.
Claim 12
Independent Claim
173 words
A method of recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said method comprising the steps of: storing X-Window commands sent from said client program to said display device in a first memory file; time stamping said X-Window commands in said first memory file with a first set of time stamps, at fixed intervals, storing state information in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; time stamping said state information in said second memory file with a second set of time stamps; wherein said work station further comprises audio means for providing audio data corresponding to said display on said display device, said method further comprising the steps of: storing in a fourth memory file said audio data; and storing in a fifth memory file time stamps corresponding to said audio data in said fourth memory file.
Claim 13
Dependent Claim
38 words
The method of claim 9 wherein said step of storing X-Window commands comprises the steps of intercepting X-Window commands sent to said display device and forwarding said commands to said first memory file and to said display device.
Claim 14
Independent Claim
171 words
A method of recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said method comprising the steps of: storing X-Window commands sent from said client program to said display device in a first memory file; time stamping said X-Window commands in said first memory file with a first set of time stamps, at fixed intervals, storing state information in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; time stamping said state information in said second memory file with a second set of time stamps; wherein said step of storing state information comprises the steps of: identifying commands which may affect the state of the display; identifying parameters of the identified commands which may alter the current state of the display; and updating a table of X-Window CREATE commands with state-affecting parameters in accordance with said identified parameters.
Claim 15
Independent Claim
171 words
A method of recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said method comprising the steps of: storing X-Window commands sent from said client program to said display device in a first memory file; time stamping said X-Window commands in said first memory file with a first set of time stamps, at fixed intervals, storing state information in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; time stamping said state information in said second memory file with a second set of time stamps; wherein said step of storing state information comprises the steps of: identifying commands which may affect the state of the display; identifying parameters of the identified commands which may alter the current state of the display; and updating a table of X-Window CREATE commands with state-affecting parameters in accordance with said identified parameters.
Claim 16
Dependent Claim
35 words
A method as set forth in claim 11 further comprising the steps of: immediately after said step of storing said state information, issuing EXPOSE X-Window events for each window which is active in said display.
Claim 17
Dependent Claim
121 words
A method as set forth in claim 12 wherein said method further comprises playing back a recorded X-Windows session from a random starting time, said method further comprising the steps of: reading out to said display device said create commands; reading out to said display device said X-Window commands stored in said first memory file starting at said random starting time using said first set of time stamps to read out said commands with a relative timing corresponding to a relative timing at which they were stored; and reading out to said display device said X-Window events stored in said second memory file using said time stamps to synchronize to said reading out of X-Window commands from said first memory file.
Claim 18
Dependent Claim
86 words
A method as set forth in claim 13 further comprising the steps of: if said specified starting time is other than at the beginning of a recording session, prior to step (e), reading out said state information from said second memory file corresponding to an instant preceding said starting time by a predetermined interval; and reading out to said display device said X-Window commands stored in said first memory file in the order in which they were stored from said instant to said specified starting time.
Claim 19
Independent Claim
158 words
An apparatus for recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said apparatus comprising: a work station including a graphic display device for generating a display; means for intercepting X-Window commands sent from said client program to said display device; means for storing said X-Window commands in a first memory file with a first set of periodic time stamps; means for storing state information at fixed intervals in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; a pointer device for graphically interacting with said client program and said display; means for storing in a third memory file X-Window events generated by said pointer device; and means for time stamping said X-Window events in said third file with a third set of time stamps.
Claim 20
Independent Claim
158 words
An apparatus for recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said apparatus comprising: a work station including a graphic display device for generating a display; means for intercepting X-Window commands sent from said client program to said display device; means for storing said X-Window commands in a first memory file with a first set of periodic time stamps; means for storing state information at fixed intervals in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; a pointer device for graphically interacting with said client program and said display; means for storing in a third memory file X-Window events generated by said pointer device; and means for time stamping said X-Window events in said third file with a third set of time stamps.
Claim 21
Dependent Claim
15 words
A method as set forth in claim 15 wherein said pointer device is a mouse.
Claim 22
Dependent Claim
66 words
An apparatus as set forth in claim 15 wherein said means for storing said X-Window commands in said first memory file comprises means for storing in said first memory file, each time interval of a predetermined duration during which interval at least one X-Window command was issued, a time stamp indicating said predetermined time interval followed by all X-Window commands which were recorded during said interval.
Claim 23
Dependent Claim
54 words
An apparatus as set forth in claim 17 wherein said means for storing said X-Window events in said third file comprises means for storing in said third memory file, for each event recorded in said third memory file, a time stamp indicating said predetermined interval within which said event occurred followed by said event.
Claim 24
Dependent Claim
182 words
An apparatus as set forth in claim 18 further comprising means for playing back a recorded X-Window session, said method further comprising: (a) means for determining a start time for said playback; (b) means for determining the first time stamp in said event file subsequent to said start time; (c) means for determining the first time stamp in said X-command file subsequent to said start time; (d) means for synchronizing said time stamps to a clock of a host processor; (e) means for reading out said event which corresponds to said time stamp and executing said event, when said clock reaches a time corresponding to a determined time stamp in said event file; (f) means for determining the time stamp in said event file of a next event in said file; (g) means for reading out all X-commands corresponding to said time stamp and executing said commands, when said clock reaches a time corresponding to a determined time stamp in said X-command file; (h) means for determining a next time stamp in said X-command file; and (i) means for repeating steps (e)-(h).
Claim 25
Independent Claim
166 words
An apparatus for recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said apparatus comprising: a work station including a graphic display device for generating a display; means for intercepting X-Window commands sent from said client program to said display device; means for storing said X-Window commands in a first memory file with a first set of periodic time stamps; and means for storing state information at fixed intervals in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; wherein said means for storing state information comprises: means for maintaining a set of state generating commands for generating windows in said display; means for determining those X-Window commands which have an effect on the state of the display; and means for updating said state generating commands in accordance with said determined X-Window commands.
Claim 26
Independent Claim
166 words
An apparatus for recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said apparatus comprising: a work station including a graphic display device for generating a display; means for intercepting X-Window commands sent from said client program to said display device; means for storing said X-Window commands in a first memory file with a first set of periodic time stamps; and means for storing state information at fixed intervals in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; wherein said means for storing state information comprises: means for maintaining a set of state generating commands for generating windows in said display; means for determining those X-Window commands which have an effect on the state of the display; and means for updating said state generating commands in accordance with said determined X-Window commands.
Claim 27
Dependent Claim
21 words
An apparatus as set forth in claim 20 further comprising a mass storage device in which said memory files are stored.
Claim 28
Dependent Claim
17 words
An apparatus as set forth in claim 21 wherein said mass storage device comprises a hard disk.
Claim 29
Dependent Claim
154 words
An apparatus as set forth in claim 22 further comprises means for playing back a recorded X-Windows session, said means for playing back comprising: means for reading out to said display device said X-Window commands stored in said first memory file starting at a specified starting time using said first set of time stamps to read out said command with a relative timing corresponding to a relative timing at which they were stored; means for reading out to said display device said X-Window events stored in said second memory file using said time stamps to synchronize to said reading out of X-Window commands from said first memory file; and means for reading out to an audio reproduction device said audio information stored in said fourth memory file using said time stamps stored in said fifth memory file to synchronize said audio data to said reading out of X-Window commands from said first memory file.
Claim 30
Dependent Claim
116 words
An apparatus as set forth in claim 23 further comprising: means for determining if said specified start time is other than at the beginning of a recorded session; means for reading out to said display device said state information from said second memory file corresponding to an instant preceding said starting time by a predetermined interval prior to reading out said data from said first memory file, if said specified starting time is other than at the beginning of a recording session; and means for reading out to said display device said X-Window commands stored in said first memory file in the order in which they were stored from said instant to said specified starting time.
Claim 31
Dependent Claim
18 words
An apparatus as set forth in claim 24 wherein said predetermined interval is at least about 2 seconds.
Claim 32
Dependent Claim
56 words
An apparatus as set forth in claim 20 wherein said work station further comprises: audio means for providing audio data corresponding to said display; means for storing in a fourth memory file said audio data; and means for storing in a fifth memory file time stamps corresponding to said audio data in said fourth memory file.
Claim 33
Independent Claim
164 words
An apparatus for recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said apparatus comprising: a work station including a graphic display device for generating a display; means for intercepting X-Window commands sent from said client program to said display device; means for storing said X-Window commands in a first memory file with a first set of periodic time stamps; and means for storing state information at fixed intervals in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; wherein said means for storing state information comprises: means for identifying commands which may affect the state of the display; means for identifying parameters of the identified commands which may alter the current state of the display; and means for updating a table of state-affecting parameters in accordance with said identified parameters.
Claim 34
Independent Claim
164 words
An apparatus for recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said apparatus comprising: a work station including a graphic display device for generating a display; means for intercepting X-Window commands sent from said client program to said display device; means for storing said X-Window commands in a first memory file with a first set of periodic time stamps; and means for storing state information at fixed intervals in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; wherein said means for storing state information comprises: means for identifying commands which may affect the state of the display; means for identifying parameters of the identified commands which may alter the current state of the display; and means for updating a table of state-affecting parameters in accordance with said identified parameters.
Claim 35
Dependent Claim
40 words
An apparatus as set forth in claim 27 further comprising means for issuing EXPOSE X-Window events for each window which is active in said display immediately after said step of storing said state information, so as to re-draw said windows.
Claim 36
Independent Claim
210 words
An apparatus for recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said apparatus comprising: a work station including a graphic display device for generating a display; means for intercepting X-Window commands sent from said client program to said display device; means for storing said X-Window commands in a first memory file with a first set of periodic time stamps; means for storing state information at fixed intervals in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; means for playing back a recorded X-Windows session, said means for playing back comprising; means for reading out to said display device said X-Window commands stored in said first memory file starting at a specified starting time using said first set of time stamps to read out said commands with a relative timing corresponding to a relative timing at which they were stored; and means for reading out to said display device said X-Window events stored in said second memory file using said time stamps to synchronize to said reading out of X-Window commands from said first memory file.
Claim 37
Independent Claim
210 words
An apparatus for recording an X-Window session in which X-Window commands and events create a display on a display device that is coupled to a client program through a work station, said apparatus comprising: a work station including a graphic display device for generating a display; means for intercepting X-Window commands sent from said client program to said display device; means for storing said X-Window commands in a first memory file with a first set of periodic time stamps; means for storing state information at fixed intervals in a second memory file, said state information comprising information from which the state of the display at said fixed interval can be determined; means for playing back a recorded X-Windows session, said means for playing back comprising; means for reading out to said display device said X-Window commands stored in said first memory file starting at a specified starting time using said first set of time stamps to read out said commands with a relative timing corresponding to a relative timing at which they were stored; and means for reading out to said display device said X-Window events stored in said second memory file using said time stamps to synchronize to said reading out of X-Window commands from said first memory file.
Claim 38
Dependent Claim
49 words
An apparatus as set forth in claim 29 wherein said display device comprises: an X-server coupled to receive X-Window commands and events from said means for intercepting and from said means for playing back; a graphic controller card coupled to receive data from said X-server; and a display terminal.
Claim 39
Dependent Claim
42 words
An apparatus as set forth in claim 29 further comprising: means for providing a graphic user interface on said display device in the form of a video cassette recorder for initiating said playing back of a recording session and setting playback parameters.
References Cited (Backward Citations)
US5097411A
Cited
US5386503A
Cited
US5603034A
Cited
US5483468A
Cited
US5475835A
Cited
US5361202A
Cited
US5564005A
Cited
US5611050A
Cited
US5596714A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-05-04 | 2001-11-03 | 2002-05-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-05-04 | 2005-11-03 | 2006-05-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-05-04 | 2009-11-03 | 2010-05-05 | $7700.00 | Window Closed / Lapsed |