US5457780A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for producing a video-instruction set utilizing a real-time frame differential bit map and microblock subimages
Assignee: Individual
•
Filing: 1992-07-06
•
Granted: 1995-10-10
•
Expires: 2012-07-06
Abstract
Abstract The present invention pertains to integrated circuit system based on novel architecture of Video-Instruction-Sec-Computing (VISC). The integrated circuit comprises a plurality of functional units to independently execute the tasks of remote communication, bandwidth adaptation, application control, multimedia management, and universal video encoding. The integrated circuit is also comprised of scalable formatter element connecting to the functional units which can inter-operate arbitrary external video formats and intelligently adapt to selective internal format depending upon the system throughput and configuration. Additionally, there is a smart memory element connecting to the functional units and scalable formatter, which can access, store, and transfer blocks of video data based on selective internal format. In the preferred embodoment, the integrated circuit is also comprised of an embedded RISC or CISC co-processor element in order to execute DOS, Window, NT, Macintosh, OS2 or UNIX applications In a more preferred embodiment, the integrated circuit includes a real time object oriented operation system element wherein concurrent execution of the application program and real time VISC based video instruction sets can be performed. The present invention is designed to sustain the evolution of a plurity generations of the VISC microprocessors. These novel VISC microprocessors can be efficiently used to perform wide range of real time distributed video signal processing functions for applications such as interactive video, HDTV, and multimedia communications.
Inventors
- 👤 Venson M. Shaw
- 👤 Steven M. Shaw
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 23:38
CPC Classifications
G; G06; G06F; G06F17/00; H; H04; H04N; H04N19/00; G06T; G06T1/00; G06T1/20; G06T3/00; G06T3/40; H04L; H04L12/00; H04L12/02; H04L12/16; H04L12/18; H04L12/1813; H04L65/00; H04L65/40; H04L65/403; H04L65/60; H04L65/75; H04L65/752; H04L65/764; H04L65/80; H04L69/00; H04L69/04; H04L9/00; H04L9/40; H04M; H04M3/00; H04M3/42; H04M3/56; H04M3/567; H04N19/42; H04N19/50; H04N19/503; H04N19/51; H04N19/59; H04N19/60; H04N19/61; H04N21/00; H04N21/20; H04N21/23; H04N21/238; H04N21/2383; H04N21/40; H04N21/43; H04N21/438; H04N21/4382; H04N7/00; H04N7/14; H04N7/141; H04N7/147; H04N7/15; H04N7/16; H04N7/173; H04L65/1066; H04L65/1101; H04N21/41; H04N21/422; H04N21/42204; H04N21/42226
Claims Analysis
Total Claims: 24
Claim 1
Independent Claim
428 words
An integrated system optimized for a video-instruction set executing a plurality of applications for the storage, retrieval and scaleable formatting of video data, comprising: a frame capture state; first data processing means for the selective receipt of a local or remote signal, said first data processing means preprocessing the remote signal to produce a real-time frame differential bit map and microblocks subimages at said frame capture stage during a first period of time; first controller means producing a run time object priority assignment signal in accordance with said microblock subimages during a second period of time subsequent to said first period of time; second controller means for producing and prefetching look-ahead group instruction sequences for run-time execution of each of said microblock subimages in accordance with said run-time object priority assignment; third controller means connected to said first data processing means for producing a run-time bandwidth requirement signal for each of said microblock subimages in accordance with said frame differential bit map, based upon said prefetching look-ahead group instruction sequences produced during said first period of time; second data processor means connected to said first data processor means and said second controller means for scaleable data formatting of the microblock subimage data to a compatible internal format in accordance with said run-time object priority assignment; third data processor means connected to said second data processor for encoding said compatible internal format of said microblock subimages to produce encoded microblock subimages; fourth data processor means connected to said third data processor means for packaging said encoded microblock subimages based upon said prefetched instruction-look-ahead sequences to produce packaged data, said fourth data processor means further comprising a transmitter means for remote network transmission; scaleable and reconfiguration data memory means for receipt of said packaged data and automatically self-configuring said packaged data into a plurality of internally storable entities, said scaleable and reconfiguration data memory means comprising at least one memory cell and their associated sensing, register, control, management and interface circuits, as well as a run-time adaptive decision-making logic means for receiving a set of run-time variables corresponding to user, application, and networking conditions, and producing a run-time executable data storage configuration in order to address, store, and retrieve the most recently-optimized run-time video articles or objects; decoder means connected to said scaleable and reconfigurable data memory and said prefetched instruction-look-ahead sequences to produce a decoded signal; and display means connected to said decoder means for post processing said decoded signal in accordance with said prefetched instruction-look-ahead sequences, said display means comprising a plurality of display, facsimile or printer adapters.
Claim 2
Dependent Claim
428 words
An integrated system optimized for a video-instruction set executing a plurality of applications for the storage, retrieval and scaleable formatting of video data, comprising: a frame capture state; first data processing means for the selective receipt of a local or remote signal, said first data processing means preprocessing the remote signal to produce a real-time frame differential bit map and microblocks subimages at said frame capture stage during a first period of time; first controller means producing a run time object priority assignment signal in accordance with said microblock subimages during a second period of time subsequent to said first period of time; second controller means for producing and prefetching look-ahead group instruction sequences for run-time execution of each of said microblock subimages in accordance with said run-time object priority assignment; third controller means connected to said first data processing means for producing a run-time bandwidth requirement signal for each of said microblock subimages in accordance with said frame differential bit map, based upon said prefetching look-ahead group instruction sequences produced during said first period of time; second data processor means connected to said first data processor means and said second controller means for scaleable data formatting of the microblock subimage data to a compatible internal format in accordance with said run-time object priority assignment; third data processor means connected to said second data processor for encoding said compatible internal format of said microblock subimages to produce encoded microblock subimages; fourth data processor means connected to said third data processor means for packaging said encoded microblock subimages based upon said prefetched instruction-look-ahead sequences to produce packaged data, said fourth data processor means further comprising a transmitter means for remote network transmission; scaleable and reconfiguration data memory means for receipt of said packaged data and automatically self-configuring said packaged data into a plurality of internally storable entities, said scaleable and reconfiguration data memory means comprising at least one memory cell and their associated sensing, register, control, management and interface circuits, as well as a run-time adaptive decision-making logic means for receiving a set of run-time variables corresponding to user, application, and networking conditions, and producing a run-time executable data storage configuration in order to address, store, and retrieve the most recently-optimized run-time video articles or objects; decoder means connected to said scaleable and reconfigurable data memory and said prefetched instruction-look-ahead sequences to produce a decoded signal; and display means connected to said decoder means for post processing said decoded signal in accordance with said prefetched instruction-look-ahead sequences, said display means comprising a plurality of display, facsimile or printer adapters.
Claim 3
Dependent Claim
67 words
The system in accordance with claim 1 wherein said first data processing means comprises a video input capturer, a graphics input bit-map adaptor, a retrieval and storage register for said input signal processor, a frame differentiation processor; a motion processor, a foreground video object processor, a background image processor, at least one integrated sensor, and analog or digital preprocessor and storage means for non-video related data input.
Claim 4
Dependent Claim
38 words
The system in accordance with claim 1 wherein said first controller means comprises a priority assignment circuit, a priority reassignment circuit, and an object identification processor for producing run-time media object data types conforming to run-time bandwidth availability.
Claim 5
Independent Claim
26 words
The system in accordance with 1 wherein said third controller means comprises a run-time attribute processor for producing run-time compression ratio, frame rate, and display resolution.
Claim 6
Independent Claim
26 words
The system in accordance with 1 wherein said third controller means comprises a run-time attribute processor for producing run-time compression ratio, frame rate, and display resolution.
Claim 7
Dependent Claim
42 words
The system apparatus in accordance with claim 1 wherein said second controller means comprises a look-ahead-pipeline processor element for receiving an inbound differential video signal including bit-map, microblock, and motion vector, and producing a group of predefined instruction sequences for run-time execution.
Claim 8
Dependent Claim
83 words
The system apparatus in accordance with claim 1 wherein said second data processor means comprises an interpolating and extrapolating processor, an instruction and task prescheduler, a dynamic data formatter, a dynamic program scheduler and optimizer means and a scaling circuit means for reformatting an inbound signal to an appropriate internal format according to the run-time bandwidth requirement producing a coherent instruction bit stream for encoding processing, and controller means for invoking system calls for adjusting system clock rate, and resetting other system parameters.
Claim 9
Dependent Claim
44 words
The system apparatus in accordance with claim 1 wherein said third data processing means comprises a programmable encoder, a task queue, a pipeline buffer, and an interface circuit for selective on-board or off-board encoding of an internally formatted input still or motion video signal.
Claim 10
Dependent Claim
38 words
The system apparatus in accordance with claim 1 wherein said fourth data processing means comprises a multiple Layer protocol processing and control device, a pipeline buffer and register, an address generation device, and an external data interface circuit.
Claim 11
Dependent Claim
64 words
A system apparatus in accordance with claim 1 wherein said scalable and reconfigurable data is further comprised of a pointer manipulation circuit for receiving run-time requests to move, overlay, rotate, enlarge, or reduce a single or plurality of stored video articles, and producing the appropriate alternative referencing parameters for run-time manipulation of said video articles without physically modifying or moving their address or data.
Claim 12
Independent Claim
29 words
A system apparatus in accordance with 1 wherein said decoder means comprises a programmable decoder, a task queue, a pipeline register and buffer, and an external data interface circuit.
Claim 13
Independent Claim
29 words
A system apparatus in accordance with 1 wherein said decoder means comprises a programmable decoder, a task queue, a pipeline register and buffer, and an external data interface circuit.
Claim 14
Dependent Claim
386 words
An integrated system optimized for a video-instruction set executing a plurality of applications for the storage, retrieval and scaleable formatting of video data, comprising: first data processing means for the selective receipt of a local or remote signal, said first data processing means preprocessing the remote signal to produce a real-time frame differential bit map and microblocks subimages; first controller means producing a run time object priority assignment signal in accordance with said microblock subimages; second controller means for producing and prefetching look-ahead group instruction sequences for run-time execution of each of said microblock subimages in accordance with said run-time object priority assignment; third controller means connected to said first data processing means for producing a run-time bandwidth requirement signal for each of said microblock subimages in accordance with said frame differential bit map; second data processor means connected to said first data processor means and said second controller means for scaleable data formatting of the microblock subimage data to a compatible internal format in accordance with said run-time object priority assignment; third data processor means connected to said second data processor for encoding said compatible internal format of said microblock subimages to produce encoded microblock subimages; fourth data processor means connected to said third data processor means for packaging said encoded microblock subimages based upon said prefetched instruction-look-ahead sequences to produce packaged data, said, fourth data processor means further comprising a transmitter means for remote network transmission; scaleable and reconfiguration data memory means for receipt of said packaged data and automatically self-configuring said packaged data into a plurality of internally storable entities, said scaleable and reconfiguration data memory means comprising at least one memory cell and their associated sensing, register, control, management and interface circuits, as well as a run-time adaptive decision-making logic means for receiving a set of run-time variables corresponding to user, application, and networking conditions, and producing a run-time executable data storage configuration in order to address, store, and retrieve the most recently-optimized run-time video articles or objects; a decoder means connected to said scaleable and reconfiguration data memory and said prefetched instruction-look-ahead sequences to produce a decoded signal; and display means connected to said decoder means for post processing said decoded signal in accordance with said prefetched instruction-look-ahead sequences, said display means comprising a plurality of display, facsimile or printer adapters.
Claim 15
Dependent Claim
386 words
An integrated system optimized for a video-instruction set executing a plurality of applications for the storage, retrieval and scaleable formatting of video data, comprising: first data processing means for the selective receipt of a local or remote signal, said first data processing means preprocessing the remote signal to produce a real-time frame differential bit map and microblocks subimages; first controller means producing a run time object priority assignment signal in accordance with said microblock subimages; second controller means for producing and prefetching look-ahead group instruction sequences for run-time execution of each of said microblock subimages in accordance with said run-time object priority assignment; third controller means connected to said first data processing means for producing a run-time bandwidth requirement signal for each of said microblock subimages in accordance with said frame differential bit map; second data processor means connected to said first data processor means and said second controller means for scaleable data formatting of the microblock subimage data to a compatible internal format in accordance with said run-time object priority assignment; third data processor means connected to said second data processor for encoding said compatible internal format of said microblock subimages to produce encoded microblock subimages; fourth data processor means connected to said third data processor means for packaging said encoded microblock subimages based upon said prefetched instruction-look-ahead sequences to produce packaged data, said, fourth data processor means further comprising a transmitter means for remote network transmission; scaleable and reconfiguration data memory means for receipt of said packaged data and automatically self-configuring said packaged data into a plurality of internally storable entities, said scaleable and reconfiguration data memory means comprising at least one memory cell and their associated sensing, register, control, management and interface circuits, as well as a run-time adaptive decision-making logic means for receiving a set of run-time variables corresponding to user, application, and networking conditions, and producing a run-time executable data storage configuration in order to address, store, and retrieve the most recently-optimized run-time video articles or objects; a decoder means connected to said scaleable and reconfiguration data memory and said prefetched instruction-look-ahead sequences to produce a decoded signal; and display means connected to said decoder means for post processing said decoded signal in accordance with said prefetched instruction-look-ahead sequences, said display means comprising a plurality of display, facsimile or printer adapters.
Claim 16
Dependent Claim
66 words
The system in accordance with claim 11 wherein said first data processing means comprises a video input capturer, a graphics input bit-map adapter, a retrieval and storage register for said input signal processor, a frame differentiation processor, a motion processor, a foreground video object processor, a background image processor, at least one integrated sensor, and analog or digital preprocessor storage means for non-video related video input.
Claim 17
Dependent Claim
38 words
The system in accordance with claim 11 wherein said first controller means comprises a priority assignment circuit, a priority reassignment circuit, and an object identification processor for producing run-time media object data types conforming to run-time bandwidth availability.
Claim 18
Dependent Claim
28 words
The system in accordance with claim 11 wherein said third controller means comprises a run-time attribute processor for producing run-time compression ratio, frame rate, and a display resolution.
Claim 19
Dependent Claim
42 words
The system apparatus in accordance with claim 11 wherein said second controller means comprises a look-ahead-pipeline processor element for receiving an inbound differential video signal including bit-map, microblock, and motion detector, and producing a group of predefined instruction sequences for run-time execution.
Claim 20
Dependent Claim
82 words
The system apparatus in accordance with claim 11 wherein said second data processor means comprises an interpolating and extrapolating processor, an instruction and task prescheduler, a dynamic data formatter, a dynamic program scheduler and optimizer means, and a scaling circuit means for reformatting an inbound signal to an appropriate internal format according to the run-time bandwidth requirement, producing a coherent instruction bit-stream for encoding processing, and controller means for invoking system calls for adjusting system clock rate, and resetting other system parameters.
Claim 21
Dependent Claim
43 words
The system in accordance with claim 11 wherein said third data processing means comprises a programmable encoder, a task queue, a pipeline buffer, and an interface circuit for selective on-board or off-board encoding of an internally formatted input still or motion video signal.
Claim 22
Dependent Claim
39 words
The system apparatus in accordance with claim 11, wherein said fourth data processing means comprises a multiple layer of protocol processing and control device, a pipeline buffer and register, and address generation device, and an external data interface circuit.
Claim 23
Dependent Claim
66 words
A system apparatus in accordance with claim 11 wherein said scaleable and reconfiguration data memory means is further comprised of a pointer manipulation circuit for receiving run-time requests to move, overlay, rotate, enlarge, or reduce a single or plurality of stored video articles, and producing the appropriate alternative referencing parameters for run-time manipulation of said video articles without physically modifying or moving their address or data.
Claim 24
Dependent Claim
30 words
The system apparatus in accordance with claim 11 wherein said decoder means comprises a programmable decoder, a task queue, a pipeline register and buffer, and an external data interface circuit.
References Cited (Backward Citations)
US4375650A
Cited
US4541012A
Cited
US4920571A
Cited
US4849810A
Cited
US5144431A
Cited
US4963995A
Cited
US5057932A
Cited
US5025482A
Cited
US5307163A
Cited
US5091782A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-10-09 | 1999-04-10 | 1999-10-10 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-10-09 | 2003-04-10 | 2003-10-10 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-10-09 | 2007-04-10 | 2007-10-10 | $7700.00 | Window Closed / Lapsed |