US5883639A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Visual software engineering system and method for developing visual prototypes and for connecting user code to them
Assignee: Keysight Technologies Inc
•
Filing: 1997-07-03
•
Granted: 1999-03-16
•
Expires: 2017-07-03
Abstract
Abstract A system for providing a simple, easy to learn and flexible means of creating user interfaces to products under development without the need of a programming language or the need to learn a large set of complicated commands. The Visual Software Engineering ("VSE") system of the invention uses a simple concept of defining both input to and output from graphical objects in an object-oriented system by providing examples of what the user desires the graphical object to do. This technique is referred to herein as "animation by example". In accordance with this process, the user creates a user interface by drawing the user interface with a graphics editor and then defining the output behavior (i.e., graphics manipulation) of the user interface components by showing each state or frame as an animation. This is accomplished by changing the object using a graphic editor function such as move or rotate and storing each of the frames with the object as a behavior state. Just as with defining the output, the input is defined by giving the graphic object an example of what type of input to look for, and once it finds that input, it tells the object which frame to output or change to. Application code can then drive the animation or read the input by accessing the frame numbers assigned to each of the example frames.
Inventors
- 👤 Thomas J. Walton
- 👤 Kipper K. Fulghum
- 👤 Thomas R. Batcha
- 👤 Michael T. Juran
- 👤 Eric J. Kuzara
- 👤 Thomas F. Kraemer
- 👤 Roy L. Johnson
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-06 20:02
CPC Classifications
G; G06; G06T; G06T1/00
Claims Analysis
Total Claims: 43
Claim 1
Independent Claim
106 words
A system for creating and animating graphical objects by directly manipulating said graphical objects on a display screen, the system comprising: a graphics editor which permits a user to create and manipulate said graphical objects on said display screen; means for animating said graphical objects by storing information representing respective manipulations of said graphical objects by said user using said graphics editor as respective behavior states of said graphical objects and recreating said manipulations by specifying stored behavior states of said graphical objects corresponding to said manipulations; and means for displaying said animated graphical objects on said display screen as display states of said graphical objects.
Claim 2
Independent Claim
106 words
A system for creating and animating graphical objects by directly manipulating said graphical objects on a display screen, the system comprising: a graphics editor which permits a user to create and manipulate said graphical objects on said display screen; means for animating said graphical objects by storing information representing respective manipulations of said graphical objects by said user using said graphics editor as respective behavior states of said graphical objects and recreating said manipulations by specifying stored behavior states of said graphical objects corresponding to said manipulations; and means for displaying said animated graphical objects on said display screen as display states of said graphical objects.
Claim 3
Dependent Claim
31 words
A system as in claim 1, wherein said graphics editor comprises means for grouping at least two graphical objects into a composite graphical object and for manipulating said composite graphical object.
Claim 4
Dependent Claim
27 words
A system as in claim 2, wherein said graphics editor further comprises means for creating and managing a plurality of said graphical objects and composite graphical objects.
Claim 5
Dependent Claim
68 words
A system as in claim 1, wherein said animating means comprises a behavior editor which defines each graphical object's input behavior by selectively assigning a user defined input region, behavior state name and value to a user input operation, said behavior editor further defining each graphical object's output behavior by assigning a current behavior state of each graphical object to a user defined output state name and value.
Claim 6
Dependent Claim
30 words
A system as in claim 4, wherein said behavior editor comprises means for sending a behavior state to said graphical objects by specifying said output state name and said value.
Claim 7
Dependent Claim
77 words
A system as in claim 1, wherein said animating means comprises an example mouse input device with an associated example mouse pad for defining operations done with a hardware mouse input device with an associated hardware mouse pad, said example mouse comprising: a graphical mouse object representing said hardware mouse with said associated hardware mouse pad on said display screen; and means for manipulating said graphical mouse object so as to simulate operation of said hardware mouse.
Claim 8
Dependent Claim
152 words
A system as in claim 6, wherein said manipulating means comprises: means for pressing and releasing one or more buttons on said example mouse pad under control of said hardware mouse and associated hardware mouse pad, a button to be depressed on said example mouse pad being selected by the user by using said hardware mouse and said button on said example mouse pad being depressed by the user by depressing a corresponding button on said hardware mouse pad; and means for moving said example mouse on its associated example mouse pad under control of said hardware mouse and associated hardware mouse pad, said example mouse being selected by the user by using said hardware mouse and being moved by moving the hardware mouse such that the example mouse is moved a corresponding amount on its associated example mouse pad on said display screen relative to the movement of said hardware mouse.
Claim 9
Dependent Claim
31 words
A system as in claim 1, further comprising a library of graphical objects which are selected by the user and manipulated by said graphics editor for display on said display screen.
Claim 10
Dependent Claim
37 words
A system as in claim 1, further comprising an interface for linking the behavior states of said graphical objects created by said graphics editor to one of (a) user defined source code and (b) an external database.
Claim 11
Dependent Claim
20 words
A system as in claim 1, further comprising means for recording and playing back behavior states of said graphical objects.
Claim 12
Independent Claim
106 words
A method of creating and animating graphical objects by directly manipulating said graphical objects on a display screen using a graphics editor, comprising the steps of: drawing graphical objects with said graphics editor; manipulating said graphical objects to different display states using said graphics editor; defining output behavior for said graphical objects for said different display states of said graphical objects; storing the output behavior defined in said defining step with the corresponding graphical object for said different display states; and animating said graphical objects by designating display states to be displayed and then displaying the designated display states in a desired order as an animation.
Claim 13
Independent Claim
106 words
A method of creating and animating graphical objects by directly manipulating said graphical objects on a display screen using a graphics editor, comprising the steps of: drawing graphical objects with said graphics editor; manipulating said graphical objects to different display states using said graphics editor; defining output behavior for said graphical objects for said different display states of said graphical objects; storing the output behavior defined in said defining step with the corresponding graphical object for said different display states; and animating said graphical objects by designating display states to be displayed and then displaying the designated display states in a desired order as an animation.
Claim 14
Dependent Claim
27 words
A method as in claim 11, wherein said drawing step comprises a step of retrieving pre-drawn graphical objects having predetermined output behavior from a graphical object library.
Claim 15
Dependent Claim
41 words
A method as in claim 11, wherein said drawing step comprises a step of grouping at least two of said desired graphical objects into a composite graphical object and said manipulating step comprises a step of manipulating said composite graphical object.
Claim 16
Dependent Claim
32 words
A method as in claim 11, wherein said manipulating step comprises a step of performing at least one of moving, rotating, scaling, stretching, cutting, filling, pasting, mapping and unmapping said graphical object.
Claim 17
Dependent Claim
40 words
A method as in claim 11, wherein said defining step comprises a step of assigning respective behavior states to respective display states and said storing step comprises a step of storing said defined output behavior with a corresponding behavior state.
Claim 18
Dependent Claim
25 words
A method as in claim 15, including a further step of interpolating said output behavior for display states between respective behavior states of said animation.
Claim 19
Dependent Claim
41 words
A method as in claim 15, wherein said defining step comprises a step of defining what output behavior each graphical object has by assigning a current behavior state of each graphical object to a user defined output state name and value.
Claim 20
Dependent Claim
31 words
A method as in claim 17, wherein said animating step comprises a step of sending a behavior state to said graphical objects by specifying an output state name and said value.
Claim 21
Dependent Claim
55 words
A method as in claim 11, wherein said defining step comprises steps of defining input behavior to said graphics editor by giving a graphical object an example of a desired input to look for, and once the desired input is found, by telling the graphical object which behavior state to output or to change to.
Claim 22
Dependent Claim
24 words
A method as in claim 19, including a further step of interpolating said input behavior for input regions between respective user defined input regions.
Claim 23
Dependent Claim
39 words
A method as in claim 19, wherein said defining step comprises a step of defining what input behavior each graphical object has by assigning a user defined input region, input state name and value to a user input operation.
Claim 24
Dependent Claim
56 words
A method as in claim 11, wherein said animating step comprises a step of receiving the behavior states of said graphical objects as input from a user's application program and linking the behavior states of said graphical objects created by said graphics editor to one of (a) user defined source code and (b) an external database.
Claim 25
Dependent Claim
84 words
A method as in claim 11, comprising a further step of creating an example mouse input device with an associated example mouse pad to define operations done with a hardware mouse input device with an associated hardware mouse pad, said example mouse creating step comprising the steps of: creating a graphical mouse object representing said hardware mouse with said associated hardware mouse pad on said display screen; and manipulating said graphical mouse object so as to simulate operation of said hardware mouse input device.
Claim 26
Dependent Claim
142 words
A method as in claim 23, wherein said manipulating step comprises the steps of: pressing and releasing one or more buttons on said example mouse pad under control of said hardware mouse and associated hardware mouse pad, comprising the steps of selecting a button to be depressed on said example mouse pad using said hardware mouse and depressing said button on said example mouse pad by depressing a corresponding button on said hardware mouse pad; and moving said example mouse on its associated example mouse pad under control of said hardware mouse and associated hardware mouse pad, comprising the steps of selecting said example mouse using said hardware mouse and moving the hardware mouse such that the example mouse is moved a corresponding amount on its associated example mouse pad on said display screen relative to the movement of said hardware mouse.
Claim 27
Dependent Claim
15 words
A method as in claim 11, comprising further steps of saving and replaying said animation.
Claim 28
Independent Claim
167 words
A method of defining user input to graphical objects as respective behavior states of said graphical objects, comprising the steps of: defining at least one region on a display screen relative to each graphical object which receives user input; describing what input event types for said at least one region relative to each of said graphical objects simulate output behavior states of said graphical objects which control output behavior for said graphical objects; defining desired input behavior states for said graphical objects which simulate said output behavior states of said graphical objects; storing the input behavior states defined in said input behavior states defining step with corresponding graphical objects for respective output behavior states; and applying the input behavior states defined in said input behavior states defining step to said graphical objects so as to cause a change in at least one output behavior state of at least one of said graphical objects, thereby changing a display state of said at least one of said graphical objects.
Claim 29
Independent Claim
167 words
A method of defining user input to graphical objects as respective behavior states of said graphical objects, comprising the steps of: defining at least one region on a display screen relative to each graphical object which receives user input; describing what input event types for said at least one region relative to each of said graphical objects simulate output behavior states of said graphical objects which control output behavior for said graphical objects; defining desired input behavior states for said graphical objects which simulate said output behavior states of said graphical objects; storing the input behavior states defined in said input behavior states defining step with corresponding graphical objects for respective output behavior states; and applying the input behavior states defined in said input behavior states defining step to said graphical objects so as to cause a change in at least one output behavior state of at least one of said graphical objects, thereby changing a display state of said at least one of said graphical objects.
Claim 30
Dependent Claim
28 words
A method as in claim 26, wherein said region defining step comprises a step of having a user demarcate a region relative to each of said graphical objects.
Claim 31
Dependent Claim
52 words
A method as in claim 27, wherein said demarcating step comprises a step of using an example mouse input device with an associated example mouse pad which simulates operation of a hardware mouse input device with an associated hardware mouse pad for selecting said region relative to each of said graphical objects.
Claim 32
Dependent Claim
40 words
A method as in claim 26, comprising the further step of retrieving graphical objects with predetermined input behavior states from a library and assigning input behavior of retrieved graphical objects to said graphical objects being described in said describing step.
Claim 33
Dependent Claim
36 words
A method as in claim 26, wherein said describing step comprises a step of performing at least one of pressing an input device, releasing said input device, toggling said input device, and moving said input device.
Claim 34
Dependent Claim
46 words
A method as in claim 30, wherein said performing step comprises a step of selectively pressing, releasing, toggling and moving an example mouse input device with an associated example mouse pad which simulates operation of a hardware mouse input device with an associated hardware mouse pad.
Claim 35
Dependent Claim
60 words
A method as in claim 30, wherein said input behavior states defining step comprises a step of associating a graphical object with an input from said input device in said at least one region relative to said graphical object and with an input behavior state, and said storing step comprises a step of storing said association with said graphical object.
Claim 36
Dependent Claim
51 words
A method as in claim 26, wherein said applying step comprises steps of routing said user input to an appropriate graphical object and sending from said appropriate graphical object an associated input behavior state to all graphical objects so that all graphical objects have corresponding display states for said user input.
Claim 37
Dependent Claim
33 words
A method as in claim 26, comprising a further step of interpolating said defined input behavior states with said user input to create new input behavior states between previously defined input behavior states.
Claim 38
Dependent Claim
16 words
A method as in claim 26, comprising further steps of saving and replaying said user input.
Claim 39
Independent Claim
156 words
A method of enabling a user to create and animate a graphical user interface, by providing examples of what the user intends one or more graphical objects in the graphical user interface to do in response to user input, the method comprising steps of: creating an arbitrary graphical user interface, using a graphics editor, by first drawing the graphical user interface as a collection of first states of graphical objects, said first states including a first state of a first graphical object; manipulating the first graphical object, via the graphics editor, to a second state of the first graphical object, wherein together, the first state of the first graphical object, the second state of the first graphical object, and the manipulation, define an exemplary output behavior for the first graphical object; connecting user input to the exemplary output behavior for the first graphical object; and animating the first graphical object in response to the user input.
Claim 40
Independent Claim
156 words
A method of enabling a user to create and animate a graphical user interface, by providing examples of what the user intends one or more graphical objects in the graphical user interface to do in response to user input, the method comprising steps of: creating an arbitrary graphical user interface, using a graphics editor, by first drawing the graphical user interface as a collection of first states of graphical objects, said first states including a first state of a first graphical object; manipulating the first graphical object, via the graphics editor, to a second state of the first graphical object, wherein together, the first state of the first graphical object, the second state of the first graphical object, and the manipulation, define an exemplary output behavior for the first graphical object; connecting user input to the exemplary output behavior for the first graphical object; and animating the first graphical object in response to the user input.
Claim 41
Dependent Claim
13 words
A method as in claim 36, wherein the user input is application code.
Claim 42
Dependent Claim
69 words
A method as in claim 36, wherein: the first state of the first graphical object corresponds to a first frame in an animation sequence; and the second state of the first graphical object corresponds to a second frame in the animation sequence; and wherein the method further comprises a step of: generating additional frames of the animation sequence by interpolating the exemplary output behavior for the first graphical object.
Claim 43
Dependent Claim
42 words
A method as in claim 36, wherein the step of manipulating the first graphical object to a second state comprises a step of performing at least one of moving, rotating, scaling, stretching, cutting, filling, pasting, mapping and unmapping the first graphical object.
References Cited (Backward Citations)
US4827404A
Cited
US4901221A
Cited
US4870561A
Cited
US4914568A
Cited
US5041992A
Cited
US5261820A
Cited
US5261041A
Cited
US5485600A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-03-15 | 2002-09-14 | 2003-03-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-03-15 | 2006-09-14 | 2007-03-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-03-15 | 2010-09-14 | 2011-03-16 | $7700.00 | Window Closed / Lapsed |