US5758122A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Immersive visual programming system
Assignee: NAVY UNITED STATES OF AMERICAS THE, Secretary of
•
Filing: 1995-03-16
•
Granted: 1998-05-26
•
Expires: 2015-03-16
Abstract
Abstract A method for programming and executing a computer program in an immersive sual programming environment, i.e., virtual reality environment, includes steps for assembling data objects and algorithmic components selected from a set of prefabricated virtual components to construct the computer program, compiling the computer program, and executing the computer program by initiating sequential flow of data objects through the algorithmic components. According to one aspect of the invention, the compiling step is performed while providing visual and audio clues to a user in response to a determined compiler error; the clues indicate the location and nature of the detected compiler error. Additionally, the executing step permits the flow of data objects and the interaction among the data objects to be visually displayed to the user. An apparatus suitable for performing the program and execution of a computer program in a virtual reality environment is also described.
Inventors
- 👤 Albert J. Corda
- 👤 Michael J. Kuchinski
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 16:33
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/011; G06F8/00; G06F8/30; G06F8/34
Claims Analysis
Total Claims: 37
Claim 1
Independent Claim
135 words
A method for programming and executing a computer program in an immersive visual programming environment, said method comprising the steps of: assembling data objects and algorithmic components selected from a set of pre-fabricated virtual components to construct the computer program; compiling the computer program while providing visual and audio clues to a user in response to a detected compiler error, said clues indicating a location and nature of the detected compiler error, and executing the computer program by initiating sequential flow of said data objects through said algorithmic components wherein the flow of said data objects and interaction among respective ones of said data objects is visually displayed to the user, wherein a visible execution pointer moves through the assembled algorithmic components during the execution step to indicate an instruction that is currently being performed.
Claim 2
Independent Claim
135 words
A method for programming and executing a computer program in an immersive visual programming environment, said method comprising the steps of: assembling data objects and algorithmic components selected from a set of pre-fabricated virtual components to construct the computer program; compiling the computer program while providing visual and audio clues to a user in response to a detected compiler error, said clues indicating a location and nature of the detected compiler error, and executing the computer program by initiating sequential flow of said data objects through said algorithmic components wherein the flow of said data objects and interaction among respective ones of said data objects is visually displayed to the user, wherein a visible execution pointer moves through the assembled algorithmic components during the execution step to indicate an instruction that is currently being performed.
Claim 3
Dependent Claim
46 words
The method for programming and executing a computer program as claimed in claim 1, further comprising the steps of providing said visual and audio clues to the user during the execution of the computer program to indicate the nature and location of a detected run-time error.
Claim 4
Dependent Claim
47 words
The method for programming and executing a computer program as claimed in claim 1, wherein said data objects each comprise a closed surface possessing a set of user-defined attributes defining the interaction of the respective closed surface with other data objects within the immersive visual programming environment.
Claim 5
Dependent Claim
46 words
The method for programming and executing a computer program as claimed in claim 3, wherein said set of attributes of said closed surface is modified in response to the interaction of the respective closed surface with the other data objects within the immersive visual programming environment.
Claim 6
Dependent Claim
60 words
The method for programming and executing a computer program as claimed in claim 1, wherein said data objects each comprise a predetermined number of nested boundary surfaces wherein each one of said nested boundary surfaces possesses a set of user-defined attributes defining the interaction of the respective nested boundary surface with other data objects within the immersive visual programming environment.
Claim 7
Dependent Claim
51 words
The method for programming and executing a computer program as claimed in claim 5, wherein said set of attributes of each one of said nested boundary surfaces is modified in response to the interaction of the respective nested boundary surface with the other data objects within the immersive visual programming environment.
Claim 8
Dependent Claim
65 words
The method for programming and executing a computer program as claimed in claim 1, further comprised of said algorithmic components each having an ingress surface and an egress surface through which said data objects enter and exit, respectively, said ingress surface and said egress surface each exhibiting varying degrees of transparency in dependence upon said data objects' varying ability to pass through each respective surface.
Claim 9
Dependent Claim
54 words
The method for programming and executing a computer program as claimed in claim 1, further comprised of said assembling step being performed by grasping and placing said pre-fabricated virtual components within the immersive visual programming environment using a data glove that provides tactile feedback in dependence upon the placement of said pre-fabricated virtual components.
Claim 10
Dependent Claim
48 words
The method for programming and executing a computer program as claimed in claim 1, wherein a single identifier data object is represented in the immersive visual programming environment by a three-dimensional, disk-like object having an identifier name on an outer surface and a value within an inner portion.
Claim 11
Dependent Claim
49 words
The method for programming and executing a computer program as claimed in claim 9, wherein said single identifier data object representative of a variable quantity is capable of being physically opened by the user during the execution of the computer program to change the value within said inner portion.
Claim 12
Dependent Claim
34 words
The method for programming and executing a computer program as claimed in claim 9, wherein each separate numeric type of said single identifier data object is indicated to the user by a separate color.
Claim 13
Dependent Claim
31 words
The method for programming and executing a computer program as claimed in claim 1, wherein said algorithmic components comprise a sequential structure visually represented by a cube having transparent lateral surfaces.
Claim 14
Dependent Claim
50 words
The method for programming and executing a computer program as claimed in claim 1, wherein said algorithmic components comprise a conditional branching structure visually represented by a cylindrical chamber, said cylindrical chamber being rotatable during the execution step to align with an execution path for passage of said data objects.
Claim 15
Independent Claim
174 words
A method for programming and executing a computer program in an immersive visual programming environment, said method comprising the steps of: assembling data objects and algorithmic components selected from a set of pre-fabricated virtual components to construct the computer program; compiling the computer program while providing visual and audio clues to a user in response to a detected compiler error, said clues indicating a location and nature of the detected compiler error; executing the computer program by initiating sequential flow of said data objects through said algorithmic components wherein said flow of said data objects and interaction among respective ones of said data objects is visually displayed to the user, said flow of said data objects being indicated by a visible execution pointer that moves through said algorithmic components during execution of the computer program to indicate an instruction that is currently being performed; and providing one of said visual and audio clues to the user during the execution of the computer program to indicate a location and nature of a detected run-time error.
Claim 16
Independent Claim
174 words
A method for programming and executing a computer program in an immersive visual programming environment, said method comprising the steps of: assembling data objects and algorithmic components selected from a set of pre-fabricated virtual components to construct the computer program; compiling the computer program while providing visual and audio clues to a user in response to a detected compiler error, said clues indicating a location and nature of the detected compiler error; executing the computer program by initiating sequential flow of said data objects through said algorithmic components wherein said flow of said data objects and interaction among respective ones of said data objects is visually displayed to the user, said flow of said data objects being indicated by a visible execution pointer that moves through said algorithmic components during execution of the computer program to indicate an instruction that is currently being performed; and providing one of said visual and audio clues to the user during the execution of the computer program to indicate a location and nature of a detected run-time error.
Claim 17
Dependent Claim
47 words
The method for programming and executing a computer program as claimed in claim 14, wherein said data objects each comprise a closed surface possessing a set of user-defined attributes defining the interaction of the respective closed surface with other data objects within the immersive visual programming environment.
Claim 18
Dependent Claim
46 words
The method for programming and executing a computer program as claimed in claim 15, wherein said set of attributes of said closed surface is modified in response to the interaction of the respective closed surface with the other data objects within the immersive visual programming environment.
Claim 19
Dependent Claim
60 words
The method for programming and executing a computer program as claimed in claim 14, wherein said data objects each comprise a predetermined number of nested boundary surfaces wherein each one of said nested boundary surfaces possesses a set of user-defined attributes defining the interaction of the respective nested boundary surface with other data objects within the immersive visual programming environment.
Claim 20
Dependent Claim
51 words
The method for programming and executing a computer program as claimed in claim 17, wherein said set of attributes of each one of said nested boundary surfaces is modified in response to the interaction of the respective nested boundary surface with the other data objects within the immersive visual programming environment.
Claim 21
Dependent Claim
65 words
The method for programming and executing a computer program as claimed in claim 14, further comprised of said algorithmic components each having an ingress surface and an egress surface through which said data objects enter and exit, respectively, said ingress surface and said egress surface each exhibiting varying degrees of transparency in dependence upon said data objects' varying ability to pass through each respective surface.
Claim 22
Dependent Claim
52 words
The method for programming and executing a computer program as claimed in claim 19, further comprised of said egress surface of a first one of said algorithmic components exhibiting a magnetic-like attraction towards said ingress surface of a second one of said algorithmic components during the assembly step to indicate proper syntax.
Claim 23
Dependent Claim
51 words
The method for programming and executing a computer program as claimed in claim 19, further comprised of said egress surface of a first one of said algorithmic components exhibiting a repulsion towards said ingress surface of a second one of said algorithmic components during the assembly step to indicate improper syntax.
Claim 24
Dependent Claim
40 words
The method for programming and executing a computer program as claimed in claim 14, further comprised of said assembling step being performed by grasping and placing said pre-fabricated virtual components within the immersive visual programming environment using a data glove.
Claim 25
Dependent Claim
48 words
The method for programming and executing a computer program as claimed in claim 14, wherein a single identifier data object is represented in the immersive visual programming environment by a three-dimensional, disk-like object having an identifier name on an outer surface and a value within an inner portion.
Claim 26
Dependent Claim
49 words
The method for programming and executing a computer program as claimed in claim 23, wherein said single identifier data object representative of a variable quantity is capable of being physically opened by the user during the execution of the computer program to change the value within said inner portion.
Claim 27
Dependent Claim
34 words
The method for programming and executing a computer program as claimed in claim 23, wherein each separate numeric type of said single identifier data object is indicated to the user by a separate color.
Claim 28
Independent Claim
238 words
A method for programming and executing a computer program in an immersive visual programming environment, said method comprising the steps of: assembling data objects and algorithmic components selected from a set of pre-fabricated virtual components to construct the computer program, said data objects each comprising a closed surface possessing a set of user-defined attributes defining interactions of the respective closed surface with other data objects within the immersive visual programming environment, said assembling step being performed by grasping and placing said pre-fabricated virtual components within the immersive visual programming environment using a data glove that provides tactile feedback in dependence upon the placement of said pre-fabricated virtual components; compiling the computer program while providing one of visual and audio clues to the user in response to a detected compiler error, said clues indicating a location and nature of the detected compiler error; executing the computer program by initiating sequential flow of said data objects through said algorithmic components wherein said flow of said data objects and interaction among respective ones of said data objects is visually displayed to the user, said flow of said data objects being indicated by a visible execution pointer that moves through said algorithmic components to indicate an instruction that is currently being performed; and providing one of said visual and audio clues to the user during the execution of the computer program to indicate a location and nature of a detected run-time error.
Claim 29
Independent Claim
238 words
A method for programming and executing a computer program in an immersive visual programming environment, said method comprising the steps of: assembling data objects and algorithmic components selected from a set of pre-fabricated virtual components to construct the computer program, said data objects each comprising a closed surface possessing a set of user-defined attributes defining interactions of the respective closed surface with other data objects within the immersive visual programming environment, said assembling step being performed by grasping and placing said pre-fabricated virtual components within the immersive visual programming environment using a data glove that provides tactile feedback in dependence upon the placement of said pre-fabricated virtual components; compiling the computer program while providing one of visual and audio clues to the user in response to a detected compiler error, said clues indicating a location and nature of the detected compiler error; executing the computer program by initiating sequential flow of said data objects through said algorithmic components wherein said flow of said data objects and interaction among respective ones of said data objects is visually displayed to the user, said flow of said data objects being indicated by a visible execution pointer that moves through said algorithmic components to indicate an instruction that is currently being performed; and providing one of said visual and audio clues to the user during the execution of the computer program to indicate a location and nature of a detected run-time error.
Claim 30
Dependent Claim
46 words
The method for programming and executing a computer program as claimed in claim 26, wherein said set of attributes of said closed surface is modified in response to the interaction of the respective closed surface with the other data objects within the immersive visual programming environment.
Claim 31
Dependent Claim
61 words
The method for programming and executing a computer program as claimed in claim 26, wherein said data objects each further comprise a predetermined number of nested boundary surfaces wherein each one of said nested boundary surfaces possesses a set of user-defined attributes defining the interaction of the respective nested boundary surface with other data objects within the immersive visual programming environment.
Claim 32
Dependent Claim
51 words
The method for programming and executing a computer program as claimed in claim 26, wherein said set of attributes of each one of said nested boundary surfaces is modified in response to the interaction of the respective nested boundary surface with the other data objects within the immersive visual programming environment.
Claim 33
Dependent Claim
65 words
The method for programming and executing a computer program as claimed in claim 26, further comprised of said algorithmic components each having an ingress surface and an egress surface through which said data objects enter and exit, respectively, said ingress surface and said egress surface each exhibiting varying degrees of transparency in dependence upon said data objects' varying ability to pass through each respective surface.
Claim 34
Dependent Claim
52 words
The method for programming and executing a computer program as claimed in claim 30, further comprised of said egress surface of a first one of said algorithmic components exhibiting a magnetic-like attraction towards said ingress surface of a second one of said algorithmic components during the assembly step to indicate proper syntax.
Claim 35
Dependent Claim
51 words
The method for programming and executing a computer program as claimed in claim 30, further comprised of said egress surface of a first one of said algorithmic components exhibiting a repulsion towards said ingress surface of a second one of said algorithmic components during the assembly step to indicate improper syntax.
Claim 36
Dependent Claim
240 words
A computer programming system for creating and executing a computer program in an immersive visual programming environment, said system comprising: means for assembling data objects and algorithmic components selected from a set of pre-fabricated virtual components to construct the computer program, said data objects each comprising a closed surface possessing a set of user-defined attributes defining interactions of the respective closed surface with other data objects within the immersive visual programming environment, said pre-fabricated virtual components being grasped and placed within the immersive visual programming environment using a data glove that provides tactile feedback in dependence upon the placement of said pre-fabricated virtual components; means for compiling the computer program while providing one of visual and audio clues to the user in response to a detected compiler error, said clues indicating a location and nature of the detected compiler error; means for executing the computer program by initiating sequential flow of said data objects through said algorithmic components wherein said flow of said data objects and interaction among respective ones of said data objects is visually displayed to the user, said flow of said data objects being indicated by a visible execution pointer that moves through said algorithmic components to indicate an instruction that is currently being performed; and means for providing one of said visual and audio clues to the user during the execution of the computer program to indicate a location and nature of a detected run-time error.
Claim 37
Dependent Claim
240 words
A computer programming system for creating and executing a computer program in an immersive visual programming environment, said system comprising: means for assembling data objects and algorithmic components selected from a set of pre-fabricated virtual components to construct the computer program, said data objects each comprising a closed surface possessing a set of user-defined attributes defining interactions of the respective closed surface with other data objects within the immersive visual programming environment, said pre-fabricated virtual components being grasped and placed within the immersive visual programming environment using a data glove that provides tactile feedback in dependence upon the placement of said pre-fabricated virtual components; means for compiling the computer program while providing one of visual and audio clues to the user in response to a detected compiler error, said clues indicating a location and nature of the detected compiler error; means for executing the computer program by initiating sequential flow of said data objects through said algorithmic components wherein said flow of said data objects and interaction among respective ones of said data objects is visually displayed to the user, said flow of said data objects being indicated by a visible execution pointer that moves through said algorithmic components to indicate an instruction that is currently being performed; and means for providing one of said visual and audio clues to the user during the execution of the computer program to indicate a location and nature of a detected run-time error.
References Cited (Backward Citations)
US4849880A
Cited
US4845633A
Cited
US5481740A
Cited
US5481741A
Cited
US5301336A
Cited
US4797694A
Cited
US5021976A
Cited
US5313575A
Cited
US5186629A
Cited
US5512919A
Cited
US5517663A
Cited
US5555354A
Cited
US5429140A
Cited
US5325533A
Cited
US5519866A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-05-25 | 2001-11-24 | 2002-05-26 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-05-25 | 2005-11-24 | 2006-05-26 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-05-25 | 2009-11-24 | 2010-05-26 | $7700.00 | Window Closed / Lapsed |