US5954516A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method of using question writing to test mastery of a body of knowledge
Assignee: PRO LEARNERS LLC
•
Filing: 1997-03-14
•
Granted: 1999-09-21
•
Expires: 2017-03-14
Abstract
Abstract A person's mastery of a body of knowledge is determined by having the person write objective questions for a test that is given to a group of test takers. The results of the test are then analyzed to determine how well the person's questions discriminated between those who did well on the test and those who did poorly. The better the questions discriminate, the more mastery the person has of the body of knowledge. In a learning situation, a cycle of study, writing questions, analyzing the results, and determining mastery may be repeated until the desired degree of mastery is reached. The technique may be used for individuals or groups and both the question writers and the test takers may work in teams. Question writers may also be test takers, and the evaluation of a question writer may reflect both the extent to which his or her questions discriminate and his or her performance on the test. Any medium may be used for communication between the question writers, test takers, and the parties making and giving the tests. One particularly active alternative is communication via electronic mail, with test taking being done interactively on the Internet.
Inventors
- 👤 Paul Heinberg
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 17:19
CPC Classifications
G; G09; G09B; G09B7/00; G09B7/06; G09B7/066; G09B3/00; G09B3/06
Claims Analysis
Total Claims: 25
Claim 1
Independent Claim
109 words
A method of determining a degree of mastery by a person of a body of knowledge, the method comprising the steps of: receiving objective test items about the body of knowledge from the person; making an objective test incorporating the test items; administering the test to a group of test takers; analyzing the graded tests objectively to determine for each test item the extent to which the test item has a quality indicating mastery of the subject matter by the person; and basing an objective indication of the degree of mastery by the person at least in part on the degree to which the test items have the quality.
Claim 2
Independent Claim
109 words
A method of determining a degree of mastery by a person of a body of knowledge, the method comprising the steps of: receiving objective test items about the body of knowledge from the person; making an objective test incorporating the test items; administering the test to a group of test takers; analyzing the graded tests objectively to determine for each test item the extent to which the test item has a quality indicating mastery of the subject matter by the person; and basing an objective indication of the degree of mastery by the person at least in part on the degree to which the test items have the quality.
Claim 3
Dependent Claim
44 words
The method set forth in claim 1 wherein: in the step of analyzing the graded tests, the quality includes the degree to which the item discriminates between test takers who do well on the test and test takers who do poorly on the test.
Claim 4
Dependent Claim
92 words
The method set forth in claim 2 wherein each objective test item includes an indication of a correct response, the method further comprises the step of: ranking the test takers according to the number of correct responses on their tests; and the step of analyzing the graded tests includes the steps of; using the ranking to determine a first group of test takers who did well and a second group who did poorly; and using the first group and the second group to determine the degree of discrimination for the test items.
Claim 5
Dependent Claim
28 words
The method set forth in claim 3 wherein: the step of using a ranking to determine a first group and a second group determines groups of equal size.
Claim 6
Dependent Claim
25 words
The method set forth in claim 4 wherein: each of the first and second groups contains on the order of 27% of the test takers.
Claim 7
Dependent Claim
54 words
The method set forth in claim 3 wherein: the step of analyzing the graded tests further includes the step of: using the first and second groups to determine a degree of difficulty for the test items; and the step of basing an objective indication further bases the objective indication on the degree of difficulty.
Claim 8
Dependent Claim
36 words
The method set forth in claim 3 further comprising the step of: basing an objective indication of a degree of mastery of the subject matter by each test taker on the rank of the test taker.
Claim 9
Dependent Claim
69 words
The method set forth in claim 7 further comprising the steps of: ranking the test items on the basis of how well the test items discriminate; defining a refined test that contains only those test items which discriminate better than a given degree; and basing the objective indication on the rank of the test takers according to the number of correct responses to the questions in the refined test.
Claim 10
Dependent Claim
83 words
The method set forth in claim 3 wherein there is a plurality of persons whose degree of mastery is to be determined and the step of basing an objective indication of the degree of mastery further comprises the steps of: determining an item power for each item which indicates at least a degree to which the item discriminates; for each person, determining an average item power for the items received from the person; and ranking the persons according to the average item power.
Claim 11
Dependent Claim
30 words
The method set forth in claim 3 further comprising the step of: terminating the method if the ranking does not permit determination of the first group and the second group.
Claim 12
Dependent Claim
27 words
The method set forth in claim 2 wherein: in the step of analyzing the graded tests, the quality further includes a difficulty measure for the test items.
Claim 13
Dependent Claim
55 words
The method set forth in claim 1 wherein each objective test item includes an indication of a correct response and the method further comprises the step of: basing an objective indication of a degree of mastery of the subject matter by the test takers on the number of correct responses made by the test taker.
Claim 14
Dependent Claim
88 words
The method set forth in claim 1 wherein there is a plurality of persons whose degree of mastery is to be determined and the step of basing an objective indication of the degree of mastery further comprises the steps of: determining an item power for each item which indicates at least a degree to which the item has the quality; for each person, determining an average item power for the items received from the person; and ranking the persons according to the average item power for their items.
Claim 15
Dependent Claim
41 words
The method set forth in claim 1 and further comprising the steps of: objectively determining whether the objective indication of the degree of mastery indicates sufficient mastery and if it does not, repeating the steps of the method with the person.
Claim 16
Dependent Claim
23 words
The method set forth in claim 1 wherein: at least the step of analyzing the graded tests is performed using a computer system.
Claim 17
Dependent Claim
22 words
The method set forth in claim 15 wherein: the step of basing an objective indication is further performed using a computer system.
Claim 18
Dependent Claim
47 words
The method set forth in claim 16 further comprising the step of: sending the objective indication to the person and wherein the steps of receiving the objective test items from the person, administering the test, and sending the objective indication are all performed using a data network.
Claim 19
Dependent Claim
69 words
The method set forth in claim 17 wherein each objective test item includes an indication of a correct response and the method further comprises the steps of: basing an objective indication of a degree of mastery of the subject matter by the test takers on the number of correct responses made by the test taker; and using a data network to send the objective indication to the test takers.
Claim 20
Dependent Claim
54 words
The method set forth in claim 2 wherein: there is a plurality of persons whose degree of mastery is to be determined; a plurality of tests are made in the step of making an objective test; and in the step of administering the test, the group of test takers includes the plurality of persons.
Claim 21
Dependent Claim
34 words
The method set forth in claim 19 wherein: in the step of administering the test, a test is not administered to a person from whom a test item used in the test was received.
Claim 22
Dependent Claim
56 words
The method set forth in claim 19 wherein: the method further comprises the step of ranking the test takers according to how well they did on the test; and in the step of basing an objective indication of the degree of mastery, the objective indication is further based on how the persons ranked as test takers.
Claim 23
Dependent Claim
65 words
The method set forth in claim 1 wherein: there is a plurality of persons whose degree of mastery is to be determined; in the step of receiving the test items, the test items are received from teams of the persons; and in the step of basing an objective indication, the objective indication is an objective indication for the team from whom the question was received.
Claim 24
Dependent Claim
47 words
The method set forth in claim 22 wherein: in the step of administering the tests, the tests are administered to teams of test takers; and the method further includes the step of ranking the teams of test takers according to how well they did on the test.
Claim 25
Dependent Claim
28 words
The method set forth in claim 1 wherein: in the step of administering the tests, the access of the test takers to the body of knowledge is restricted.
References Cited (Backward Citations)
US4247995A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-09-20 | 2003-03-22 | 2003-09-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-09-20 | 2007-03-22 | 2007-09-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-09-20 | 2011-03-22 | 2011-09-21 | $7700.00 | Window Closed / Lapsed |