US5718591A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for providing performance feedback to test resolvers
Assignee: NCS Pearson Inc
•
Filing: 1995-11-20
•
Granted: 1998-02-17
•
Expires: 2015-11-20
Abstract
Abstract A method for managing resolvers of test answers to maintain consistent and efficient test scoring of the answers. The method monitors test resolver performance in order to provide feedback. By tracking a resolver's scoring rate to compile performance data, the method monitors efficiency and optionally recommends break times and provides the resolver with diversionary activities during breaks.
Inventors
- 👤 Jay V. Clark
- 👤 William L. Bramlett, Jr.
- 👤 Judith Moyer
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 09:28
CPC Classifications
G; G09; G09B; G09B7/00; G09B7/02; G09B7/06; G09B7/066; Y; Y10; Y10S; Y10S706/00; Y10S706/902; Y10S706/927
Claims Analysis
Total Claims: 30
Claim 1
Independent Claim
85 words
A method for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the method comprising the steps of: a) electronically receiving information related to a first performance level of a first resolver's scoring of test answers, and a predetermined performance level; b) electronically comparing the first performance level and the predetermined performance level; and c) electronically reporting a discrepancy based on predefined criteria between the first performance level and the predetermined performance level.
Claim 2
Independent Claim
85 words
A method for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the method comprising the steps of: a) electronically receiving information related to a first performance level of a first resolver's scoring of test answers, and a predetermined performance level; b) electronically comparing the first performance level and the predetermined performance level; and c) electronically reporting a discrepancy based on predefined criteria between the first performance level and the predetermined performance level.
Claim 3
Dependent Claim
23 words
The method of claim 1 wherein the step of electronically reporting a discrepancy comprises electronically reporting the discrepancy to the first test resolver.
Claim 4
Dependent Claim
22 words
The method of claim 1 wherein the step of electronically reporting a discrepancy comprises electronically reporting the discrepancy to a system manager.
Claim 5
Independent Claim
86 words
A method for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the method comprising the steps of: a) electronically receiving information related to a first test-score validity level of a first resolver's scoring of test answers, and a predetermined validity level; b) electronically comparing the first validity level and the predetermined validity level; and c) electronically reporting a discrepancy based on predefined criteria between the first validity level and the predetermined validity level.
Claim 6
Independent Claim
86 words
A method for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the method comprising the steps of: a) electronically receiving information related to a first test-score validity level of a first resolver's scoring of test answers, and a predetermined validity level; b) electronically comparing the first validity level and the predetermined validity level; and c) electronically reporting a discrepancy based on predefined criteria between the first validity level and the predetermined validity level.
Claim 7
Dependent Claim
33 words
The method of claim 4 wherein the step of electronically receiving information comprises receiving a test score for a quality item from the first resolver and a known score for the quality item.
Claim 8
Dependent Claim
23 words
The method of claim 4 wherein the step of electronically reporting a discrepancy comprises electronically reporting the discrepancy to the first test resolver.
Claim 9
Dependent Claim
22 words
The method of claim 4 wherein the step of electronically reporting a discrepancy comprises electronically reporting the discrepancy to a system manager.
Claim 10
Independent Claim
85 words
A method for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the method comprising the steps of: a) electronically receiving information related to a first reliability level of a first resolver's scoring of test answers, and a predetermined reliability level; b) electronically comparing the first reliability level and the predetermined reliability level; and c) electronically reporting a discrepancy based on predefined criteria between the first reliability level and the predetermined reliability level.
Claim 11
Independent Claim
85 words
A method for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the method comprising the steps of: a) electronically receiving information related to a first reliability level of a first resolver's scoring of test answers, and a predetermined reliability level; b) electronically comparing the first reliability level and the predetermined reliability level; and c) electronically reporting a discrepancy based on predefined criteria between the first reliability level and the predetermined reliability level.
Claim 12
Dependent Claim
53 words
The method of claim 8 wherein the step of electronically receiving information comprises receiving a first score corresponding to the first resolver's scoring of a test item during a first time period and for receiving a second score corresponding to the first resolver's scoring of the test item during a second time period.
Claim 13
Dependent Claim
23 words
The method of claim 8 wherein the step of electronically reporting a discrepancy comprises electronically reporting the discrepancy to the first test resolver.
Claim 14
Dependent Claim
22 words
The method of claim 8 wherein the step of electronically reporting a discrepancy comprises electronically reporting the discrepancy to a system manager.
Claim 15
Independent Claim
85 words
A method for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the method comprising the steps of: a) electronically receiving information related to a first speed level of a first resolver's scoring of test answers, and a predetermined speed level; b) electronically comparing the first speed level and the predetermined speed level; and c) electronically reporting a discrepancy based on predefined criteria between the first speed level and the predetermined speed level.
Claim 16
Independent Claim
85 words
A method for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the method comprising the steps of: a) electronically receiving information related to a first speed level of a first resolver's scoring of test answers, and a predetermined speed level; b) electronically comparing the first speed level and the predetermined speed level; and c) electronically reporting a discrepancy based on predefined criteria between the first speed level and the predetermined speed level.
Claim 17
Dependent Claim
64 words
The method of claim 12 wherein the step of electronically receiving information comprises receiving at least one of the following: a first scoring rate corresponding to the first resolver's scoring of the test answers, an average scoring rate corresponding to a selected group of resolvers'scoring of the test answers, and a second scoring rate corresponding to a second resolver's scoring of the test answers.
Claim 18
Dependent Claim
23 words
The method of claim 12 wherein the step of electronically reporting a discrepancy comprises electronically reporting the discrepancy to the first test resolver.
Claim 19
Dependent Claim
22 words
The method of claim 12 wherein the step of electronically reporting a discrepancy comprises electronically reporting the discrepancy to a system manager.
Claim 20
Independent Claim
106 words
A method for increasing test resolver efficiency by monitoring test resolver performance in scoring test answers and recommending break times to the test resolvers, the method comprising the steps of: a) electronically receiving first performance levels corresponding to a test resolver's scoring of test answers at predetermined past intervals in time, and electronically receiving a second predetermined performance level; b) electronically comparing the second predetermined performance level and the first performance level; and c) electronically detecting a discrepancy based on predefined criteria between the second predetermined performance level and the first performance level and signalling the test resolver to halt test scoring for a break time.
Claim 21
Independent Claim
106 words
A method for increasing test resolver efficiency by monitoring test resolver performance in scoring test answers and recommending break times to the test resolvers, the method comprising the steps of: a) electronically receiving first performance levels corresponding to a test resolver's scoring of test answers at predetermined past intervals in time, and electronically receiving a second predetermined performance level; b) electronically comparing the second predetermined performance level and the first performance level; and c) electronically detecting a discrepancy based on predefined criteria between the second predetermined performance level and the first performance level and signalling the test resolver to halt test scoring for a break time.
Claim 22
Dependent Claim
32 words
The method of claim 16 wherein the step of electronically receiving first performance levels comprises electronically receiving first validity levels from the test resolver and electronically receiving a second predetermined validity level.
Claim 23
Dependent Claim
32 words
The method of claim 16 wherein the step of electronically receiving first performance levels comprises electronically receiving first reliability levels from the test resolver and electronically receiving a second predetermined reliability level.
Claim 24
Dependent Claim
32 words
The method of claim 16 wherein the step of electronically receiving first performance levels comprises electronically receiving first speed levels from the test resolver and electronically receiving a second predetermined speed level.
Claim 25
Dependent Claim
41 words
The method of claim 16 wherein the step of electronically detecting a discrepancy comprises electronically detecting a discrepancy based on predefined criteria between the second predetermined performance level and the first performance levels and providing the test resolver with diversionary activities.
Claim 26
Dependent Claim
32 words
The method of claim 16 wherein the step of electronically detecting a discrepancy comprises enabling the test resolver to select diversionary activities when the test resolver is signalled for the break time.
Claim 27
Independent Claim
124 words
A method for increasing test resolver efficiency by monitoring test resolver performance in scoring test answers and recommending break times to the test resolvers, the method comprising the steps of: a) electronically receiving first scoring rates corresponding to a test resolver's scoring of test answers at predetermined past intervals in time, and electronically receiving a second present scoring rate corresponding to the test resolver's scoring of the test answers at a present time; b) electronically comparing the second scoring rate and the first scoring rate; and c) electronically detecting a discrepancy based on predefined criteria between the second scoring rate and the first scoring rate as indicated by the comparison step and signalling the test resolver to halt test scoring for a break time.
Claim 28
Independent Claim
124 words
A method for increasing test resolver efficiency by monitoring test resolver performance in scoring test answers and recommending break times to the test resolvers, the method comprising the steps of: a) electronically receiving first scoring rates corresponding to a test resolver's scoring of test answers at predetermined past intervals in time, and electronically receiving a second present scoring rate corresponding to the test resolver's scoring of the test answers at a present time; b) electronically comparing the second scoring rate and the first scoring rate; and c) electronically detecting a discrepancy based on predefined criteria between the second scoring rate and the first scoring rate as indicated by the comparison step and signalling the test resolver to halt test scoring for a break time.
Claim 29
Dependent Claim
48 words
The method of claim 22 wherein the step of electronically detecting a discrepancy further comprises electronically detecting a discrepancy based on predefined criteria between the second present scoring rate and the first scoring rate as indicated by the comparison step and providing the test resolver with diversionary activities.
Claim 30
Dependent Claim
34 words
The method of claim 22 wherein the step of electronically detecting a discrepancy further comprises enabling the test resolver to select diversionary activities when the test resolver has been signalled for the break time.
References Cited (Backward Citations)
US3405457A
Cited
US3538626A
Cited
US3762072A
Cited
US4151659A
Cited
US4518267A
Cited
US4798543A
Cited
US4648062A
Cited
US4845739A
Cited
US4908759A
Cited
US4671772A
Cited
US4930077A
Cited
US4867685A
Cited
US4996642A
Cited
US4895518A
Cited
US4878175A
Cited
US5147205A
Cited
WO1990005070A1
Cited
US5072383A
Cited
US4958284A
Cited
US5105354A
Cited
US5002491A
Cited
US4978305A
Cited
US5011413A
Cited
US5059127A
Cited
US5204813A
Cited
US5195033A
Cited
US5134669A
Cited
US5103490A
Cited
US5100329A
Cited
US5180309A
Cited
US5261823A
Cited
US5259766A
Cited
US5294229A
Cited
US5302132A
Cited
US5321611A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-02-16 | 2001-08-18 | 2002-02-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-02-16 | 2005-08-18 | 2006-02-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-02-16 | 2009-08-18 | 2010-02-17 | $7700.00 | Window Closed / Lapsed |