US5437554A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for providing performance feedback to test resolvers
Assignee: NCS Pearson Inc
•
Filing: 1993-02-05
•
Granted: 1995-08-01
•
Expires: 2013-02-05
Abstract
Abstract A system for managing resolvers of test answers to maintain consistent and efficient scoring of the answers. The system monitors test resolver performance in order to provide feedback. By tracking a resolver's scoring rate to compile performance data, the system monitor's efficiency and optionally recommends break times and provides the resolver with diversionary activities during breaks.
Inventors
- 👤 Jay V. Clark
- 👤 William L. Bramlett, Jr.
- 👤 Judith Moyer
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 05:14
CPC Classifications
G; G09; G09B; G09B7/00; G09B7/02; G09B7/06; G09B7/066; Y; Y10; Y10S; Y10S706/00; Y10S706/902; Y10S706/927
Claims Analysis
Total Claims: 30
Claim 1
Independent Claim
91 words
A system for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the system comprising: a) receive means for electronically receiving information related to a first performance level of a first resolver's scoring of test answers, and a predetermined performance level; b) comparison means for electronically comparing the first performance level and the predetermined performance level; and c) feedback means for electronically reporting a discrepancy based on predefined criteria between the first performance level and the predetermined performance level.
Claim 2
Independent Claim
91 words
A system for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the system comprising: a) receive means for electronically receiving information related to a first performance level of a first resolver's scoring of test answers, and a predetermined performance level; b) comparison means for electronically comparing the first performance level and the predetermined performance level; and c) feedback means for electronically reporting a discrepancy based on predefined criteria between the first performance level and the predetermined performance level.
Claim 3
Dependent Claim
21 words
The system of claim 1 wherein the feedback means comprises means for electronically reporting the discrepancy to the first test resolver.
Claim 4
Dependent Claim
20 words
The system of claim 1 wherein the feedback means comprises means for electronically reporting the discrepancy to a system manager.
Claim 5
Independent Claim
92 words
A system for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the system comprising: a) receive means for electronically receiving information related to a first test-score validity level of a first resolver's scoring of test answers, and a predetermined validity level; b) comparison means for electronically comparing the first validity level and the predetermined validity level; and c) feedback means for electronically reporting a discrepancy based on predefined criteria between the first validity level and the predetermined validity level.
Claim 6
Independent Claim
92 words
A system for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the system comprising: a) receive means for electronically receiving information related to a first test-score validity level of a first resolver's scoring of test answers, and a predetermined validity level; b) comparison means for electronically comparing the first validity level and the predetermined validity level; and c) feedback means for electronically reporting a discrepancy based on predefined criteria between the first validity level and the predetermined validity level.
Claim 7
Dependent Claim
32 words
The system of claim 4 wherein the receive means comprises means for receiving a test score for a quality item from the first resolver and a known score for the quality item.
Claim 8
Dependent Claim
21 words
The system of claim 4 wherein the feedback means comprises means for electronically reporting the discrepancy to the first test resolver.
Claim 9
Dependent Claim
20 words
The system of claim 4 wherein the feedback means comprises means for electronically reporting the discrepancy to a system manager.
Claim 10
Independent Claim
91 words
A system for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the system comprising: a) receive means for electronically receiving information related to a first reliability level of a first resolver's scoring of test answers, and a predetermined reliability level; b) comparison means for electronically comparing the first reliability level and the predetermined reliability level; and c) feedback means for electronically reporting a discrepancy based on predefined criteria between the first reliability level and the predetermined reliability level.
Claim 11
Independent Claim
91 words
A system for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the system comprising: a) receive means for electronically receiving information related to a first reliability level of a first resolver's scoring of test answers, and a predetermined reliability level; b) comparison means for electronically comparing the first reliability level and the predetermined reliability level; and c) feedback means for electronically reporting a discrepancy based on predefined criteria between the first reliability level and the predetermined reliability level.
Claim 12
Dependent Claim
52 words
The system of claim 8 wherein the receive means comprises means for receiving a first score corresponding to the first resolver's scoring of a test item during a first time period and for receiving a second score corresponding to the first resolver's scoring of the test item during a second time period.
Claim 13
Dependent Claim
21 words
The system of claim 8 wherein the feedback means comprises means for electronically reporting the discrepancy to the first test resolver.
Claim 14
Dependent Claim
20 words
The system of claim 8 wherein the feedback means comprises means for electronically reporting the discrepancy to a system manager.
Claim 15
Independent Claim
91 words
A system for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the system comprising: a) receive means for electronically receiving information related to a first speed level of a first resolver's scoring of test answers, and a predetermined speed level; b) comparison means for electronically comparing the first speed level and the predetermined speed level; and c) feedback means for electronically reporting a discrepancy based on predefined criteria between the first speed level and the predetermined speed level.
Claim 16
Independent Claim
91 words
A system for electronically providing performance feedback based upon a comparison of a test resolver's performance in scoring test answers to predetermined performance criteria, the system comprising: a) receive means for electronically receiving information related to a first speed level of a first resolver's scoring of test answers, and a predetermined speed level; b) comparison means for electronically comparing the first speed level and the predetermined speed level; and c) feedback means for electronically reporting a discrepancy based on predefined criteria between the first speed level and the predetermined speed level.
Claim 17
Dependent Claim
64 words
The system of claim 12 wherein the receive means comprises means for receiving at least one of the following: a first scoring rate corresponding to the first resolver's scoring of the test answers, an average scoring rate corresponding to a selected group of resolvers' scoring of the test answers, and a second scoring rate corresponding to a second resolver's scoring of the test answers.
Claim 18
Dependent Claim
21 words
The system of claim 12 wherein the feedback means comprises means for electronically reporting the discrepancy to the first test resolver.
Claim 19
Dependent Claim
20 words
The system of claim 12 wherein the feedback means comprises means for electronically reporting the discrepancy to a system manager.
Claim 20
Independent Claim
120 words
A system for increasing test resolver efficiency by monitoring test resolver performance in scoring test answers and recommending break times to the test resolvers, the system comprising: a) receive means for electronically receiving first performance levels corresponding to a test resolver's scoring of test answers at predetermined past intervals in time, and for electronically receiving a second predetermined performance level; b) comparison means for electronically comparing the second predetermined performance level and the first performance level; and c) recommendation means for electronically detecting a discrepancy based on predefined criteria between the second predetermined performance level and the first performance level as indicated by the comparison means and for signalling the test resolver to halt test scoring for a break time.
Claim 21
Independent Claim
120 words
A system for increasing test resolver efficiency by monitoring test resolver performance in scoring test answers and recommending break times to the test resolvers, the system comprising: a) receive means for electronically receiving first performance levels corresponding to a test resolver's scoring of test answers at predetermined past intervals in time, and for electronically receiving a second predetermined performance level; b) comparison means for electronically comparing the second predetermined performance level and the first performance level; and c) recommendation means for electronically detecting a discrepancy based on predefined criteria between the second predetermined performance level and the first performance level as indicated by the comparison means and for signalling the test resolver to halt test scoring for a break time.
Claim 22
Dependent Claim
30 words
The system of claim 16 wherein the receive means comprises means for electronically receiving first validity levels from the test resolver and for electronically receiving a second predetermined validity level.
Claim 23
Dependent Claim
30 words
The system of claim 16 wherein the receive means comprises means for electronically receiving first reliability levels from the test resolver and for electronically receiving a second predetermined reliability level.
Claim 24
Dependent Claim
30 words
The system of claim 16 wherein the receive means comprises means for electronically receiving first speed levels from the test resolver and for electronically receiving a second predetermined speed level.
Claim 25
Dependent Claim
48 words
The system of claim 16 wherein the recommendation means further comprises diversion means for electronically detecting a discrepancy based on predefined criteria between the second predetermined performance level and the first performance levels as indicated by the comparison means and for providing the test resolver with diversionary activities.
Claim 26
Dependent Claim
36 words
The system of claim 16 wherein the recommendation means further comprises resolver-selected diversion means for enabling the test resolver to select diversionary activities when the recommendation means has signalled the test resolver for the break time.
Claim 27
Independent Claim
132 words
A system for increasing test resolver efficiency by monitoring test resolver performance in scoring test answers and recommending break times to the test resolvers, the system comprising: a) receive means for electronically receiving first scoring rates corresponding to a test resolver's scoring of test answers at predetermined past intervals in time, and for electronically receiving a second present scoring rate corresponding to the test resolver's scoring of the test answers at a present time; b) comparison means for electronically comparing the second scoring rate and the first scoring rates; and c) recommendation means for electronically detecting a discrepancy based on predefined criteria between the second scoring rate and the first scoring rates as indicated by the comparison means and for signalling the test resolver to halt test scoring for a break time.
Claim 28
Independent Claim
132 words
A system for increasing test resolver efficiency by monitoring test resolver performance in scoring test answers and recommending break times to the test resolvers, the system comprising: a) receive means for electronically receiving first scoring rates corresponding to a test resolver's scoring of test answers at predetermined past intervals in time, and for electronically receiving a second present scoring rate corresponding to the test resolver's scoring of the test answers at a present time; b) comparison means for electronically comparing the second scoring rate and the first scoring rates; and c) recommendation means for electronically detecting a discrepancy based on predefined criteria between the second scoring rate and the first scoring rates as indicated by the comparison means and for signalling the test resolver to halt test scoring for a break time.
Claim 29
Dependent Claim
48 words
The system of claim 22 wherein the recommendation means further comprises diversion means for electronically detecting a discrepancy based on predefined criteria between the second present scoring rate and the first scoring rates as indicated by the comparison means and for providing the test resolver with diversionary activities.
Claim 30
Dependent Claim
36 words
The system of claim 22 wherein the recommendation means further comprises resolver-selected diversion means for enabling the test resolver to select diversionary activities when the recommendation means has signalled the test resolver for the break time.
References Cited (Backward Citations)
US3405457A
Cited
US3538626A
Cited
US3762072A
Cited
US4151659A
Cited
US4798543A
Cited
US4648062A
Cited
US4845739A
Cited
US4908759A
Cited
US4671772A
Cited
US4930077A
Cited
US4867685A
Cited
US4996642A
Cited
US4895518A
Cited
US4878175A
Cited
US5147205A
Cited
WO1990005970A1
Cited
US5072383A
Cited
US4958284A
Cited
US5105354A
Cited
US5002491A
Cited
US5011413A
Cited
US5059127A
Cited
US5204813A
Cited
US5195033A
Cited
US5134669A
Cited
US5103490A
Cited
US5100329A
Cited
US5180309A
Cited
US5261823A
Cited
US5259766A
Cited
US5294229A
Cited
US5302132A
Cited
US5321611A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-07-31 | 1999-01-30 | 1999-08-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-07-31 | 2003-01-30 | 2003-08-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-07-31 | 2007-01-30 | 2007-08-01 | $7700.00 | Window Closed / Lapsed |