US5735694A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Collaborative and quality control scoring method
Assignee: NCS Pearson Inc
•
Filing: 1995-11-20
•
Granted: 1998-04-07
•
Expires: 2015-11-20
Abstract
Abstract A method for managing resolvers of test answers to maintain consistent and efficient scoring of test answers. Collaborative scoring allows two test resolvers to score the same test answer and resolves potential discrepancies in the scores provided by the resolvers. Quality items monitor a test resolver's scoring performance against a known standard. A quality-control test item, having a known score, is transmitted to a test resolver. After receiving a score from the resolver, the known score is compared with the resolver's score and a quality profile is generated for the resolver.
Inventors
- 👤 Jay V. Clark
- 👤 William L. Bramlett, Jr.
- 👤 Judith Moyer
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 01:38
CPC Classifications
G; G09; G09B; G09B7/00; G09B7/02; G09B7/06; G09B7/066; Y; Y10; Y10S; Y10S706/00; Y10S706/902; Y10S706/927
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
132 words
A method for verifying test answers between two or more test resolvers, the method comprising the steps of: a) electronically receiving an answer to a test question, the answer comprising an electronic representation of at least a portion of a test answer sheet; b) electronically transmitting the answer to first and second test resolver terminals to be scored by first and second test resolvers; c) electronically receiving first and second test scores for the answer, as determined by the first and second test resolvers, from the first and second test resolver terminals; and d) electronically comparing the first and second test scores and for selectively recording a value related to the first and second test scores if the first and second test scores did not contain a discrepancy based on predefined criteria.
Claim 2
Independent Claim
132 words
A method for verifying test answers between two or more test resolvers, the method comprising the steps of: a) electronically receiving an answer to a test question, the answer comprising an electronic representation of at least a portion of a test answer sheet; b) electronically transmitting the answer to first and second test resolver terminals to be scored by first and second test resolvers; c) electronically receiving first and second test scores for the answer, as determined by the first and second test resolvers, from the first and second test resolver terminals; and d) electronically comparing the first and second test scores and for selectively recording a value related to the first and second test scores if the first and second test scores did not contain a discrepancy based on predefined criteria.
Claim 3
Dependent Claim
30 words
The method of claim 1 further comprising the step of electronically displaying the test question to the first and second test resolvers at the first and second test resolver terminals.
Claim 4
Dependent Claim
78 words
The method of claim 1 wherein the step of electronically comparing the first and second test scores further comprises the steps of: a) providing an electronic communication link between the first and second test resolver terminals and, if the first and second test scores contain the discrepancy based on the predefined criteria, signalling the first and second test resolvers to interactively determine and enter a joint score using the electronic communication link; and b) recording the joint score.
Claim 5
Dependent Claim
49 words
The method of claim 3 further comprising the step of tracking average scores of the first and second test resolvers and preventing the first and second test resolvers from scoring a same test item if the first and second test resolvers each have average scores within predefined scoring criteria.
Claim 6
Dependent Claim
49 words
The method of claim 3 wherein the step of electronically comparing the first and second test scores further comprises the step of preventing the first and second test resolver terminals from receiving another answer to be scored until the first and second test resolvers have entered the joint score.
Claim 7
Dependent Claim
58 words
The method of claim 3 wherein the step of electronically comparing the first and second test scores further comprises the step of transmitting the test item to a third test resolver terminal to be scored by a third test resolver, if the first and second test resolvers do not enter the joint score within a predetermined time period.
Claim 8
Dependent Claim
76 words
The method of claim 1 wherein the step of electronically comparing the first and second test scores further comprises the steps of: a) transmitting the answer to a third test resolver terminal to be scored by a third test resolver, if the first and second test scores contain the discrepancy based on the predefined criteria; and b) recording a third test score, as determined by the third test resolver, received from the third test resolver terminal.
Claim 9
Dependent Claim
36 words
The method of claim 1 wherein the step of transmitting the answer to a third test resolver terminal further comprises the step of providing the third test resolver terminal with the first and second test scores.
Claim 10
Dependent Claim
52 words
The method of claim 1 wherein the step of transmitting the answer to a third test resolver terminal further comprises the step of preventing the third test resolver from viewing the first and second test scores on the third test resolver terminal before the third test resolver records the third test score.
Claim 11
Dependent Claim
44 words
The method of claim 1, wherein the step of electronically comparing the first and second test scores further comprises the step of electronically linking the first and second test resolver terminals when the first and second test resolvers are located in different geographical locations.
Claim 12
Dependent Claim
54 words
The method of claim 1 wherein the step of electronically comparing the first and second test scores comprises the step of selectively recording, as the value, a greater of the first and second test scores, a lower of the first and second test scores, and an average of the first and second test scores.
Claim 13
Independent Claim
118 words
A method for evaluating the performance of test resolvers by routing quality-control questions for scoring to test resolvers, the quality-control questions comprising a test answer with a score known to quality-control personnel, the method comprising the steps of: a) electronically transmitting to a test resolver terminal a quality-control question to be scored by a test resolver, the quality-control question comprising a test answer with a score known to quality-control personnel; b) electronically receiving from the test resolver terminal a resolver score, as determined by the test resolver, for the quality-control question; and c) electronically comparing the score known to the quality-control personnel and the resolver score and reporting a discrepancy between the known score and the resolver score.
Claim 14
Independent Claim
118 words
A method for evaluating the performance of test resolvers by routing quality-control questions for scoring to test resolvers, the quality-control questions comprising a test answer with a score known to quality-control personnel, the method comprising the steps of: a) electronically transmitting to a test resolver terminal a quality-control question to be scored by a test resolver, the quality-control question comprising a test answer with a score known to quality-control personnel; b) electronically receiving from the test resolver terminal a resolver score, as determined by the test resolver, for the quality-control question; and c) electronically comparing the score known to the quality-control personnel and the resolver score and reporting a discrepancy between the known score and the resolver score.
References Cited (Backward Citations)
US3405457A
Cited
US3538626A
Cited
US3762072A
Cited
US4151659A
Cited
US4518267A
Cited
US4798543A
Cited
US4648062A
Cited
US4845739A
Cited
US4908759A
Cited
US4671772A
Cited
US4930077A
Cited
US4867685A
Cited
US4996642A
Cited
US4895518A
Cited
US4878175A
Cited
US5147205A
Cited
WO1990005070A1
Cited
US5072383A
Cited
US4958284A
Cited
US5105354A
Cited
US5002491A
Cited
US4978305A
Cited
US5011413A
Cited
US5059127A
Cited
US5204813A
Cited
US5195033A
Cited
US5134669A
Cited
US5103490A
Cited
US5100329A
Cited
US5180309A
Cited
US5261823A
Cited
US5259766A
Cited
US5294229A
Cited
US5302132A
Cited
US5321611A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-04-06 | 2001-10-06 | 2002-04-07 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-04-06 | 2005-10-06 | 2006-04-07 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-04-06 | 2009-10-06 | 2010-04-07 | $7700.00 | Window Closed / Lapsed |