US6016475A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System, method, and article of manufacture for generating implicit ratings based on receiver operating curves
Assignee: University of Minnesota System
•
Filing: 1996-10-08
•
Granted: 2000-01-18
•
Expires: 2016-10-08
Abstract
Abstract An electronic rating broker is provided. The rating broker includes an input mechanism for obtaining an implicit measure concerning items presented to a user. A processor is operatively coupled to the input mechanism and an output device to cooperatively perform several functions. These functions include generating an implicit rating as a function of the implicit measure using a receiver operating curve (ROC). The output device is provided the implicit rating by the processor. In addition, a method is provided for operating an electronic rating broker on a computer system in order to provide an implicit rating generated with an ROC. Also, a storage device readable by a computer system for implementing this method is provided.
Inventors
- 👤 Bradley N. Miller
- 👤 Joseph A. Konstan
- 👤 John T. Riedl
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-03 20:00
CPC Classifications
G; G06; G06Q; G06Q30/00; G06Q30/02; G06Q30/0201; G06F; G06F16/00; G06F16/90; G06F16/95; G06F16/953; G06F16/9535; G06Q30/0204; G06Q30/06; G06Q30/0601; G06Q30/0631; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99932
Claims Analysis
Total Claims: 37
Claim 1
Independent Claim
66 words
A collaborative filtering electronic rating broker, comprising: (a) input means for obtaining an implicit measure concerning items presented to a user; (b) processing means, operatively coupled to the input means, for generating an implicit rating as a function of the implicit measure using a receiver operating curve (ROC); and (c) output means, operatively coupled to the processing means, for providing the implicit rating to collaborative filter.
Claim 2
Dependent Claim
66 words
A collaborative filtering electronic rating broker, comprising: (a) input means for obtaining an implicit measure concerning items presented to a user; (b) processing means, operatively coupled to the input means, for generating an implicit rating as a function of the implicit measure using a receiver operating curve (ROC); and (c) output means, operatively coupled to the processing means, for providing the implicit rating to collaborative filter.
Claim 3
Dependent Claim
36 words
The rating broker of claim 1 wherein the processing means comprises collaborative filtering means for deriving recommendations based on the implicit rating and the output means comprises means for providing the recommendations to an output device.
Claim 4
Dependent Claim
31 words
The rating broker of claim 2 wherein the collaborative filtering means comprises means for deriving the recommendations based on both the implicit rating and at least one rating from another user.
Claim 5
Dependent Claim
112 words
A recommender system comprising the rating broker of claim 2 further comprising a client device operatively coupled to the collaborative filtering rating broker through an interactive network, the client device comprising: (a) user interface means for presenting the items and the recommendations to the user; (b) user input means for receiving data input by the user; (c) client processing means, operatively coupled to the user interface means and user input means, for obtaining the implicit measure, providing the implicit measure to the input means of the collaborative filtering rating broker, receiving the recommendations from the the collaborative filtering rating broker, and presenting the recommendations to the user on the user interface means.
Claim 6
Dependent Claim
22 words
The recommender system of claim 4 wherein the collaborative filtering rating broker and the client device are located within a single apparatus.
Claim 7
Dependent Claim
25 words
The recommender system of claim 4 wherein the collaborative filtering rating broker and the client device are remotely located from one another in separate apparatuses.
Claim 8
Dependent Claim
58 words
The recommender system of claim 4 wherein the client processing means comprises means for obtaining the implicit measure from the user through the user input means based on criteria selected from a group consisting of: user time spent viewing a particular item, user time spent listening to a particular item, and user time spent sampling a particular item.
Claim 9
Dependent Claim
88 words
The recommender system of claim 4 wherein the client processing means comprises means for obtaining the implicit measure from a user through the user input means based on subsequent actions taken by the user, the subsequent actions taken being selected from a group consisting of: a user viewing details of a particular item after viewing only a title, saving a particular item, forwarding a particular item, saving a return address of a particular item, deleting a particular item, replying to a particular item, and printing a particular item.
Claim 10
Dependent Claim
43 words
The rating broker of claim 1 wherein the input means comprises means for obtaining a plurality of implicit measures including the implicit measure and the processing means comprises means for generating the implicit rating as a function of the plurality of implicit measures.
Claim 11
Dependent Claim
50 words
The rating broker of claim 1 wherein the input means comprises means for obtaining a plurality of implicit measures, the plurality of implicit measures including the implicit measure and the processing means comprises means for generating a plurality of implicit ratings as a function of the plurality of implicit measures.
Claim 12
Dependent Claim
34 words
The rating broker of claim 1 wherein the processing means comprises means for deriving the ROC from the items, a signal to noise characterization, and a plurality of implicit measures including the implicit measure.
Claim 13
Dependent Claim
25 words
The rating broker of claim 11 wherein the processing means comprises means for deriving the signal to noise characterization from a set of explicit ratings.
Claim 14
Dependent Claim
41 words
The rating broker of claim 11 wherein the processing means comprises means for deriving rating threshold values for converting a plurality of implicit measures to implicit ratings from the ROC curve, the plurality of implicit measures including the particular implicit measure.
Claim 15
Dependent Claim
50 words
The rating broker of claim 1 wherein the processing means comprises means for deriving a quality metric receiver operating curve (ROC) of a mapping between an implicit measure and an implicit rating, the mapping being based on the items, a signal to noise characterization, and recommendations from a recommendation engine.
Claim 16
Dependent Claim
46 words
The rating broker of claim 14 wherein the processing means comprises means for deriving a plurality of quality metric ROCs each of which corresponds to a different mapping and for selecting one of the mappings for subsequent use based on the plurality of quality metric ROCs.
Claim 17
Dependent Claim
39 words
The rating broker of claim 14 wherein the processing means comprises means for determining if a plurality of implicit ratings including the particular implicit measure are better than a set of explicit ratings based on the quality metric ROC.
Claim 18
Independent Claim
60 words
A method of operating a collaborative filtering electronic rating broker in order to provide an implicit preference rating, comprising steps of: (a) obtaining an implicit measure concerning items presented to a user; (b) generating an implicit rating as a function of the implicit measure using a receiver operating curve (ROC); and (c) providing the implicit rating to a collaborative filter.
Claim 19
Independent Claim
60 words
A method of operating a collaborative filtering electronic rating broker in order to provide an implicit preference rating, comprising steps of: (a) obtaining an implicit measure concerning items presented to a user; (b) generating an implicit rating as a function of the implicit measure using a receiver operating curve (ROC); and (c) providing the implicit rating to a collaborative filter.
Claim 20
Dependent Claim
26 words
The method of claim 17 further comprising steps of: (d) deriving recommendations based on the implicit rating; and (e) providing the recommendations to an output device.
Claim 21
Dependent Claim
27 words
The method of claim 17 wherein the deriving step comprises deriving the recommendations based on both the implicit rating and at least one rating from another user.
Claim 22
Dependent Claim
38 words
The method of claim 18 further comprising steps of (f) receiving the recommendations from the output device; (g) receiving data input by the user; and (h) presenting items and the recommendations to the user on a display device.
Claim 23
Dependent Claim
46 words
The method of claim 17 wherein the obtaining step comprises deriving the implicit measure based on criteria selected from a group consisting of: user time spent viewing a particular item, user time spent listening to a particular item, and user time spent sampling a particular item.
Claim 24
Dependent Claim
73 words
The method of claim 17 wherein the obtaining step comprises deriving the implicit measure based on subsequent actions taken, the subsequent actions taken being selected from a group consisting of: a user viewing details of a particular item after viewing only a title, saving a particular item, forwarding a particular item, saving a return address of a particular item, deleting a particular item, replying to a particular item, and printing a particular item.
Claim 25
Dependent Claim
28 words
The method of claim 17 wherein the generating step comprises deriving the implicit rating as a function of a plurality of implicit measures including the particular implicit measure.
Claim 26
Dependent Claim
30 words
The method of claim 17 wherein the generating step comprises generating a plurality of implicit ratings as a function of a plurality of implicit measures including the particular implicit measure.
Claim 27
Dependent Claim
33 words
The method of claim 17 wherein the generating step further comprises deriving the ROC from the items, a signal to noise characterization, and a plurality of implicit measures including the particular implicit measure.
Claim 28
Dependent Claim
23 words
The method of claim 25 wherein the generating step further comprises deriving the signal to noise characterization from a set of explicit ratings.
Claim 29
Dependent Claim
39 words
The method of claim 25 wherein the generating step further comprises deriving rating threshold values for converting a plurality of implicit measures to implicit ratings from the ROC curve, the plurality of implicit measures including the particular implicit measure.
Claim 30
Dependent Claim
47 words
The method of claim 17 further comprising a step of deriving a quality metric receiver operating curve (ROC) of a mapping between an implicit measure and an implicit rating, the mapping being based on the items, a signal to noise characterization, and predictions from a prediction engine.
Claim 31
Dependent Claim
48 words
The method of claim 19 wherein the deriving step comprises deriving a plurality of quality metric ROCs each of which corresponds to a different mapping, the method further comprising a step of selecting one of the mappings for subsequent use based on the plurality of quality metric ROCs.
Claim 32
Dependent Claim
36 words
The method of claim 19 further comprising a step of determining if a plurality of implicit ratings including the particular implicit measure are better than a set of explicit ratings based on the quality metric ROC.
Claim 33
Dependent Claim
83 words
A program storage device readable by a computer system tangibly embodying a program of instructions executable by the computer system to perform a method of operating a collaborative filtering electronic rating broker in order to provide an implicit rating, the method comprising steps of: (a) obtaining an implicit measure concerning items presented to a user; (b) generating an implicit rating as a function of the implicit measure using a receiver operating curve (ROC); and (c) providing the implicit rating to a collaborative filter.
Claim 34
Dependent Claim
83 words
A program storage device readable by a computer system tangibly embodying a program of instructions executable by the computer system to perform a method of operating a collaborative filtering electronic rating broker in order to provide an implicit rating, the method comprising steps of: (a) obtaining an implicit measure concerning items presented to a user; (b) generating an implicit rating as a function of the implicit measure using a receiver operating curve (ROC); and (c) providing the implicit rating to a collaborative filter.
Claim 35
Dependent Claim
31 words
The program storage device of claim 31 wherein the method further comprises steps of: (d) deriving recommendations based on the implicit rating; and (e) providing the recommendations to an output device.
Claim 36
Dependent Claim
43 words
The program storage device of claim 32 wherein the method further comprises steps of: (f) receiving the recommendations from the output device; (g) receiving data input by the user; and (h) presenting items and the recommendations to the user on a display device.
Claim 37
Dependent Claim
22 words
The recommender system of claim 5, wherein the collaborative filtering rating broker and the client device are located within a single processor.
References Cited (Backward Citations)
US3952184A
Cited
US4041617A
Cited
US4205464A
Cited
US4348740A
Cited
FR2461302A1
Cited
US4646145A
Cited
US4331973A
Cited
US4546382A
Cited
US4566030A
Cited
US4658290A
Cited
US4602279A
Cited
US4630108A
Cited
US4627818A
Cited
US4745549A
Cited
US4647964A
Cited
US4682956A
Cited
US4781596A
Cited
US4930077A
Cited
US4872113A
Cited
US4870579A
Cited
US4996642A
Cited
US5544281A
Cited
US5410344A
Cited
US5386104A
Cited
US5754939A
Cited
US5754938A
Cited
US5708591A
Cited
US5704017A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-01-17 | 2003-07-19 | 2004-01-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-01-17 | 2007-07-19 | 2008-01-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-01-17 | 2011-07-19 | 2012-01-18 | $7700.00 | Window Closed / Lapsed |