Patent US7363282B2 successfully refreshed from Google Patents.
US7363282B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Search system using user behavior data
Assignee: Microsoft Technology Licensing LLC
•
Filing: 2003-12-03
•
Granted: 2008-04-22
•
Expires: 2023-12-03
Abstract
Abstract Context-based user feedback is gathered regarding searches performed on a search mechanism. The search mechanism is monitored for user behavior data regarding an interaction of a user with the search mechanism. The response data provided by the search mechanism is also monitored. Context data (describing the search) and user feedback data (the user's feedback on the search—either explicit or implicit) are determined. This can be used, for example, to evaluate a search mechanism or to check a relevance model.
Inventors
- 👤 Kuldeep Karnawat
- 👤 Lu Wang
- 👤 Mark B. Mydland
- 👤 Steven C. Fox
- 👤 Takeshi Shimizu
- 👤 Thomas A. Taylor
- 👤 Thomas D. White
- 👤 Ying Zhang
- 👤 Susan T. Dumais
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-08 18:06
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/90; G06F16/95; G06F16/953; G06F16/9535; G06F16/9536; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99935
Claims Analysis
Total Claims: 16
Claim 1
Independent Claim
301 words
A method with regard to a user performing a search during a single search session at a search engine by way of a search mechanism, said method comprising: monitoring the search mechanism for user behavior data regarding interactions between the user and the search mechanism during the search session thereat, the user behavior data comprising data concerning a plurality of events, each event corresponding to an action of the user at the search mechanism during the search session; monitoring said search mechanism for response data regarding said search session, the response data comprising a results list; determining context data describing a search during said search session, the context data being derived from the user behavior data and from the response data and representing an overall context of the search conducted during the search session; and determining user feedback data describing said search, the user feedback data including implicit user feedback derived from the user behavior data and explicit user feedback regarding the usefulness to a user of the response data and the user response to at least one question, the implicit feedback data comprises time spent reviewing a specific item of the results list, wherein the time spent is calculated by subtracting any time that a user switched to another application while reviewing the specific item, and wherein the explicit user feedback data comprises (a) a user rating of the quality or usefulness of the specific item reviewed from the results list and (b) the user response to the at least one question concerning the results list as a whole; and performing a context-dependent evaluation of the results of the search engine acquired during the search session, the evaluation based at least in part on the determined context data and the determined user feedback data acquired during the single search session.
Claim 2
Independent Claim
301 words
A method with regard to a user performing a search during a single search session at a search engine by way of a search mechanism, said method comprising: monitoring the search mechanism for user behavior data regarding interactions between the user and the search mechanism during the search session thereat, the user behavior data comprising data concerning a plurality of events, each event corresponding to an action of the user at the search mechanism during the search session; monitoring said search mechanism for response data regarding said search session, the response data comprising a results list; determining context data describing a search during said search session, the context data being derived from the user behavior data and from the response data and representing an overall context of the search conducted during the search session; and determining user feedback data describing said search, the user feedback data including implicit user feedback derived from the user behavior data and explicit user feedback regarding the usefulness to a user of the response data and the user response to at least one question, the implicit feedback data comprises time spent reviewing a specific item of the results list, wherein the time spent is calculated by subtracting any time that a user switched to another application while reviewing the specific item, and wherein the explicit user feedback data comprises (a) a user rating of the quality or usefulness of the specific item reviewed from the results list and (b) the user response to the at least one question concerning the results list as a whole; and performing a context-dependent evaluation of the results of the search engine acquired during the search session, the evaluation based at least in part on the determined context data and the determined user feedback data acquired during the single search session.
Claim 3
Dependent Claim
14 words
The method of claim 1 , where said search mechanism is a web browser.
Claim 4
Dependent Claim
106 words
The method of claim 2 , where each action of the user at the search mechanism is selected from among entering a search query; said user navigation to a new page using a hyperlink; said user navigation to a new page using a history list; said user navigation to a new page using an address bar; said user navigation to a new page using a favorites list; user scrolling behavior; user document printing behavior; said user adding a document to said favorites list; said user switching focus to a different application; said user switching focus back from a different application; and said user closing a window.
Claim 5
Dependent Claim
33 words
The method of claim 1 where said method further comprises: tracking, using a state machine comprising at least two states describing progress through said search, which of said states said search is in.
Claim 6
Dependent Claim
26 words
The method of claim 4 , where said context data describing said search comprises state data regarding which of said states were tracked during said search.
Claim 7
Dependent Claim
26 words
The method of claim 4 where at least one transition between said states in said state machines is at least partially dependent on explicit user feedback.
Claim 8
Dependent Claim
17 words
The method of claim 6 where said context data describing said search comprises said explicit user feedback.
Claim 9
Dependent Claim
16 words
The method of claim 1 where said context data describing said search comprises user behavior data.
Claim 10
Dependent Claim
14 words
The method of claim 1 where said user feedback data comprises explicit user feedback.
Claim 11
Dependent Claim
20 words
The method of claim 1 where said user feedback data comprises implicit user feedback based on said user behavior data.
Claim 12
Dependent Claim
14 words
A computer-readable medium having computer-executable instructions to perform the method of claim 1 .
Claim 13
Dependent Claim
94 words
The method of claim 1 wherein the search comprises a number of queries from the user to the search engine, each query being followed by a response from the search engine, the method comprising determining context data that describes each query of the search, including timing and how the user reacted to the corresponding response, and performing the context-dependent evaluation of the results of the search engine based on such context data that allows corresponding user feedback data to be analyzed in a context of the search that is performed during the search session.
Claim 14
Dependent Claim
32 words
The method of claim 1 comprising determining user feedback data that describes the search, the user feedback data including implicit user feedback derived from user behavior including browsing, scrolling, and clicking behavior.
Claim 15
Dependent Claim
78 words
The method of claim 1 comprising determining user feedback data that describes the search, the user feedback data including implicit user feedback including: user behavior while visiting a result list page, including time spent thereat; user behavior while exploring a hyperlink on the result list page, including time spent thereat; user behavior while visiting a result item page, including the time spent thereat; and user behavior relating to the user ignoring a result item of a result list.
Claim 16
Dependent Claim
36 words
The method of claim 1 comprising determining user feedback data that describes the search, the user feedback data including explicit user feedback by way of a dialog box opened at the search mechanism of the user.
References Cited (Backward Citations)
US6801902B1
Cited
US6751606B1
Cited
US6438579B1
Cited
US6571606B2
Cited
US6801909B2
Cited
US20020152190A1
Cited
US6853998B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2011-04-22 | 2011-10-22 | 2012-04-22 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2015-04-22 | 2015-10-22 | 2016-04-22 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2019-04-22 | 2019-10-22 | 2020-04-22 | $7700.00 | Window Closed / Lapsed |