US5958008A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Software system and associated methods for scanning and mapping dynamically-generated web documents
Assignee: Micro Focus LLC
•
Filing: 1997-04-11
•
Granted: 1999-09-28
•
Expires: 2017-04-11
Abstract
Abstract A visual Web site analysis program, implemented as a collection of software components, provides a variety of features for facilitating the analysis and management of Web sites and Web site content. A mapping component scans a Web site over a network connection and builds a site map which graphically depicts the URLs and links of the site. Site maps are generated using a unique layout and display methodology which allows the user to visualize the overall architecture of the Web site. Various map navigation and URL filtering features are provided to facilitate the task of identifying and repairing common Web site problems, such as links to missing URLs. A dynamic page scan feature enables the user to include dynamically-generated Web pages within the site map by capturing the output of a standard Web browser when a form is submitted by the user, and then automatically resubmitting this output during subsequent mappings of the site. The Web site analysis program is implemented using an extensible architecture which includes an API that allows plug-in applications to manipulate the display of the site map. Various plug-ins are provided which utilize the API to extend the functionality of the analysis program, including an action tracking plug-in which detects user activity and behavioral data (link activity levels, common site entry and exit points, etc.) from server log files and then superimposes such data onto the site map.
Inventors
- 👤 Michael Pogrebisky
- 👤 Amir Weinberg
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 04:50
CPC Classifications
G; G06; G06F; G06F11/00; G06F11/30; G06F11/32; G06F11/323; G06F16/00; G06F16/90; G06F16/95; G06F16/958; G06Q; G06Q30/00; G06Q30/02; H; H04; H04L; H04L67/00; H04L67/01; H04L67/02; G06F11/34; G06F11/3466; G06F11/3476; G06F2201/00; G06F2201/875
Claims Analysis
Total Claims: 43
Claim 1
Independent Claim
305 words
A method of scanning and mapping dynamically-generated web documents, comprising the computer-implemented steps of: presenting a user of a computer with a user interface of a web site analysis program that includes executable code for scanning and mapping web sites, the user interface including control functionality for allowing the user to at least (i) initiate an automatic scanning/mapping session of a web site, and (ii) activate a capture session in which datasets entered by the user into forms of web documents of the web site are automatically recorded for use during subsequent scanning/mapping sessions; in response to user activation of a capture session from the user interface, recording a dataset entered by the user into an embedded form of a web document of the web site, the step of recording comprising: (a) launching a browser program on the computer; (b) displaying the web document on a display screen of the computer with the browser program to allow the user to enter the dataset into the form; (c) capturing the dataset entered by the user; and (d) storing the dataset captured in step (c) in association with the web document in a memory of the computer; subsequently, in response to user activation of an automatic scanning/mapping of the web site from the user interface, generating a graphical map of the web site, the step of generating the map comprising: (e) retrieving the dataset stored in step (d) and submitting the dataset to a web site component specified within the web document to simulate a manual submission by the user of the dataset; (f) receiving a dynamically-generated web document returned by the web site component in response to the dataset submission of step (e); and (g) displaying a graphical representation of the dynamically-generated web document received in step (f) on the display screen within the graphical map.
Claim 2
Independent Claim
305 words
A method of scanning and mapping dynamically-generated web documents, comprising the computer-implemented steps of: presenting a user of a computer with a user interface of a web site analysis program that includes executable code for scanning and mapping web sites, the user interface including control functionality for allowing the user to at least (i) initiate an automatic scanning/mapping session of a web site, and (ii) activate a capture session in which datasets entered by the user into forms of web documents of the web site are automatically recorded for use during subsequent scanning/mapping sessions; in response to user activation of a capture session from the user interface, recording a dataset entered by the user into an embedded form of a web document of the web site, the step of recording comprising: (a) launching a browser program on the computer; (b) displaying the web document on a display screen of the computer with the browser program to allow the user to enter the dataset into the form; (c) capturing the dataset entered by the user; and (d) storing the dataset captured in step (c) in association with the web document in a memory of the computer; subsequently, in response to user activation of an automatic scanning/mapping of the web site from the user interface, generating a graphical map of the web site, the step of generating the map comprising: (e) retrieving the dataset stored in step (d) and submitting the dataset to a web site component specified within the web document to simulate a manual submission by the user of the dataset; (f) receiving a dynamically-generated web document returned by the web site component in response to the dataset submission of step (e); and (g) displaying a graphical representation of the dynamically-generated web document received in step (f) on the display screen within the graphical map.
Claim 3
Dependent Claim
25 words
The method according to claim 1, wherein each of steps (a)-(g) is performed at least in-part by executable code of the web site analysis program.
Claim 4
Dependent Claim
68 words
The method according to claim 1, wherein step (d) comprises storing the dataset within a data structure which represents a previously-generated map of the web site, and wherein steps (e)-(g) are performed in response to activation by the user of an automatic map update operation in which the web site analysis program automatically updates the data structure to reflect changes that have been made to the web site.
Claim 5
Dependent Claim
25 words
The method according to claim 3, further comprising repeating steps (e)-(g) in response to a subsequent activation by the user of the automatic update operation.
Claim 6
Dependent Claim
26 words
The method according to claim 1, wherein step (a) comprises launching a stand-alone browser program that is not a component of the web site analysis program.
Claim 7
Dependent Claim
28 words
The method according to claim 5, wherein step (a) further comprises dynamically configuring the stand-alone browser program to temporarily use the web site analysis program as a proxy.
Claim 8
Dependent Claim
20 words
The method according to claim 6, wherein the step of configuring comprises updating an operating system registry on the computer.
Claim 9
Dependent Claim
57 words
The method according to claim 1, wherein step (c) comprises: receiving a dynamic page request message with the web site analysis program, the request message generated by the browser program in response to a submission by the user of the dataset; and copying the dataset from the dynamic page request message with the web site analysis program.
Claim 10
Dependent Claim
79 words
The method according to claim 8, wherein the step of recording the dataset further comprises: forwarding the dynamic page request message from the web site analysis program to the web site component specified within the web document to cause a current version of the dynamically-generated document to be generated and returned; and displaying the current version of the dynamically-generated document to the user with the browser program to create a user impression of normal browsing during the capture session.
Claim 11
Dependent Claim
27 words
The method according to claim 1, wherein step (d) comprises storing the dataset within a data structure that represents a previously-generated graphical map of the web site.
Claim 12
Dependent Claim
61 words
The method according to claim 10, wherein the user interface includes a save option for allowing the user to save maps of web sites to a nonvolatile memory of the computer, and wherein step (d) further comprises storing the data structure, including the dataset, to the nonvolatile memory when the user invokes the save option to save the previously-generated graphical map.
Claim 13
Dependent Claim
45 words
The method according to claim 1, further comprising the steps of: automatically parsing the dynamically-generated web document received in step (f) to identify at least one outgoing link of the dynamically-generated web document; and displaying the at least one outgoing link within the graphical map.
Claim 14
Dependent Claim
56 words
The method according to claim 1, wherein the step of recording comprises repeating steps (c) and (d) multiple times during the capture session to record a plurality of different datasets that correspond to the form, and wherein the step of generating the map comprises submitting each of the plurality of datasets to the web site component.
Claim 15
Dependent Claim
184 words
A web site analysis program which runs on a computer of a computer network to provide web site analysis functionality, the program comprising, on a computer-readable medium: a dataset capture routine which captures a dataset entered by a user of the computer into an embedded form of a web document, and which stores the dataset in association with the web document within a memory of the computer to permit the dataset to subsequently be used to initiate a generation and retrieval of a dynamically-generated web document; a web site scanning routine which scans web sites of the network and generates graphical maps of the web sites on a display screen of the computer, the scanning routine including executable code which automatically retrieves the dataset stored by the dataset capture routine and submits the dataset to a web site component that corresponds to the embedded form to cause the web site component to generate and return a dynamically-generated web document; and a user interface which provides control functionality for allowing the user to selectively invoke the dataset capture routine and the web site scanning routine.
Claim 16
Dependent Claim
184 words
A web site analysis program which runs on a computer of a computer network to provide web site analysis functionality, the program comprising, on a computer-readable medium: a dataset capture routine which captures a dataset entered by a user of the computer into an embedded form of a web document, and which stores the dataset in association with the web document within a memory of the computer to permit the dataset to subsequently be used to initiate a generation and retrieval of a dynamically-generated web document; a web site scanning routine which scans web sites of the network and generates graphical maps of the web sites on a display screen of the computer, the scanning routine including executable code which automatically retrieves the dataset stored by the dataset capture routine and submits the dataset to a web site component that corresponds to the embedded form to cause the web site component to generate and return a dynamically-generated web document; and a user interface which provides control functionality for allowing the user to selectively invoke the dataset capture routine and the web site scanning routine.
Claim 17
Dependent Claim
63 words
The web site analysis program according to claim 14, wherein the dataset capture routine is configured to run in conjunction with a web browser program, and is configured to capture the dataset by extracting the dataset from a message generated by the web browser program, the message generated in response to a submission of the form by the user from the browser program.
Claim 18
Dependent Claim
38 words
The web site analysis program according to claim 15, wherein the dataset capture routine is configured to automatically launch the browser program in response to activation by the user of a dataset capture session from the user interface.
Claim 19
Dependent Claim
26 words
The web site analysis program according to claim 16, wherein the dataset capture routine is configured to operate as a proxy of the web browser program.
Claim 20
Dependent Claim
37 words
The web site analysis program according to claim 17, wherein the dataset capture includes executable code for temporarily configuring the web browser program to use the data capture routine as a proxy for communicating with web sites.
Claim 21
Dependent Claim
59 words
The web site analysis program according to claim 14, wherein the dataset capture routine is configured to store the dataset within a data structure which represents a previously-generated graphical map of a web site, the data structure generated by the web site scanning routine prior to activation by the user of the dataset capture routine to capture the dataset.
Claim 22
Dependent Claim
91 words
The web site analysis program according to claim 19, wherein the user interface includes a map update option for allowing the user to selectively invoke the web site scanning routine in order to update the data structure to reflect modifications that have been made to the web site, and wherein user selection of the automatic update option following storage of the of the dataset within the data structure causes the web site scanning routine to automatically retrieve the dataset from the data structure submit the dataset to the web site component.
Claim 23
Dependent Claim
37 words
The web site analysis program according to claim 19, wherein the user interface includes a save option which allows the user to selectively save the data structure, including the dataset, to a nonvolatile memory of the computer.
Claim 24
Dependent Claim
36 words
The web site analysis program according to claim 14, wherein the web site scanning routine is configured to display an iconic representation of the on the dynamically-generated document as a node of a web site map.
Claim 25
Independent Claim
190 words
A method of scanning dynamically-generated web documents, comprising the steps of: (a) providing a capture routine which runs in conjunction with a browser program, the capture routine configured to capture datasets entered by users into forms of web documents; (b) providing a scanning routine which selectively scans web site addresses to obtain information about web sites, the scanning routine configured to use datasets captured by the capture routine to automatically scan dynamically-generated web documents; (c) displaying a web document on a display screen of a computer with the browser program to allow a user to enter a dataset into a form of the web document; (d) capturing the dataset entered by the user with the capture routine and storing the dataset in association with the web document within a memory for subsequent use; subsequently, in response to activation by the user of the scanning routine: (e) automatically retrieving the dataset stored in step (d) with the scanning routine; and (f) automatically submitting the dataset to a web site component which corresponds to the embedded form with the scanning routine, to simulate an actual submission of the form by the user.
Claim 26
Independent Claim
190 words
A method of scanning dynamically-generated web documents, comprising the steps of: (a) providing a capture routine which runs in conjunction with a browser program, the capture routine configured to capture datasets entered by users into forms of web documents; (b) providing a scanning routine which selectively scans web site addresses to obtain information about web sites, the scanning routine configured to use datasets captured by the capture routine to automatically scan dynamically-generated web documents; (c) displaying a web document on a display screen of a computer with the browser program to allow a user to enter a dataset into a form of the web document; (d) capturing the dataset entered by the user with the capture routine and storing the dataset in association with the web document within a memory for subsequent use; subsequently, in response to activation by the user of the scanning routine: (e) automatically retrieving the dataset stored in step (d) with the scanning routine; and (f) automatically submitting the dataset to a web site component which corresponds to the embedded form with the scanning routine, to simulate an actual submission of the form by the user.
Claim 27
Dependent Claim
40 words
The method according to claim 23, wherein the capture routine and the scanning routine are integrated as part of a client software program, and each of steps (c)-(f) are performed at least in-part by executable code of the client program.
Claim 28
Dependent Claim
22 words
The method according to claim 24, further comprising the step of launching the browser program on the computer with the capture routine.
Claim 29
Dependent Claim
35 words
The method according to claim 25, wherein the step of launching the browser program is performed in response to activation by the user of a capture session from a user interface of the client program.
Claim 30
Dependent Claim
30 words
The method according to claim 23, wherein step (d) comprises storing the dataset within a memory that is located at a remote location relative to the user and the computer.
Claim 31
Dependent Claim
51 words
The method according to claim 23, further comprising the steps of: (g) receiving a dynamically-generated document generated by the web site component in response to the submission of step (f); and (h) displaying an icon representation of the dynamically-generated document received in step (f) to the user on a display screen.
Claim 32
Dependent Claim
23 words
The method according to claim 28, wherein step (h) comprises displaying the icon representation as a node of a hierarchical web site map.
Claim 33
Dependent Claim
27 words
The method according to claim 23, wherein step (f) comprises submitting the dataset to the web site component in accordance with protocols of the World Wide Web.
Claim 34
Dependent Claim
35 words
The method according to claim 23, wherein the web site component runs on a physical server of a corporate intranet site, and step (f) comprises sending the dataset from the computer to the physical server.
Claim 35
Dependent Claim
29 words
The method according to claim 23, wherein step (d) comprises storing the the dataset within a nonvolatile memory, and step (d) comprises retrieving the dataset from the nonvolatile memory.
Claim 36
Dependent Claim
29 words
The method according to claim 23, wherein steps (c) and (d) are performed multiple times in sequence to record a plurality of different datasets that correspond to the form.
Claim 37
Independent Claim
166 words
A method of analyzing a web site, comprising the steps of: (a) providing a data capture routine which runs in conjunction with a browser program on a computer, the computer connected to a network that interconnects the computer to the web site; (b) providing an analysis routine which uses data captured by the data capture routine to analyze the web site; (c) capturing an output sequence of the browser with the data capture routine while a user interactively accesses the web site with the browser, and storing the output sequence within a memory of the computer, the output sequence including at least one web site address accessed by the user; and (d) subsequently, in response to initiation of an analysis session by a user, analyzing the web site with the analysis routine using the output sequence stored in step (c), the step of analyzing comprising automatically accessing the at least one web site address with the analysis routine while monitoring data returned by the web site.
Claim 38
Independent Claim
166 words
A method of analyzing a web site, comprising the steps of: (a) providing a data capture routine which runs in conjunction with a browser program on a computer, the computer connected to a network that interconnects the computer to the web site; (b) providing an analysis routine which uses data captured by the data capture routine to analyze the web site; (c) capturing an output sequence of the browser with the data capture routine while a user interactively accesses the web site with the browser, and storing the output sequence within a memory of the computer, the output sequence including at least one web site address accessed by the user; and (d) subsequently, in response to initiation of an analysis session by a user, analyzing the web site with the analysis routine using the output sequence stored in step (c), the step of analyzing comprising automatically accessing the at least one web site address with the analysis routine while monitoring data returned by the web site.
Claim 39
Dependent Claim
31 words
The method according to claim 34, wherein the step of capturing comprises temporarily configuring the browser program to use the analysis routine as a proxy for communicating with the web site.
Claim 40
Dependent Claim
48 words
The method according to claim 34, wherein step (c) comprises capturing and storing a dataset entered by the user into a form of a web document, and step (d) comprises submitting the dataset to the web site with the analysis routine to recreate a submission of the form.
Claim 41
Dependent Claim
39 words
The method according to claim 34, wherein step (c) comprises capturing and storing a sequence of web site addresses accessed by the user, and step (d) comprises automatically accessing the sequence of web site addresses with the analysis routine.
Claim 42
Dependent Claim
31 words
The method according to claim 34, wherein step (d) comprises automatically processing the data returned by the web site with the analysis routine to evaluate the operation of the web site.
Claim 43
Dependent Claim
33 words
The method according to claim 34, wherein steps (a) and (b) comprise providing the data capture routine and the analysis routine as integrated components of a web site management and analysis software package.
References Cited (Backward Citations)
US5295261A
Cited
US5657438A
Cited
US5524202A
Cited
US5388255A
Cited
US5546529A
Cited
US5515488A
Cited
US5590250A
Cited
US5544310A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-09-27 | 2003-03-29 | 2003-09-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-09-27 | 2007-03-29 | 2007-09-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-09-27 | 2011-03-29 | 2011-09-28 | $7700.00 | Window Closed / Lapsed |