text:
US9081756B2 - Method and apparatus for populating a form with data - Google Patents
Method and apparatus for populating a form with data Download PDF
Duane Maxwell
William Von Reis
Geoffrey D. Scott
2011-05-23 Assigned to ENTRYPOINT, INC. reassignment ENTRYPOINT, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SCOTT, GEOFFREY D., VON REIS, WILLIAM, MAXWELL, DUANE
2011-05-23 Assigned to AOL LLC reassignment AOL LLC CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: AMERICA ONLINE, INC.
2011-05-23 Assigned to AOL INC. reassignment AOL INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AOL LLC
2011-05-23 Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
2011-05-23 Assigned to AMERICA ONLINE, INCORPORATED reassignment AMERICA ONLINE, INCORPORATED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ENTRYPOINT, INC.
2014-10-30 Assigned to MICROSOFT CORPORATION reassignment MICROSOFT CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AOL ADVERTISING INC, AOL INC., MAPQUEST, INC
G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
G06F17/20—Handling natural language data
G06F17/21—Text processing
G06F17/22—Manipulating or registering by use of codes, e.g. in sequence of text characters
G06F17/2247—Tree structured documents; Markup, e.g. Standard Generalized Markup Language [SGML], Document Type Definition [DTD]
G06F17/24—Editing, e.g. insert/delete
G06F17/243—Form filling; Merging, e.g. graphical processing of form or text
G06F17/248—Templates
A method and apparatus for populating a form with data is described. In one embodiment of the invention, a form is displayed to the user via the target application. Each form has one or more data receptacles. The data receptacles of a form are filled with data when the user executes a data population command. The form completion program executes the data population command when a graphical representation of a particular data set is placed over the form. Each data set is stored in an encrypted manner and is accessible to users who enter the appropriate information into an authentication mechanism. To populate a form with data the form completion program obtains an image of the form and then searches for a template file that resembles the form image to within a certain threshold. The template files are typically stored on the computer hosting the target application in a template directory that is arranged according to a predefined structure. The form completion program is configured to search for templates that resemble the form image in the template directory to within a certain threshold.
CROSS-REFERENCE TO RELATED APPLICATION
This application is a continuation of U.S. patent application Ser. No. 11/413,680, filed Apr. 28, 2006 now U.S. Pat. No. 7,962,845, which is a divisional of U.S. patent application Ser. No. 10/426,182, filed Apr. 29, 2003, issued as U.S. Pat. No. 7,062,706, which is a continuation of U.S. patent application Ser. No. 09/430,535, filed Oct. 29, 1999, issued as U.S. Pat. No. 6,589,290, all of which are incorporated herein by reference.
The present invention relates to computer networks and more particularly to a method and apparatus for populating a form with data.
2. Background Art
Computer users can shop for merchandise using the Internet. A number of companies maintain web sites where customers can purchase books, records, videos, and many other products. Other web sites provide subscription services that provide the user with access to a service or product. Typically, users make purchases or sign up for services by completing forms. A problem with current Internet schemes is that each field on a form must be filled out separately and manually. This is a time consuming and often frustrating process for the user.
Current systems do not provide a way for users to quickly complete a form (referred to as "populating" a form) with data. For example, when a user wishes to purchase a product online, the user typically supplies a credit card number, a shipping address, and any other personal information that may be needed to complete the transaction. The user supplies this information using an input device such as a keyboard to manually enter data into the fields of a form. However, after buying goods from one vendor, for example, the user may wish to purchase goods from a second vendor. The user must manually complete the second vendor's form even though the second vendor may require the purchaser to provide the same kind of information the user provided to the first vendor. This presents a problem to the user because it forces the user to manually enter the same information into different vendor's forms multiple times.
Another problem presented by the prior art is that users do not have a way to securely store sensitive information and then later use that information to populate a form. Current systems do not provide a way to prevent unauthorized users from obtaining access to sensitive information stored on a user's computer. Instead such systems leave data that is entered into a form readily accessible. For example, data that is entered into a form may be stored locally using a technology called cookies. A cookie is a local representation of information related to a particular web page that was previously visited by the user. Cookies are not encrypted and may be read by anyone who can obtain them. The term anyone also includes any computer program that knows where the cookies are stored. This is problematic because it unnecessarily exposes sensitive information to unauthorized users. Therefore, there is a need for a method and apparatus for populating forms with data where that data is accessible only to authenticated users.
The problems associated with form population may be better understood by the following discussion of the Internet/World Wide Web, web page creation, embedded forms, cookies, and web browser technology.
The Internet/World Wide Web:
A web browser is a type of computer program that provides users with a mechanism for accessing the World Wide Web (WWW). The WWW is a segment of the Internet comprised of numerous web clients and web servers that communicate with one another using a standard set of protocols. A web server is a computer configured to provide web pages to the web client upon request. A web client typically utilizes the web browser application to request web pages from the web server.
The Internet is a global computer network comprised of an amalgamation of interconnected networks that are capable of readily communicating with one another using a standardized set of protocols. Protocols provide a uniform set of communication parameters that enable computers to effectively transmit and receive data. Most computer networks, including the Internet, utilize several different layers of protocols. Each layer provides the network with different functionality.
The WWW is a segment of the Internet that utilizes an application layer protocol called the HyperText Transfer Protocol (HTTP) to disseminate and to obtain information from users. HTTP is a request/response protocol used with distributed, collaborative, hypermedia information systems. In operation, HTTP enables one computer to communicate with another. For example referring now to FIG. 1, web client 100 can use HTTP to communicate with web server 150 via network 125. In this scenario the web server acts as a repository for files 160 and is capable of processing the web client's requests for such files. The files 160 stored on the web server may contain any type of data. For example, the files may contain data used to construct a form, image data, text data, or any other type of data.
HTTP has communication methods that allow web client 100 to request or send data to web server 150. The web client 100 may use web browser 110 to initiate request 115 and receive one or more files from file repository 160. Typically, web browser 110 sends a request 115 for at least one file to web server 150 and the web server forwards the requested file to web client 100 in response 120. The connection is then terminated between web client 100 and web server 150. Web client 100 then uses web browser 110 to display the requested file. A client request 115 therefore, consists of establishing a connection between the web client and the web server using network 125, issuing a response 120 to the request 115, and terminating the connection.
Web server 150 does not utilize state information about the request once the connection is terminated. HTTP is, therefore, a stateless application protocol. That is, a web client can send several requests to a web server, but each individual request is treated independent of any other request. In some instances, the web server maintains a record of such requests, but the web server does not use that information to process later requests. Thus, for example, if a form is completed by the user and submitted to the web server for processing, the web server may maintain a record of the data entered into the form, but that record will not be used to later influence another request from the same client. In other words, web server 150 may record a request in a log file, but it does not later read from the log to determine how to respond to another request from the same client.
Once a file is sent from web server 150 to web client 100 it becomes ready for display. The web client's 100 web browser 110 is typically used to format and display files. Web browser 110 allows the user to request and view a file without having to learn a complicated command syntax. Examples of several widely used web browsers include Netscape Navigator, Internet Explorer, and Opera. Some web browsers can display several different types of files. For example, files written using the HyperText Markup Language (HTML), the JavaScript programming language, the ActiveX programming language, or the Portable Document Format (PDF) may be displayed using a web browser. It is also possible to display various other types of files using language such as Standard Generalized Markup Language (SGML) or eXtensible Markup Language (XML).
Creating a Web Page:
A form, which provides one or more places for a user to enter data, can be embedded inside of a web page. A web page may be created using a variety of different data formats and/or programming languages. Most web pages, and as a result most forms, are created using the HyperText Markup Language (HTML). The techniques used to create a web page will now be discussed in further detail.
HTML is a language that may be used to specify the contents of a web page (e.g. web page 220). An HTML description is typically comprised of a set of markup symbols which are described in more detail below. HTML file 250 or any type of data file that contains the markup symbols for web page 220 may be sent to web browser 210. Web browser 210 executing at web client 200 parses the markup symbols in HTML file 250 and produces web page 220, which is then displayed, based on the information in HTML file 250. Web page 220 may contain text, pictures, or forms comprised of embedded text fields, checkboxes, or other types of data that is to be displayed on the web client using web browser 210. Consequently, HTML document 250 defines the web page 220 that is rendered by web browser 210. For example, the following set of markup symbols directs web browser 210 to display a title, a heading, and an image called "image.jpg":
<TITLE> This is a document title </TITLE>

 This text uses heading level one

In the above example, markup symbols (e.g. "<" and ">") indicate where each HTML command (e.g. TITLE) begins and ends. An HTML command, which is typically surround by markup symbols, provides the web browser with instructions to execute. Markup symbols typically surround an HTML command. The "<" symbol indicates the start of an HTML command an the "</" symbol indicates the end of an HTML command. Each start or end command has a corresponding ">" to indicate the close of that particular command. Information associated with the HTML command may be contained within the HTML command's start and end symbols. An HTML command is used by the web browser 210 to determine how to process the block of information associated with the two commands.
In the above example, "<TITLE>", and "</TITLE>" are examples of HTML commands surrounded by markup symbols. The "</TITLE>" HTML command directs web browser 210 to place the text "This is a document title" in the title bar of web browser 210.
Some HTML commands have attribute names associated with the command. For example, HTML command "", directs web browser 210 to display an image. A "SRC=" attribute identifies the location and name of the image to be displayed. In the above example, the statement "" tells the web browser to display an image named "image.jpg" that can be obtained from the web server located at "http://www.idealab.com."
Embedding a Form into a Web Page
An HTML file may also contain HTML commands that cause the web browser to render a web page that contains fields for entering data. The portion of the web page that contains the data entry fields may be referred to as a form (e.g. the portion enclosed in the HTML tags <FORM></FORM>). When the web page is comprised of primarily data entry fields the entire web page is sometimes also referred to as a form. As is discussed below, HTML includes an HTML form command that may cause the browser to display data entry fields. A text box, a drop down menu, a check box, a command button, a toggle button, or any other kind of interface component capable of receiving input are some examples of the type of data entry fields that may be placed in a form. Data is manually entered into the fields by the user and then submitted to a web server for processing. As previously discussed, when a user wishes to use a form to purchase a product, for example, the user manually fills in text boxes located on the form with the type of information needed to carry out the transaction. Other types of data entry fields require the user to select from one or more options such as in the case of a menu, a toggle button, or a radio button, for example. When the form is complete the user submits the completed form to the vendor's web server by pressing a command button, for example.
A problem with collecting information from the user in this manner is that the user is required to manually enter data into the fields of a form. This takes time and becomes unnecessarily burdensome when the user wishes to complete more than one form with the same information.
FIG. 3 provides an example of, a form created using the HTML definition language. Code block 310 contains HTML command examples. When a document comprising code block 310 is transmitted to web browser 300 executing on web client 330, it causes form 305 to be displayed. Web browser 300 displays form 305 by parsing the HTML commands contained in code block 310 and then using the information obtained to format form 305. Once the user finishes entering information into form 305, the user may submit the form by pressing command button 331. Pressing command button 331 sends the information entered by the user in form 305 to web server 320 using the POST method. However, one of ordinary skill in the art could modify code block 310 to use the GET method instead of the POST method.
The <FORM> command shown in code block 310 indicates the beginning of a form. Once the initial FORM command is placed into the HTML document other HTML commands may be entered between the initial FORM command and the closing FORM command (e.g. </FORM>) that represent, for example, one or more data entry fields such as a text-box, drop-down lists, check boxes, radio buttons, and input buttons. The INPUT command is used to specify different types of data entry fields. The type of data entry field created is dependant upon the value assigned to the INPUT command's TYPE attribute. For example, the INPUT command can create a text-box, a password field, a hidden field, a button, a radio button, or a checkbox. A "text" value assigned to the TYPE attribute of an INPUT command creates a text box, for example. Similarly, a TYPE of "checkbox" creates a checkbox. The following code, if inserted after the FORM element, creates a text box and a checkbox:
<INPUT TYPE="text" NAME="user_name">
<INPUT TYPE="checkbox" NAME="user_item1">
The HTML tags and text contained in code block 310, for example, create form 305 when displayed using web browser 300.
A <FORM> tag may contain an ACTION and/or METHOD attribute. The ACTION attribute specifies what program on the server to execute when form 305 is submitted for processing. The METHOD attribute describes how data entered into the form is handled. There are two METHOD choices: GET and POST. Each one of them is capable of processing the data entered into a form. To illustrate, if a user named Bill who resides at 130 West Union Street, Pasadena, Calif. 91103 with a credit card number of 1111272733334141 completes the Name Address, and Credit Card number fields shown on form 305 by filling in spaces 345-347, then the following data string 350 is created and sent to web server 320.
user_name=Bill&user_address=130 West Union Street
Pasadena CA 91103&user_cc=1111222233334444
This data string may be handled by either the GET method or the POST method. However, in FIG. 3 it is handled by the POST method. The GET method appends information entered into form 305 by the user onto the end of a Uniform Resource Locator (URL 335) or in a QUERY_STRING environment variable. URL 335 is submitted to web server 320 by web client 330 in an HTTP request 315. Web server 320 is responsible for processing the submitted information. A problem with the GET method is that the information contained in URL 335 is not stored on web client 330 for later use and cannot therefore be later used to populate form 305. With the POST method, the information placed into form 305 by the user is placed into the data stream of the HTTP protocol. This allows web server 320 to process form 305 data using the standard input data stream to a separate program or script on the server. Standard input is a method for providing a program or script with data that is well know to programmers skilled in the art. The POST method also does not provide a way to store data on web client 330 for later use.
The ACTION attribute of the FORM tag indicates where the computer program tasked with processing data string 350 resides. For example, the following portion of code block 310 specifies that a computer program (e.g. a PERL script) named form_processor.pl is located in cgi-bin 321 of sever 320.
<FORM METHOD=POST ACTION=http://server320
/form_processor.pl>
The form_processor.pl program is responsible for processing data string 350. Programs that utilize the Common Gateway Interface (CGI) standard are typically located in a common directory (e.g. cgi-bin 321). CGI is a specified standard for communicating between HTTP servers and server-side gateway programs. A CGI program is capable of storing data supplied by the user, but it cannot determine whether the user asking for the form is the same user that previously submitted data to the CGI program. If the user has never visited the web site before, the CGI program does not have any information about that user. CGI programs can collect information about users who visit a web site, but such programs cannot collect information about users who have never visited the web site.
The program "form_processor.pl" used in the above example is an example of a server-side program that processes data input by the user via form 305, for example. When form 305 is submitted web server 320 executes the "form_processor.pl" program and passes the data that was entered by the user and then sent from web client 330 to server 321. That is, data string 350 is passed to "form_processor.pl" when a form is submitted. When the gateway program is done processing data string 350 the result is sent to server 320 and a response may be forwarded back to web client 330. Gateway programs can be compiled programs written in languages such as C or C++ or they can be executable scripts written using a scripting language such as PERL, TCL, or various other language. Once data string 350 is processed it may be stored on server 320 in data store 322. A problem with using CGI programs is that since they are located on the server, information cannot easily be saved on the web client for later use.
Thus, existing mechanisms for processing forms reside on the server and are unable to populate a form on the client with user data from users that have never visited the web site having the form (e.g. the data is only available to web servers the user has previously visited).
One example of data that may be stored on the client is a cookie. A cookie is an HTTP header that consists of a text-only string. The text-string is entered into the memory of a web client and accessible by the web browser. This text-string is initially set by the computer serving the web page and consists of the domain name, path, lifetime, and value of a variable that the server sets. If the lifetime of this variable is longer than the time the user spends at that site, then the text-string is saved on the web client for later use. As a result, cookies provide a way to store and later recall values entered into a web page by the user. For example, cookies allow a web server to individually customize a web page for each user who visits the page.
A cookie may be used to populate the elements of a form that a user has previously completed. For example, referring now to FIG. 9, if a user completes field 945-947 of form 905 and submits it to server 920 via submission path 915, server 920 can place the data submitted by the user in cookie 931 by sending web client 910 data via path 925. If the user returns to form 905 again Web browser 930 executing at web client 910 may use the data saved in cookie 931 populate fields 945-947 with the data previously entered by the user. Thus, a cookie can free the user from having to complete form 905 more than once. Cookies can be used to fill forms the user has previously visited. However, the data that is stored by the cookie cannot be used to populate other forms. That is, a problem with cookies is that forms located on different servers are not provided access to the same cookie. Only web servers that are listed as having permission to access a particular cookie may obtain such access.
A cookie is only accessible to the server that set, or created it. Thus, a second form cannot use the first form's cookies to obtain the user's name and address. For example, the web server located at www.merchantA.com may be allowed to read a cookie, but the web server located at www.merchantB.com may not be allowed to read the cookie created by www.merchantA.com
Referring now to FIG. 4, the process used to create and retrieve a cookie is illustrated. Initially, web browser 401 which resides on web client 400 issues a request 410 for web page 415 from web server 450. Web server 450 responds by sending a copy of web page 415 to web client 400 via response 411. Web client 400 uses web browser 401 to display web page 415 to the user. To create a cookie 460, web server 450 sends a "Set-Cookie" command in the header line contained in response 411. For example, in response to a request 410, web server 450 may send the following command in HTTP response 411:
Set-Cookie: NAME=VALUE; expires=DATE; path=PATH;
domain=DOMAIN_NAME; secure.
The NAME and VALUE parameter contain the information included in the cookie. DATE is the time at which the cookie expires and is thus no longer saved on web client 210. DOMAIN is the host address or domain name for which the cookie is valid. For example, if a cookie is set by a computer having a domain name of www.merchantA.com, only the server responsible for that particular domain name is provided access to the cookie. The PATH parameter specifies a subset of URL's at the appropriate domain for which the cookie is valid. If the keyword secure is used then the cookie is only transmitted over a secure connection. All of these parameters except the NAME=VALUE are optional to set a cookie. Once the Set-Cookie command is sent to web client 400 a cookie 460 is placed on web client 400.
To create a cookie 460 using the UNIX operating system, for example, web server 450 could execute the following shell script in response to a request 410:
echo Content-type: text/html
echo Set-cookie: FooBar=foo; expires=Wednesday,
02-11-99 12:00:00 GMT
echo
A Cookie named Foobar containing the text
foo is now present on your computer</H>
This script stores "FooBar=foo" on web client 400. The following script allows web server 450 to read the HTTP cookie:
echo The data supplied here was obtained from a
cookie:

echo $HTTP_COOKIE
Once cookie 460 is created, the information stored in the cookie can be used in many different ways. Information in cookie 460 may be accessed by a script that has authorization to insert cookie 460 data into a form, for example. However, a problem with cookies that no authentication mechanism is required to obtain the information they store. A cookie is a text file and is not stored in encrypted form. While a browser may limit access to a cookie, the text that is stored in the cookie may be accessed or read by any program that can read a text file. Therefore, it is not wise to store any sensitive data in a cookie. An additional problem with cookies is that users do not have to enter a user name and password to obtain access to the cookie.
Predefined Paste Operation
Some web browsers provide users with a mechanism for pasting predefined data into a form. Under the generic preferences menu of the Opera web browser, for example, the user can select a command button labeled personal information. When this command button is selected a dialog box that contains fields for entering personal information opens. If the user desires, the user can enter a name, an address, a phone number, an e-mail address, and/or any other kind of information into the text fields of the dialog box.
Once the user enters information into the fields of the dialog box and clicks "OK" the information that was entered can be pasted into the fields of a form by performing a right click operation. For example, if the user encounters a form that has a place for entering an address, the user can elect to paste the address previously specified in the dialog box by first selecting the address field and then right-clicking on a pointing device such as a mouse and selecting from a drop down menu the item titled "insert address".
A problem with pasting information into the fields of a form in this manner is that the user is required to manually select the place to insert the information and the type of information to insert into that place. Another problem is that unauthorized users are not prevented from accessing the information entered into the dialog box.
A method and apparatus for populating a form with data is described. One embodiment of the present invention executes on a web client that is connected to a computer network such as the Internet. The web client is capable of obtaining web pages that contain forms from the Internet. The web client contains computer code, such as a form completion program, configured to enable a user to populate a form with data. The form completion program interacts with a target application (e.g. a web browser) installed at the web client to provide the user with a mechanism for filling out multiple forms. The form completion program, for example, provides the user with a mechanism to complete a form by dragging a graphical representation of a data set over to the form and then dropping it.
In one embodiment of the invention, a form is displayed to the user via the target application. Each form has one or more data receptacles. The data receptacles of a form are filled with data when the user executes a data population command. The form completion program executes the data population command when a graphical representation of a particular data set is placed over the form. The form completion program collects data from the user via a data collection interface. The data collection interface provides data entry fields for the user to enter a particular type of information (e.g. a data set). Each data set that is entered using the data collection interface is stored in an encrypted manner and is accessible to users who enter the appropriate information into an authentication mechanism.
To populate a form with data the form completion program obtains an image of the form and then searches for a template file that resembles the form image to within a certain threshold. The template files are typically stored on the computer hosting the target application in a template directory that is arranged according to a predefined structure. The form completion program is configured to search for templates that resemble the form image in the template directory to within a certain threshold. However, the invention also contemplates searching for templates at alternate locations. Templates, for example, may reside on any other computer that is accessible via a telecommunication medium such as a computer network.
The form completion program examines each template file in order to determine if one or more of the template files resembles the form image to within a certain threshold. If a template file that resembles the form image to within a certain threshold is located, then the form completion acknowledges that a match occurred. When a match occurs the form completion program utilizes the template file to identify what kind of data to insert into each of the form's data receptacles. For example, the template file allows the form completion program to determine which of the data receptacles contain personal information and which data receptacles contain payment information. Once the form completion program successfully identifies what kind of data to insert into each data receptacle the program begins to input the appropriate kind of data into the appropriate data receptacle.
The present invention contemplates the use of multiple techniques to insert information into the data receptacles. The technique used is largely dependent upon the type of target application used to display the form.
FIG. 1 is a block diagram of the various components used by the World Wide Web.
FIG. 2 is a block diagram illustrating the components used to create a web page.
FIG. 3 is a block diagram illustrating how web client interacts with a web server to display a form.
FIG. 4 illustrates the process used to create and retrieve a cookie.
FIG. 5 is an illustration of the process used by one embodiment of the invention to populate a form.
FIG. 6 illustrates some of the actions the form completion program listens for when it is in the listening mode.
FIG. 7 is an example of several of the interfaces presented to the user by the form completion program.
FIG. 8 illustrates the execution environment of one embodiment of the invention.
FIG. 9 illustrates the process used by cookies to save form data.
FIG. 10 is a block diagram illustrating how data is collected from the user in one embodiment of the invention.
FIG. 11 is a block diagram illustrating how the shopping interface used by one embodiment of the invention interacts with a target application.
A method and apparatus for populating a form with data is described. In the following description numerous specific details are set forth in order to provide a more thorough understanding of the present invention. It will be apparent, however, to one skilled in the art, that the present invention may be practiced without these specific details. In other instances, well-known features have not been described in detail so as not to obscure the invention.
One embodiment of the present invention executes on a web client that is connected to a computer network such as the Internet. The web client is capable of obtaining forms from the Internet and contains computer code configured to allow a user to populate a form with data. In one embodiment of the invention, a form completion program is created to execute the invention.
The form completion program interacts with a target application (e.g. a web browser) installed at the web client to provide the user with a mechanism for filling out multiple forms. The target application displays forms to the user. The form completion program may have multiple interfaces that each provide the web client 1015 with additional functionality. For example, referring now to FIG. 10, a data collection interface 1000 is shown. The data collection interface 1000 may be used to collect and store multiple data sets from multiple users. A data set is a collection of related information (e.g. payment information or personal information) that represents any kind of information likely to be used to complete a form.
In one embodiment of the invention, the data collection interface collects a data set via a data collection form 1005. Data entered into the data collection fields 1006-1009 of the data collection form 1005 may be stored in secure storage medium 1010. The data stored in storage medium 1010 is utilized to populate a form when the user issues a form population command. The data held in secure storage medium 1010 may be encrypted and reside on web client 1015 and/or any other computational device available via a network communication medium. A user is not permitted to access secure storage medium 1010 until properly authenticated.
Each data set stored in secure storage medium 1020, may be associated with a graphical representation 1120. Referring now to FIG. 11, for example, a data set comprising payment information may be represented by a credit card graphic. A data set comprising personal information may be represented by an identification card graphic. A data set may be associated with any type of graphic. In one embodiment of the invention, the graphical representations of each data set are displayed to the user via a shopping interface 1125. The shopping interface may be used to execute a form population command. When executed, a form population command completes form 1135. Form 1135 is displayed via a target application 1103 such as a web browser or other computer program.
The form completion program executes the data population command when a graphical representation 1120 is moved from the shopping interface 1120 to form 1135. The data population command fills data receptacles 1136-1139 with data taken from secure storage medium 1010. For example, if the user encounters a form 1135 that prompts the user for personal information (e.g. name, address, and phone number), then the user could provide that information to form 1135 by dragging a graphic (e.g. graphic 1120) that represents the user's personal information from form completion program to form 1135. When the user drops the graphical representation 1120 of the information onto the form 1135, the data population command places data into the appropriate place of the form by obtain the data from secure storage medium 1010, identifying what type of form 1135 is to be populated, and then using this information to fill the fields 1136-1139 of form 1135 with data. In one embodiment of the invention, the type of form 1135 that is to be populated is identified by a template file. However, the manner with which a form is populated is dependent upon the type of form that is being populated.
The form completion program, for example, provides the user with a mechanism to complete a form by dragging a graphical representation of a data set over to the form and then dropping it. Anytime the user encounters a form the user may elect to populate the form by performing this drag and drop operation.
In one embodiment of the invention, the data receptacles of a form are filled with data when the user executes a data population command.
A form may be created using HTML or any other programming language capable of generating a document that provides a place for the user to enter data (e.g. a data receptacle). For example, a spreadsheet, a word processing document, a document created using PDF, a database table, or any other type of document having one or more data receptacles may be referred to as a form. A data receptacle is a field or place for holding and/or receiving data.
Data Population Command
In one embodiment of the invention, the data population command is executed by a form completion program. The form completion program may be configured to collect data from the user and execute a data population command when the user performs a drag and drop operation. Other types of computer programs, however, may also collect data from the user and perform a data population command. For example, an operating system, a dynamic link library, a Java applet, or any other type of executable computer program may be configured to execute a data population command.
The form completion program aids in the process of collecting data from the user by prompting the user for information likely to be required to complete a form. For example, the user might be prompted to enter personal information (e.g. name, address, phone number, etc.) and payment information (e.g. American Express number, Visa card number, MasterCard number). Once information is gathered, the form completion program creates a graphic that is representative of the type of information collected. For example, if the user provides the form completion program with payment information such as a Visa Card or MasterCard number, then a graphic is created that represents the form of payment information the user supplied. For example, an icon depicting a Visa Card, MasterCard or other such card might be displayed. If the user provides personal information, such as a name and address, then a graphic is created that identifies the data associated with that particular personal information. For example, an image resembling a drivers license or identification card might be displayed. Each graphical representation that is created is associated with a different data set. The user may elect to create additional data sets that have a corresponding graphical representation. The user may customize the type of data set collected and the graphics associated with that data set. A graphic may represent any kind of data. The form completion program utilizes the information the user supplies (e.g. the data set) to populate a form. For example, when a graphic that is representative of a particular type of data is dragged from the form completion program and dropped on a form the data population command is executed, and the form is completed without requiring more input from the user.
When the user executes the data population command, data is placed inside the data receptacles of the form on which the user executed the data population command. Multiple data sets/graphics may be used to populate the same form. For example, a graphic representative of a credit card may be used to populate the form with credit card data and a graphic representative of a user's personal information may be used to populate the form with personal information.
Various types of data may be placed into each data receptacle. For example, executing a data population command may insert text data, image data, and/or any other type of data into one or more data receptacles. In one embodiment of the invention, the data utilized to populate the form is supplied by the user and stored on the user's computer before execution of the data population command. However, it is possible to obtain data from other sources. For example, the data population command may obtain data from a memory device that is available via a communication medium such as a computer network. The user executes a data population command by moving a graphical representation of the data from a first location to a second location.
Referring now to FIG. 5, an illustration of the process used by one embodiment of the invention to populate a form is shown. The user initiates a data population command at step 500 by performing a drag and drop operation. Once the user issues a data population command the form completion program proceeds to step 503 where an attempt is made to determine what type of target application is displaying the form that is to be populated. For example, the form completion program may determine that the user is attempting to populate a form displayed using the Internet Explorer web browser. The type of application displaying the form to the user is referred to as the target application.
When the target application type (e.g. Internet Explorer) is determined, then the form completion program proceeds to step 506. At step 506, the form completion program determines whether it recognizes the target application. The form completion program may be configured to support a variety of different target applications.
If the target application is recognized the form completion program proceeds to step 509 where it begins to communicate with the target application in a manner understood by the target application. If the target application is not recognized, then a return value is sent, at step 519, and the form completion program informs the user that this type of target application is not yet supported. At step 509, the form completion program is configured to interact with different target applications using a variety of different communication techniques. A form displayed using Internet Explorer may be dealt with in a different way than a form displayed using Netscape Communicator (e.g. a different interface protocol may be used). The COM interface, for example, is used to communicate with Internet Explorer 4. However, the present invention also contemplates the use of other interfaces and API's such as ActiveX or Javascript. The type of protocol utilized by the form completion program is dictated by the target application. The present invention contemplates the use of a protocol capable of communicating with the target application. It is possible to utilize a variety of different protocols to open a communication channel between the form completion program and the target application.
Once step 509 is complete, the communication channel between the form completion program and the target application is open. This allows the form completion program to proceed to step 511 where it captures the location of the form. For example, if the form is displayed using a web browser, the form completion program will capture the Uniform Resource Locator (URL) that identifies where the form is located. The URL provides the form completion program with the address information needed to determine where the form being populated was obtained. For example, the URL may indicate that the user obtained the form from another computer accessible via a communication medium such as a network. At step 513, the form completion program builds an image of the form the target application displays to the user. In one embodiment of the invention, the form completion program builds the form image by querying the computer (e.g. the server) that originally supplied the form to the target application. However, the form completion program may build a form image by querying any computer that has a version of the form that is displayed to the user. For example, the form image could be built by contacting a mirror server instead of the original server. The form completion program may also build the form image by querying the target application about its form properties or the form completion program may elect to utilize a local version of the form that is displayed to the user. For example, the form completion program may utilize a cached version of the form to build a form image. The present invention contemplates various techniques for building a form image. It is possible to utilize any version of the form the user is attempting to populate in order to build the form image.
Once an image of the form the user is attempting to populate is produced, the form completion program proceeds to step 515 where it searches for a template file that resembles the form image. The template file comprises a collection of form descriptions. In one aspect of the invention, the template file is a text file that contains one or more form descriptions. Each form description is typically associated with a particular form. However, one description may represent multiple forms if the forms are substantially similar to one another. Each form description in the template file is associated with a regular expression and a list of controls. Each control has an index, a symbol, and a control type description.
The index associates a number with each control that resides on a form. For example, if a form contains a button control and a select box control the template file may identify information about each of these controls by associating the number zero with the button control and the number one with the select box control. The template file may also contain a plain text name for each control. In one embodiment of the invention, each control is associated with a symbol. The symbol represents the data that is to be placed inside the fields of the form. For example, the symbol can represent a name, date, or gender. Each control also has a control type description that identifies what type of control is present. The control type description, for example, may be utilized by the form completion program to determine what steps are required to populate the control with data. The way a text box is filled, for example, may be different from the way a check box is completed. A text box may accept raw textual data whereas a check box may accept a Boolean value.
In one embodiment of the invention, each form in the template file has a regular expression associated with it. The regular expression describes a set of one or more forms that a particular template file resembles (e.g. by using a string of text, such as a URL, that is contained within a form) and thereby provides information that may be used to perform a string matching operation. String matching provides the form completion program with a way to determine whether the template file resembles a form to within a certain threshold. For example, if the URL of a form contains a word that starts with W followed by a period and three more letters, this information can be stored in the regular expression and used to verify that the correct template file is being used to complete the form.
If the form completion program attempts to complete a form that is not represented in the template file, a list of the data that was collected from the user is displayed. When the list is displayed, the user may elect to manually intervene by dragging information from the list onto the form. If, for example, the user wishes to place address information into one of the data receptacles contained on a form, the user can drag the address data from the list to the form. At this point, the information placed over the form is inserted into the appropriate data receptacle. The user may repeat this process to fill-in the remaining data receptacles. In one embodiment of the invention, the actions of the user may be used to generate a form description. For example, if a user manually completes a form, the form completion program may track the information the user elected to place in the forms various data receptacles. This information may then be transmitted to a third party for verification and utilized to generate a new form description for the template file. In one embodiment of the invention, a different template file is created for each form. However, a single template file may represent more than one form. For example, a generic template that operates on forms that adhere to a set of predefined standards may be created and later verified by an independent party. The template may store information using a variety of formats such as binary, hexadecimal, or text (e.g. ASCII or XML). It is also possible to use other methods for representing information. A template file, for example, may be an executable file, a compressed file, and/or any other form of storing digital information. For example, a template file may be included in the form (using ECML, inband tems).
The template files are typically stored on the computer hosting the target application in a template directory. The form completion program is configured to search for templates that resemble the form image in the template directory to within a certain threshold. However, the invention also contemplates searching for templates at alternate locations. Templates, for example, may reside on any other computer that is accessible via a telecommunication medium such as a computer network.
The form completion program examines each template file in order to determine if one or more of the template files resembles the form image to within a certain threshold. For example, if a percentage of the template file is similar to the form image then the form completion program may assume that a match occurred. In one embodiment of the invention, the threshold percentage is thirty percent. However, the present invention contemplates the use of any percentage indicative of a match. For example, in some instances a threshold percentage lower than thirty percent indicates a match whereas in other instances a percentage greater than thirty percent indicates a match. The percentage chosen is largely a result of how much the form has changed since the template file was created. If, for example, a form has added new graphics, but has substantially the same text as when the template was created, then the template file will resemble the form image to a greater percent than it would if the text or number of data receptacles on the form were changed.
If a template file that resembles the form image to within a certain threshold is located, then the form completion program proceeds to step 517 where it acknowledges that a match occurred. If no match is found the form completion program informs the user that the data population command was not successfully completed. At this point the program may execute step 519 and exit. Otherwise, the form completion program executes step 518 where the information obtained from the template file is utilized to populate the form.
The form completion program utilizes the template file to identify what kind of data to insert into each of the form's data receptacles. For example, the template file allows the form completion program to determine which of the data receptacles contain personal information and which data receptacles contain payment information. Once the form completion program successfully identifies what kind of data to insert into each data receptacle the program begins to input the appropriate kind of data into the appropriate data receptacle. The user's name, for example, is placed in all data receptacles that expect such information and the user's credit card number is placed in all data receptacles that expect credit card information.
The present invention contemplates the use of multiple techniques to insert information into the data receptacles. The technique used is largely dependent upon the type of target application used to display the form. If, for example, the form is displayed using the Internet Explorer web browser the form completion program populates the data receptacles by sending a command to the browser that tells the browser which string belongs in which data receptacle (e.g. insert name into data receptacle 1). If the form is displayed with the Netscape web browser, the technique for inserting information into the data receptacles differs. When Netscape is used, data is inserted by grabbing standard input and emulating keystrokes. Each keystroke inserts a character of information into the appropriate data receptacle. To move from one data receptacle to the next the set focus system message is sent (WM_SETFOCUS). However, the invention contemplates using other methods such as emulating the tab key. Once information is properly inserted into the appropriate data receptacles, the data population command is complete.
The Form Completion Program:
In one embodiment of the invention, the form completion program uses a registry with the operating system (OS) to assure proper execution. The registry contains multiple fields. Each field contains information that may be utilized by the form completion program during execution. An example of the kind of fields that may be placed in the registry follows.
Field Name Description
InstallPath Contains the path of installed program
UpdateFile Contains the name and path to copy to be deleted
LastUser Contains the name of last user
Coordinate Contains the horizontal coordinate (in pixel), of
X the program window
Coordinate Contains the vertical coordinate (in pixel), of the
Y program window
Server URL Contains URL(s) where update routine should
check for a new version of the program
When the form completion program is installed, a directory structure is created that contains files used by the form completion program during execution. This directory contains the form completion program and two sub-directories: "user" and "data". The "user" sub-directory contains as many sub-directories as there are users. Each sub-directory contains one file called by the login name of the user, followed by the extension ".dat". This file contains encrypted data about the user (e.g. address, credit card information, electronic money, etc.). The "data" sub-directory contains general information utilized by the form completion program during execution. For example, graphical images that represent various kinds of data, web site information, and other information useful to the form completion program is placed in the "data" sub-directory. The information placed in the "data" sub-directory is organized in a tree of one or more additional sub-directories.
The "domain" sub-directory, for example, is located within the "data" sub-directory. In one embodiment of the invention, the "domain" sub-directory contains a database of information that is used by the form completion program to populate a form. For example, the database may contain a list of web sites (e.g. domain names) having forms that can be populated. Template files associated with each domain name are also placed in the database.
The database contains sub-directories listing each of the top-level domain names (e.g. .com, .net, .org, etc. . . . ). Each sub-directory of top-level domain names contains a tree of sub-directories organized in alphabetical order. When the form completion program initially launches, a startup routine begins to execute. The startup routine performs a number of checks to ensure that the program is running properly. The form completion program then launches a separate process, called a thread, to determine if the form completion program that is running is the most current version available. The process determines if the program is current by contacting a server. The server responds by transmitting an update signal to the form completion program that indicates whether or not the program is indeed out of date. If the form completion program is out of date, the program starts the download-update process.
After running the start-up checks the form completion program enters a listening mode. While in listening mode the program listens for any action that occurs within the display space of the form completion program, or hot keys. For example, the program listens for actions received from the operating system (e.g. mouse pointer selection, keyboard key stroke, voice commands, etc. . . . ). These actions are handled by the application action listener which generates commands according to an action-to-command map.
FIG. 6 illustrates some of the actions the form completion program listens for when it is in the listening mode. When an action is triggered that is bound to a command (e.g. those being listened for), the form completion program runs the segment of code responsible for performing the corresponding action. If, for example, the form completion program is in listening mode 600 and the user initiates a login action 601, then the program performs a login operation 602. In one embodiment of the invention, the login operation ensures that users are properly authenticated before being allowed access to sensitive data. For example, users are not permitted to access personal information such as a credit card number without first being authenticated. A user is authenticated when the user enters the correct login and password information.
However, in one embodiment of the invention, the user's password information is not stored by the form completion program. To determine if the user's login and password information is correct, the form completion program determines if the user has logged in before by examining whether a directory having the name entered by the user as a login parameter exists. If the user has not previously logged in, the user is asked to provide a login name and a password. If the user has previously logged in (e.g. the user's directory exists), then the program generates a 32-bit number using a CRC Algorithm. A random number key is generated using the CRC output as a seed. If the correct random number is generated, the user is authenticated. At this point, the user is permitted to access the user's sensitive data. This technique is beneficial because it enables the form completion program to authenticate a user without having to permanently store the user's password information. The present invention also contemplates the use of various authentication schemes that are known in the art and is not limited to the process discussed herein.
In one embodiment of the invention, after the login operation is performed the form completion program proceeds to step 603 where it determines if the user is a new user. If the user is new, the form completion program advances to step 604 where it shows the user a data collection interface. Once the user enters data into the data collection interface, the program executes step 605 where it displays a shopping view to the user. The shopping view is comprised of one or more graphical representations of the user's sensitive information.
It is possible for other types of actions to transpire while the form completion program is in listening mode. For example, the user might wish to perform a shopping action 606. When a shopping action 606 occurs the form completion program performs a shopping operation 607. In one embodiment of the invention, a shopping action occurs when the user selects an image indicative of a particular shopping destination. For example, if the form completion program displays a list of web sites to the user, a shopping action 606 occurs when the user selects one of the web sites on the list. When the user initiates the shopping action 606 it causes the form completion program to perform step 607 where a web browser window is displayed to the user containing the web page the user selected from the list.
When a search action 608 occurs, the form completion program performs a search 609. For example, in one embodiment of the invention the form completion program contains a location for the user to enter a search query and a way to identify a preferred search engine. If the user enters a search query and submits the query a search 609 is performed. The form completion program responds by passing the search parameter entered by the user to the preferred search engine identified by the user. The results of the search are displayed inside of a web browser window that runs external to the form completion program.
If an update action 610 occurs, the form completion program performs an update 611. During an update operation 611 the form completion program checks to see if the version of the program currently executing is the most recent version available. In one embodiment of the invention, the update operation 611 queries a server via a network to determine the latest available version is. If the form completion program currently executing is in need of a version update, the program starts an update thread to handle the update process. When the execution of the update process is complete, the form completion program running is the most recent version. The update operation 611, for example, may be utilized to add functionality to the form completion program.
The form completion program may be configured to listen for actions other than the ones identified in FIG. 6. For example, the user may customize the program to listen for a specific type of action. The present invention also contemplates action added by the update operation 611.
When a FillOut Information action 612 is performed the form completion program executes step 613. At step 613, the user is prompted for information. In one embodiment of the invention, the user is shown a data collection interface that provides locations for the user to enter a particular type of information. For example, the user may be prompted for personal information, payment information, and/or any other type of information deemed necessary to populate a form. This information may be associated with an image file, text file, multimedia file, or other representation of the data entered into the data collection interface.
If a FillOut Form action 614 occurs, the form completion program executes a data population command 615. The data population command 615 provides the user with a mechanism for populating a form. When the user elects to stop running the form completion program, a quit action 616 occurs. When a quit action 616 executes the form completion program returns to an inactive state.
Referring now to FIG. 7, an example of several of the interfaces presented to the user by the form completion program is shown. When the user initially opens the form completion program, a login interface 715 is displayed which provides the user with locations for a user name 711 and password 712. In one embodiment of the invention, a login action 601 occurs when the user enters the appropriate information into the login interface 715 and presses the return key.
If the user is properly authenticated the form completion program displays a data collection interface 720. The data collection interface 720 contains one or more fields 705-709 for entering data. When the user enters data into these fields 705-709 the data is stored for later use during a form population command. There are several different types of data collection interfaces 720. Each type is used to obtain a different data set from the user. For example, the user is presented one interface for entering payment information and another interface for entering personal information.
If, for example, the data collection interface 720 intended for collecting payment information is displayed, the user is provided with one or more fields 705-709 for entering data. Each field is intended to store a different type of information. For example, field 705 is used to collect the form of payment (e.g. American Express) the user wishes to utilize for later populating a form. Fields 706-709 provides a place for the user to enter information related to the form of payment identified. The name of the issuing bank is entered into field 706. The account number of the identified card is entered into field 707 and the expiration date and name on the card are entered into fields 708 and 709.
Once the user enters such information into fields 705-709 it is stored by the form completion program for later use. In one embodiment of the invention, the data collected via the data collection interface is stored on the computer having the form completion program in encrypted form and protected from unauthorized users by an authentication mechanism. For example, data about a particular user may be stored in a directory bearing the user's login name. Before access is granted to the information in that directory the user is prompted for a name and password. If the appropriate user name and password is entered, then access is granted to the specified user's data. When the correct information is not entered access is denied. This permits multiple users to make use of the form completion program and prevents unauthorized users from inappropriately obtaining access to another users data.
In one embodiment of the invention, each collection of data entered into the data collection interface 720 is associated with a representation of that data. The representation may be in the form of image data, text data, multimedia data, and/or any other kind of data. For example, if data collection interface 720 prompts the user for payment information, a graphic representing that payment information (e.g. a Visa Card graphic) will be displayed to the user.
For example, the shopping interface 730 displays numerous representations 701-702 of each data set entered by the user via the data collection interface 720. Each representation 701-702 may represent a different data set. For example, representation 701 might represent a form of payment whereas representation 702 might represent a user's personal information. Additional representations may be displayed when the user scrolls either up or down using command buttons 731 and 732.
In one embodiment of the invention, a portion of the shopping interface 730 is dedicated to displaying a list 710 of web sites where the user can purchase goods and/or services. This list 710 can be changed and modified by the update action 610. The list 710 may be organized in any manner preferred by the user. In one embodiment of the invention, the list 710 is divided into categories. When the user selects a link to a particular web site from list 710, the form completion program passes the URL information identified by the users action to a web browser program. The browser program, for example, accesses the web site identified in the URL to obtain the web page identified in the URL. If after perusing through the web site the user needs to complete a form to purchase an item, the user may use the form completion program to populate the form.
To illustrate, when the user encounters a form (e.g. after shopping), the user may elect to populate the data receptacles 751-755 of that form with the information associated with a particular representative graphic. If, for example, the user wishes to fill-out form 750 with payment information, the user may cause a data population command to execute by utilizing a pointing device to drag representation 701 along path 725 until the pointing device resides over form 750. When the pointing device is located over form 750 the data population command executes. The data population command causes data receptacles 751-755 to fill with data.
In one embodiment of the invention, the user is not required to drag representation 701 over to form 750, but can instead drag an iconosized version of representation 701 to form 750 in order to initiate a data population command. The iconosized version of representation 701 is a smaller image of graphical representation 701 that requires less processor overhead to rapidly move about the display region. The invention also contemplates the use of other mechanisms to initiate a data population command. The form completion program can, for example, be configured to perform a data population command whenever the user performs an event that discernibly indicates the user wishes to populate a form (e.g. a click event or a menu event).
Embodiment of Computer Execution Environment (Hardware)
An embodiment of the invention can be implemented as computer software in the form of computer readable code executed on a general purpose computer such as computer 800 illustrated in FIG. 8, or in the form of bytecode class files executable within a Java™ runtime environment running on such a computer, or in the form of bytecodes running on a processor (or devices enabled to process bytecodes) existing in a distributed environment (e.g., one or more processors on a network). A keyboard 810 and mouse 811 are coupled to a system bus 818. The keyboard and mouse are for introducing user input to the computer system and communicating that user input to processor 813. Other suitable input devices may be used in addition to, or in place of, the mouse 811 and keyboard 810. I/O (input/output) unit 819 coupled to system bus 818 represents such I/O elements as a printer, A/V (audio/video) I/O, etc.
Computer 800 includes a video memory 814, main memory 815 and mass storage 814, all coupled to system bus 818 along with keyboard 810, mouse 811 and processor 813. The mass storage 814 may include both fixed and removable media, such as magnetic, optical or magnetic optical storage systems or any other available mass storage technology. Bus 818 may contain, for example, thirty-two address lines for addressing video memory 814 or main memory 815. The system bus 818 also includes, for example, a 64-bit data bus for transferring data between and among the components, such as processor 813, main memory 815, video memory 814 and mass storage 814. Alternatively, multiplex data/address lines may be used instead of separate data and address lines.
In one embodiment of the invention, the processor 813 is a microprocessor manufactured by Motorola, such as the 680×0 processor, or a microprocessor manufactured by Intel, such as the 80×86, or Pentium processor. However, any other suitable microprocessor or microcomputer may be utilized. Main memory 815 is comprised of dynamic random access memory (DRAM). Video memory 814 is a dual-ported video random access memory. One port of the video memory 814 is coupled to video amplifier 816. The video amplifier 816 is used to drive the cathode ray tube (CRT) raster monitor 817. Video amplifier 816 is well known in the art and may be implemented by any suitable apparatus. This circuitry converts pixel data stored in video memory 814 to a raster signal suitable for use by monitor 817. Monitor 817 is a type of monitor suitable for displaying graphic images.
Computer 800 may also include a communication interface 840 coupled to bus 818. Communication interface 840 provides a two-way data communication coupling via a network link 841 to a local network 844. For example, if communication interface 840 is an integrated services digital network (ISDN) card or a modem, communication interface 840 provides a data communication connection to the corresponding type of telephone line, which comprises part of network link 841. If communication interface 840 is a local area network (LAN) card, communication interface 840 provides a data communication connection via network link 841 to a compatible LAN. Wireless links are also possible. In any such implementation, communication interface 840 sends and receives electrical, electromagnetic or optical signals which carry digital data streams representing various types of information.
Network link 841 typically provides data communication through one or more networks to other data devices. For example, network link 841 may provide a connection through local network 844 to local server computer 843 or to data equipment operated by an Internet Service Provider (ISP) 844. ISP 844 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the "Internet" 845. Local network 844 and Internet 845 both use electrical, electromagnetic or optical signals which carry digital data streams. The signals through the various networks and the signals on network link 841 and through communication interface 840, which carry the digital data to and from computer 800, are exemplary forms of carrier waves transporting the information.
Computer 800 can send messages and receive data, including program code, through the network(s), network link 841, and communication interface 840. In the Internet example, remote server computer 846 might transmit a requested code for an application program through Internet 845, ISP 844, local network 844 and communication interface 840.
The received code may be executed by processor 813 as it is received, and/or stored in mass storage 814, or other non-volatile storage for later execution. In this manner, computer 800 may obtain application code in the form of a carrier wave.
Application code may be embodied in any form of computer program product. A computer program product comprises a medium configured to store or transport computer readable code, or in which computer readable code may be embedded. Some examples of computer program products are CD-ROM disks, ROM cards, floppy disks, magnetic tapes, computer hard drives, servers on a network, and carrier waves.
The computer systems described above are for purposes of example only. An embodiment of the invention may be implemented in any type of computer system or programming or processing environment.
Thus, a method and apparatus for populating forms is described.
1. A method for populating an electronic form with data, comprising:
receiving an invocation of a data population command;
detecting a type of a target application displaying a form to be populated in accordance with the data population command;
determining whether the detected type of target application is of a type recognized by a form completion program;
configuring the form completion program to use a communication technique corresponding to the type of target application upon determining that the target application is recognized; and
populating the form using the configured form completion program.
2. The method of claim 1, wherein the receiving the invocation of the data population command includes receiving the invocation of the data population command from a user.
3. The method of claim 2, further comprising:
generating, upon determining that the detected type of target application is not recognizable by the form completion program, a return value for providing to the target application; and
generating an indication to the user that the target application is not recognizable.
4. The method of claim 1, further comprising capturing a Uniform Resource Locator (URL) for identifying where the form was obtained.
5. The method of claim 1, further comprising building an image of the form displayed in the target application.
6. The method of claim 5, wherein building an image of the form includes querying a device that originally supplied the form.
7. The method of claim 5, wherein building an image of the form includes querying any device containing a version of the form.
8. The method of claim 5, wherein building an image of the form includes querying the target application about properties of the form displayed by the target application.
9. The method of claim 5, wherein building an image of the form includes utilizing a locally cached version of the form as a basis for building a form image.
10. The method of claim 5, further comprising searching for a template file that resembles the form image.
11. The method of claim 10, wherein populating the form using the configured form completion program includes populating the form with data responsive to finding a template file that resembles the form image to within a matching threshold.
12. A computer-readable hardware storage medium storing instructions which, responsive to execution by a processor, cause the processor to perform operations comprising:
13. The computer-readable hardware storage medium of claim 12, wherein the receiving the invocation of the data population command includes receiving the invocation of the command from a user.
14. The computer-readable hardware storage medium of claim 13, the operations further comprising:
15. The computer-readable hardware storage medium of claim 12, the operations further comprising capturing a Uniform Resource Locator (URL) for identifying where the form was obtained.
16. The computer-readable hardware storage medium of claim 12, the operations further comprising building an image of the form displayed in the target application.
17. The computer-readable hardware storage medium of claim 16, wherein the building the image of the form includes querying a device that originally supplied the form.
18. The computer-readable hardware storage medium of claim 16, wherein the building the image of the form includes querying any device containing a version of the form.
19. The computer-readable hardware storage medium of claim 16, wherein the building the image of the form includes querying the target application about properties of the form displayed by the target application.
20. The computer-readable hardware storage medium of claim 16, wherein the building the image of the form includes utilizing a locally cached version of the form as a basis for building the form image.
21. The computer-readable hardware storage medium of claim 16, the operations further comprising searching for a template file that resembles the form image.
22. The computer-readable hardware storage medium of claim 21, wherein the populating the form using the configured form completion program includes populating the form with data responsive to finding a template file that resembles the form image to within a matching threshold.
23. A client computer system comprising:
at least one processor; and
a memory device that stores programmed instructions, the instructions being executable by the processor to perform operations comprising:
24. The client computer system of claim 23, wherein the receiving the invocation of the data population command includes receiving the invocation of the data population command from a user.
25. The client computer system of claim 24, the operations further comprising:
26. The client computer system of claim 23, the operations further comprising capturing a Uniform Resource Locator (URL) for identifying where the form was obtained.
27. The client computer system of claim 23, the operations further comprising building an image of the form displayed in the target application.
28. The client computer system of claim 27, wherein the building the image of the form includes querying a device that originally supplied the form.
29. The client computer system of claim 27, wherein the building the image of the form includes querying any device containing a version of the form.
30. The client computer system of claim 27, wherein the building the image of the form includes querying the target application about properties of the form displayed by the target application.
31. The client computer system of claim 27, wherein the building the image of the form includes utilizing a locally cached version of the form as a basis for building the form image.
32. The client computer system of claim 27, the operations further comprising searching for a template file that resembles the form image.
33. The client computer system of claim 32, wherein the populating the form using the configured form completion program includes populating the form with data responsive to finding a template file that resembles the form image to within a matching threshold.
US13/113,258 1999-10-29 2011-05-23 Method and apparatus for populating a form with data Active 2022-08-05 US9081756B2 (en)
US09/430,535 US6589290B1 (en) 1999-10-29 1999-10-29 Method and apparatus for populating a form with data
US11/413,680 Continuation US7962845B2 (en) 1999-10-29 2006-04-28 Method and apparatus for populating a form with data
US09/430,535 Active US6589290B1 (en) 1999-10-29 1999-10-29 Method and apparatus for populating a form with data
US10/426,182 Expired - Fee Related US7062706B2 (en) 1999-10-29 2003-04-29 Method and apparatus for populating a form with data
US11/413,680 Active 2022-09-14 US7962845B2 (en) 1999-10-29 2006-04-28 Method and apparatus for populating a form with data
US10019430B2 (en) 2015-02-09 2018-07-10 Thomas Ralph Rossi System and method for automatically filling out forms
US7904187B2 (en) 1999-02-01 2011-03-08 Hoffberg Steven M Internet appliance system and method
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US8381087B1 (en) 1999-07-26 2013-02-19 G&H Nevada-Tek Automated electronic document filing system, method, and article of manufacture
US7293074B1 (en) * 1999-09-20 2007-11-06 Fusionone, Inc. Performing server actions using template with field that can be completed without obtaining information from a user
US6589290B1 (en) * 1999-10-29 2003-07-08 America Online, Inc. Method and apparatus for populating a form with data
US7350071B1 (en) * 1999-11-08 2008-03-25 Avaya Technology Corp. Encrypted and non-encrypted communication of message data
US8156074B1 (en) 2000-01-26 2012-04-10 Synchronoss Technologies, Inc. Data transfer and synchronization system
US6671757B1 (en) 2000-01-26 2003-12-30 Fusionone, Inc. Data transfer and synchronization system
AU779316B2 (en) * 2000-03-16 2005-01-13 Harex Infotech Inc. Optical payment transceiver and system using the same
US20030056171A1 (en) * 2000-03-24 2003-03-20 Yutaka Yone Electronic document processing apparatus and processing method
US9292484B1 (en) * 2000-03-29 2016-03-22 International Business Machines Corporation Method and system for automatically providing information to an electronic form
US6981028B1 (en) * 2000-04-28 2005-12-27 Obongo, Inc. Method and system of implementing recorded data for automating internet interactions
US6950980B1 (en) * 2000-05-31 2005-09-27 International Business Machines Corporation System, method, and program product for saving a submitted form of a web page
AU1474802A (en) 2000-06-12 2001-12-24 Infospace Inc Universal shopping cart and order injection system
US20080306835A1 (en) * 2000-06-15 2008-12-11 American Express Travel Related Services Company, Inc. System and method for customizing an email message
US20080162298A1 (en) * 2000-06-15 2008-07-03 American Express Travel Related Services Company, Inc. Online ordering system and method
US6996768B1 (en) * 2000-06-15 2006-02-07 International Business Machines Corporation Electric publishing system and method of operation generating web pages personalized to a user's optimum learning mode
US7350139B1 (en) * 2000-06-16 2008-03-25 American Express Travel Related Services Company, Inc. System and method for utilizing a drag and drop technique to complete electronic forms
US7155667B1 (en) * 2000-06-21 2006-12-26 Microsoft Corporation User interface for integrated spreadsheets and word processing tables
US6948135B1 (en) 2000-06-21 2005-09-20 Microsoft Corporation Method and systems of providing information to computer users
US7624356B1 (en) 2000-06-21 2009-11-24 Microsoft Corporation Task-sensitive methods and systems for displaying command sets
US7000230B1 (en) 2000-06-21 2006-02-14 Microsoft Corporation Network-based software extensions
US7191394B1 (en) 2000-06-21 2007-03-13 Microsoft Corporation Authoring arbitrary XML documents using DHTML and XSLT
US7346848B1 (en) 2000-06-21 2008-03-18 Microsoft Corporation Single window navigation methods and systems
US6883168B1 (en) 2000-06-21 2005-04-19 Microsoft Corporation Methods, systems, architectures and data structures for delivering software via a network
US9800671B1 (en) * 2000-06-28 2017-10-24 Intel Corporation Repeatedly accessing a storage resource normally accessed through a web page without accessing the web page
US7568152B1 (en) * 2000-07-14 2009-07-28 International Business Machines Corporation Text file interface support in an object oriented application
US7086067B1 (en) 2000-07-14 2006-08-01 International Business Machines Corporation Dynamic Java bean for VisualAge for Java
US8073954B1 (en) 2000-07-19 2011-12-06 Synchronoss Technologies, Inc. Method and apparatus for a secure remote access system
US7895334B1 (en) 2000-07-19 2011-02-22 Fusionone, Inc. Remote access communication architecture apparatus and method
US7140045B2 (en) * 2000-07-26 2006-11-21 Sony Corporation Method and system for user information verification
US7188305B1 (en) * 2000-08-31 2007-03-06 International Business Machines Corporation Method and apparatus for providing local data persistence for web applications
US6950983B1 (en) * 2000-09-07 2005-09-27 International Business Machines Corporation System and method for populating HTML forms using relational database agents
US7330876B1 (en) * 2000-10-13 2008-02-12 Aol Llc, A Delaware Limited Liability Company Method and system of automating internet interactions
AU2002241786B2 (en) * 2000-11-02 2007-03-22 Webtrends, Inc. System and method for generating and reporting cookie values at a client node
US6845390B1 (en) * 2000-11-10 2005-01-18 Hewlett-Packard Development Company, L.P. Server-side state replication among collaborating world wide web servers
US20020069217A1 (en) * 2000-12-04 2002-06-06 Hua Chen Automatic, multi-stage rich-media content creation using a framework based digital workflow - systems, methods and program products
US20020165877A1 (en) * 2000-12-07 2002-11-07 Malcolm Jerry Walter Method and apparatus for filling out electronic forms
US7818435B1 (en) 2000-12-14 2010-10-19 Fusionone, Inc. Reverse proxy mechanism for retrieving electronic content associated with a local network
US20020112027A1 (en) * 2000-12-18 2002-08-15 Mchugh Adrian J Method of providing user-related information between devices on a data network
US7685507B2 (en) * 2001-01-22 2010-03-23 Oracle International Corporation System for editing query conditions, calculations, formulas and equations
US20020103748A1 (en) * 2001-01-30 2002-08-01 Rai Abhyanker System and method for consolidating financing in an internet exchange portal
US20020107885A1 (en) * 2001-02-01 2002-08-08 Advanced Digital Systems, Inc. System, computer program product, and method for capturing and processing form data
US7243077B2 (en) 2001-03-02 2007-07-10 International Business Machines Corporation Method and computer program product for managing an internet trading network
US7155403B2 (en) 2001-03-22 2006-12-26 International Business Machines Corporation System and method for leveraging procurement across companies and company groups
US7386495B2 (en) 2001-03-23 2008-06-10 International Business Machines Corporation System and method for processing tax codes by company group
US8615566B1 (en) 2001-03-23 2013-12-24 Synchronoss Technologies, Inc. Apparatus and method for operational support of remote network systems
US8027892B2 (en) 2001-03-28 2011-09-27 International Business Machines Corporation System and method for automating invoice processing with positive confirmation
CA2344074A1 (en) * 2001-04-17 2002-10-17 George Wesley Bradley Method and system for cross-platform form creation and deployment
US8095597B2 (en) 2001-05-01 2012-01-10 Aol Inc. Method and system of automating data capture from electronic correspondence
US20020180736A1 (en) * 2001-05-31 2002-12-05 Millmore Martin John Data entry control system
US20040205530A1 (en) * 2001-06-28 2004-10-14 Borg Michael J. System and method to automatically complete electronic forms
DE60141393D1 (en) * 2001-07-27 2010-04-08 Sap Ag Method and computer system for providing and processing a human interface description of a
EP1280055B1 (en) * 2001-07-27 2010-04-14 Sap Ag Method and computer system for creating and processing a browser compliant human interface description
EP1280054A1 (en) * 2001-07-27 2003-01-29 SAP Aktiengesellschaft Method and computer system for separating and processing layout information and data of a document
US20030061567A1 (en) * 2001-09-05 2003-03-27 International Business Machines Corporation Apparatus and method for protecting entries in a form using access rights information
US20030051039A1 (en) * 2001-09-05 2003-03-13 International Business Machines Corporation Apparatus and method for awarding a user for accessing content based on access rights information
US6892201B2 (en) * 2001-09-05 2005-05-10 International Business Machines Corporation Apparatus and method for providing access rights information in a portion of a file
US20030177248A1 (en) * 2001-09-05 2003-09-18 International Business Machines Corporation Apparatus and method for providing access rights information on computer accessible content
US20030046578A1 (en) * 2001-09-05 2003-03-06 International Business Machines Incorporation Apparatus and method for providing access rights information in metadata of a file
US7171562B2 (en) * 2001-09-05 2007-01-30 International Business Machines Corporation Apparatus and method for providing a user interface based on access rights information
US8359335B2 (en) * 2001-09-29 2013-01-22 Siebel Systems, Inc. Computing system and method to implicitly commit unsaved data for a world wide web application
US7885996B2 (en) * 2001-09-29 2011-02-08 Siebel Systems, Inc. Method, apparatus, and system for implementing notifications in a framework to support web-based applications
US7146617B2 (en) 2001-09-29 2006-12-05 Siebel Systems, Inc. Method, apparatus, and system for implementing view caching in a framework to support web-based applications
US6907451B1 (en) 2001-09-29 2005-06-14 Siebel Systems, Inc. Method, apparatus, and system for immediate posting of changes in a client server environment
US7203948B2 (en) * 2001-09-29 2007-04-10 Siebel Systems, Inc. Method, apparatus, and system for implementing caching of view custom options in a framework to support web-based applications
US7870492B2 (en) 2001-10-02 2011-01-11 Siebel Systems, Inc. Method, apparatus, and system for managing commands in a client server environment
US7212301B2 (en) * 2001-10-31 2007-05-01 Call-Tell Llc System and method for centralized, automatic extraction of data from remotely transmitted forms
WO2003044701A1 (en) * 2001-11-19 2003-05-30 Hewlett-Packard Company, A Delaware Corporation Methods, software modules and software application for logging transaction-tax-related transactions
US8689096B2 (en) * 2001-11-19 2014-04-01 Hewlett-Packard Development Company, L.P. Computer-based method, software module and computer program product for processing information in transaction-tax related applications
US7844476B2 (en) 2001-12-31 2010-11-30 Genworth Financial, Inc. Process for case-based insurance underwriting suitable for use by an automated system
US8793146B2 (en) 2001-12-31 2014-07-29 Genworth Holdings, Inc. System for rule-based insurance underwriting suitable for use by an automated system
US8005693B2 (en) 2001-12-31 2011-08-23 Genworth Financial, Inc. Process for determining a confidence factor for insurance underwriting suitable for use by an automated system
US7818186B2 (en) 2001-12-31 2010-10-19 Genworth Financial, Inc. System for determining a confidence factor for insurance underwriting suitable for use by an automated system
US7899688B2 (en) * 2001-12-31 2011-03-01 Genworth Financial, Inc. Process for optimization of insurance underwriting suitable for use by an automated system
US7844477B2 (en) 2001-12-31 2010-11-30 Genworth Financial, Inc. Process for rule-based insurance underwriting suitable for use by an automated system
US7895062B2 (en) * 2001-12-31 2011-02-22 Genworth Financial, Inc. System for optimization of insurance underwriting suitable for use by an automated system
US7178104B1 (en) * 2002-02-15 2007-02-13 Microsoft Corporation System and method for generating structured documents in a non-linear manner
US20060075070A1 (en) * 2002-04-02 2006-04-06 Patrick Merissert-Coffinieres Development and deployment of mobile and desktop applications within a flexible markup-based distributed architecture
KR20030087737A (en) * 2002-05-09 2003-11-15 주식회사 세중나모인터랙티브 Processing system of web document and processing method thereof
CA2388150A1 (en) * 2002-05-29 2003-11-29 Ibm Canada Limited-Ibm Canada Limitee Toggleable widget for a user interface
JP2004046375A (en) * 2002-07-09 2004-02-12 Canon Inc Business form processing device, business form processing method and program
US8010405B1 (en) 2002-07-26 2011-08-30 Visa Usa Inc. Multi-application smart card device software solution for smart cardholder reward selection and redemption
EP1387291A3 (en) * 2002-07-30 2005-10-19 Canon Kabushiki Kaisha Apparatus, method, recording medium and program for form processing
US20040039991A1 (en) * 2002-08-22 2004-02-26 International Business Machines Corporation System, method, and computer program product in a data processing system for dynamic variable definition within an input form
US9852437B2 (en) 2002-09-13 2017-12-26 Visa U.S.A. Inc. Opt-in/opt-out in loyalty system
US8626577B2 (en) 2002-09-13 2014-01-07 Visa U.S.A Network centric loyalty system
US8015060B2 (en) 2002-09-13 2011-09-06 Visa Usa, Inc. Method and system for managing limited use coupon and coupon prioritization
US7702999B1 (en) * 2002-11-27 2010-04-20 Dc Future Llc Network-based, information management system and method
KR100484181B1 (en) * 2002-12-02 2005-04-20 삼성전자주식회사 Apparatus and method for authoring multimedia document
JP2004234225A (en) * 2003-01-29 2004-08-19 Seiko Epson Corp Information providing device, information providing method, program and product
US7415672B1 (en) 2003-03-24 2008-08-19 Microsoft Corporation System and method for designing electronic forms
US7370066B1 (en) 2003-03-24 2008-05-06 Microsoft Corporation System and method for offline editing of data files
US7296017B2 (en) 2003-03-28 2007-11-13 Microsoft Corporation Validation of XML data files
US7913159B2 (en) 2003-03-28 2011-03-22 Microsoft Corporation System and method for real-time validation of structured data files
US7383239B2 (en) * 2003-04-30 2008-06-03 Genworth Financial, Inc. System and process for a fusion classification for insurance underwriting suitable for use by an automated system
US7801748B2 (en) 2003-04-30 2010-09-21 Genworth Financial, Inc. System and process for detecting outliers for insurance underwriting suitable for use by an automated system
US7567914B2 (en) 2003-04-30 2009-07-28 Genworth Financial, Inc. System and process for dominance classification for insurance underwriting suitable for use by an automated system
US7813945B2 (en) 2003-04-30 2010-10-12 Genworth Financial, Inc. System and process for multivariate adaptive regression splines classification for insurance underwriting suitable for use by an automated system
US7827077B2 (en) 2003-05-02 2010-11-02 Visa U.S.A. Inc. Method and apparatus for management of electronic receipts on portable devices
US7281029B2 (en) * 2003-05-13 2007-10-09 Aol Llc, A Delaware Limited Liability Company Method and system of capturing data for automating internet interactions
JP4240293B2 (en) * 2003-05-27 2009-03-18 ソニー株式会社 Multi-media playback device and multimedia playback method
US7045377B2 (en) * 2003-06-26 2006-05-16 Rj Mears, Llc Method for making a semiconductor device including a superlattice and adjacent semiconductor layer with doped regions defining a semiconductor junction
US7451392B1 (en) 2003-06-30 2008-11-11 Microsoft Corporation Rendering an HTML electronic form by applying XSLT to XML using a solution
US8645471B2 (en) 2003-07-21 2014-02-04 Synchronoss Technologies, Inc. Device message management system
US7406660B1 (en) 2003-08-01 2008-07-29 Microsoft Corporation Mapping between structured data and a visual surface
US7581177B1 (en) * 2003-08-01 2009-08-25 Microsoft Corporation Conversion of structured documents
US7334187B1 (en) 2003-08-06 2008-02-19 Microsoft Corporation Electronic form aggregation
US7454783B2 (en) * 2003-08-08 2008-11-18 Metapass, Inc. System, method, and apparatus for automatic login
US8554610B1 (en) 2003-08-29 2013-10-08 Visa U.S.A. Inc. Method and system for providing reward status
US7559018B2 (en) * 2003-09-10 2009-07-07 Sas Institute Inc. Computer-implemented system and method for data collection
US7500178B1 (en) * 2003-09-11 2009-03-03 Agis Network, Inc. Techniques for processing electronic forms
US7051923B2 (en) 2003-09-12 2006-05-30 Visa U.S.A., Inc. Method and system for providing interactive cardholder rewards image replacement
US8005763B2 (en) 2003-09-30 2011-08-23 Visa U.S.A. Inc. Method and system for providing a distributed adaptive rules based dynamic pricing system
US8407083B2 (en) 2003-09-30 2013-03-26 Visa U.S.A., Inc. Method and system for managing reward reversal after posting
US7653602B2 (en) 2003-11-06 2010-01-26 Visa U.S.A. Inc. Centralized electronic commerce card transactions
US8819072B1 (en) 2004-02-02 2014-08-26 Microsoft Corporation Promoting data from structured data files
US7698159B2 (en) * 2004-02-13 2010-04-13 Genworth Financial Inc. Systems and methods for performing data collection
US20120041941A1 (en) 2004-02-15 2012-02-16 Google Inc. Search Engines and Systems with Handheld Document Data Capture Devices
US8489624B2 (en) 2004-05-17 2013-07-16 Google, Inc. Processing techniques for text capture from a rendered document
US7894670B2 (en) 2004-04-01 2011-02-22 Exbiblio B.V. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US8346620B2 (en) 2004-07-19 2013-01-01 Google Inc. Automatic modification of web pages
US9143638B2 (en) 2004-04-01 2015-09-22 Google Inc. Data capture from rendered documents using handheld device
US8442331B2 (en) 2004-02-15 2013-05-14 Google Inc. Capturing text from rendered documents using supplemental information
US20060081714A1 (en) 2004-08-23 2006-04-20 King Martin T Portable scanning device
US7707039B2 (en) 2004-02-15 2010-04-27 Exbiblio B.V. Automatic modification of web pages
US8146156B2 (en) 2004-04-01 2012-03-27 Google Inc. Archive of text captures from rendered documents
US20060098900A1 (en) 2004-09-27 2006-05-11 King Martin T Secure data gathering from rendered documents
US7812860B2 (en) 2004-04-01 2010-10-12 Exbiblio B.V. Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US9116890B2 (en) 2004-04-01 2015-08-25 Google Inc. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US8620083B2 (en) 2004-12-03 2013-12-31 Google Inc. Method and system for character recognition
US8081849B2 (en) 2004-12-03 2011-12-20 Google Inc. Portable scanning and memory device
US8713418B2 (en) 2004-04-12 2014-04-29 Google Inc. Adding value to a rendered document
US7990556B2 (en) 2004-12-03 2011-08-02 Google Inc. Association of a portable scanner with input/output and storage devices
US8447066B2 (en) 2009-03-12 2013-05-21 Google Inc. Performing actions based on capturing information from rendered documents, such as documents under copyright
US20060104515A1 (en) * 2004-07-19 2006-05-18 King Martin T Automatic modification of WEB pages
US8874504B2 (en) 2004-12-03 2014-10-28 Google Inc. Processing techniques for visual capture data from a rendered document
WO2010105244A2 (en) 2009-03-12 2010-09-16 Exbiblio B.V. Performing actions based on capturing information from rendered documents, such as documents under copyright
US7552630B2 (en) * 2004-02-27 2009-06-30 Akron Special Machinery, Inc. Load wheel drive
US8620286B2 (en) 2004-02-27 2013-12-31 Synchronoss Technologies, Inc. Method and system for promoting and transferring licensed content and applications
US8103651B2 (en) * 2004-04-13 2012-01-24 Hewlett-Packard Development Company, L.P. Auto-updating reader program for document files
US20050234838A1 (en) * 2004-04-14 2005-10-20 Manousos Nicholas H Method and apparatus for providing in place editing within static documents
US8250034B2 (en) * 2004-04-14 2012-08-21 Verisign, Inc. Method and apparatus to provide visual editing
US7496837B1 (en) 2004-04-29 2009-02-24 Microsoft Corporation Structural editing with schema awareness
US20050268213A1 (en) * 2004-05-06 2005-12-01 Peiya Liu System and method for automating job management in mobile data collection
US9542076B1 (en) 2004-05-12 2017-01-10 Synchronoss Technologies, Inc. System for and method of updating a personal profile
US8611873B2 (en) 2004-05-12 2013-12-17 Synchronoss Technologies, Inc. Advanced contact identification system
US7281018B1 (en) 2004-05-26 2007-10-09 Microsoft Corporation Form template data source change
US7774620B1 (en) 2004-05-27 2010-08-10 Microsoft Corporation Executing applications at appropriate trust levels
US7430343B2 (en) * 2004-05-28 2008-09-30 Dee Sign Company System and method for displaying images
US7596545B1 (en) 2004-08-27 2009-09-29 University Of Kansas Automated data entry system
US7996759B2 (en) * 2004-09-14 2011-08-09 Oracle Internatonal Corporation Data insertion from a database into a fixed electronic template form that supports overflow data
US8839090B2 (en) * 2004-09-16 2014-09-16 International Business Machines Corporation System and method to capture and manage input values for automatic form fill
US8566125B1 (en) 2004-09-20 2013-10-22 Genworth Holdings, Inc. Systems and methods for performing workflow
US7617233B2 (en) * 2004-09-28 2009-11-10 International Business Machines Corporation Method, system, and computer program product for sharing information between hypertext markup language (HTML) forms using a cookie
EP1643374A3 (en) * 2004-09-29 2007-03-21 Sap Ag A data processing system and method for automatic entry of user data
US7692636B2 (en) 2004-09-30 2010-04-06 Microsoft Corporation Systems and methods for handwriting to a screen
US7584417B2 (en) * 2004-11-15 2009-09-01 Microsoft Corporation Role-dependent action for an electronic form
US7712022B2 (en) 2004-11-15 2010-05-04 Microsoft Corporation Mutually exclusive options in electronic forms
US7721190B2 (en) 2004-11-16 2010-05-18 Microsoft Corporation Methods and systems for server side form processing
EP1669899A1 (en) * 2004-12-08 2006-06-14 France Telecom Method for processing HTTP and HTML page requests sent or received by a browser towards or from at least one Web server and associated server
US7904801B2 (en) 2004-12-15 2011-03-08 Microsoft Corporation Recursive sections in electronic forms
US8606665B1 (en) 2004-12-30 2013-12-10 Hrb Tax Group, Inc. System and method for acquiring tax data for use in tax preparation software
US7937651B2 (en) 2005-01-14 2011-05-03 Microsoft Corporation Structural editing operations for network forms
US20060168509A1 (en) * 2005-01-27 2006-07-27 International Business Machines Corporation System and method to map favorite values for specific values during electronic form filling
US7712078B1 (en) 2005-02-02 2010-05-04 Teradata Us, Inc. Techniques for data store population
US8402047B1 (en) 2005-02-25 2013-03-19 Adobe Systems Incorporated Method and apparatus for generating a query to search for matching forms
US7523100B1 (en) 2005-02-28 2009-04-21 Adobe Systems Incorporated Method and apparatus for using a rendered form as a search template
US7725834B2 (en) 2005-03-04 2010-05-25 Microsoft Corporation Designer-created aspect for an electronic form template
US8055689B1 (en) 2005-03-14 2011-11-08 Oracle America, Inc. Methods and systems for distributing information model nodes in memory
US8005791B1 (en) 2005-03-14 2011-08-23 Oracle America, Inc. Methods and systems for publishing aggregated data to a business logic tier
US8090873B1 (en) 2005-03-14 2012-01-03 Oracle America, Inc. Methods and systems for high throughput information refinement
US20060224397A1 (en) * 2005-03-29 2006-10-05 Ipac, Llc Methods, systems, and computer program products for saving form submissions
US7673228B2 (en) 2005-03-30 2010-03-02 Microsoft Corporation Data-driven actions for network forms
US8010515B2 (en) 2005-04-15 2011-08-30 Microsoft Corporation Query to an electronic form
US8200975B2 (en) 2005-06-29 2012-06-12 Microsoft Corporation Digital signatures for network forms
US20070130505A1 (en) * 2005-08-21 2007-06-07 Woods Michael E Template filler, method, and computer program product
US9158749B2 (en) * 2005-09-23 2015-10-13 International Business Machines Corporation Smart form completion of form values
US8001459B2 (en) 2005-12-05 2011-08-16 Microsoft Corporation Enabling electronic documents for limited-capability computing devices
US20070156977A1 (en) * 2005-12-29 2007-07-05 Ritter Gerd M Automatic location data determination in an electronic document
US7882072B1 (en) * 2005-12-30 2011-02-01 Google Inc. Autosave functionality for web browser
US7720688B1 (en) * 2006-03-24 2010-05-18 Titlevest Agency, Inc. Method for generating real-estate transfer documents on an unassociated second website using single set of user provided information
US8667382B2 (en) * 2006-06-28 2014-03-04 International Business Machines Corporation Configurable field definition document
US7716156B1 (en) * 2006-07-13 2010-05-11 United Services Automobile Association Systems and methods for sharing data from web accessed calculators
US7971135B2 (en) * 2006-07-28 2011-06-28 Adobe Systems Incorporated Method and system for automatic data aggregation
US7870477B2 (en) * 2006-07-28 2011-01-11 Adobe Systems Incorporated Method and system for portable data aggregation
US8589869B2 (en) 2006-09-07 2013-11-19 Wolfram Alpha Llc Methods and systems for determining a formula
WO2008028674A2 (en) 2006-09-08 2008-03-13 Exbiblio B.V. Optical scanners, such as hand-held optical scanners
US8335745B2 (en) 2006-10-11 2012-12-18 Visa International Service Association Method and system for processing micropayment transactions
US10068220B2 (en) 2006-10-11 2018-09-04 Visa International Service Association Systems and methods for brokered authentication express seller links
US20080158160A1 (en) * 2006-12-29 2008-07-03 Christof Engel Central storage for data entry processing
US20080158161A1 (en) * 2006-12-29 2008-07-03 Sap Ag Data entry processing
US20080195929A1 (en) * 2007-02-13 2008-08-14 Oracle International Corporation Simplifying Understanding of Procedure Dependencies in a Form Definition
US7866551B2 (en) 2007-02-15 2011-01-11 Visa U.S.A. Inc. Dynamic payment device characteristics
US7965961B2 (en) * 2007-07-13 2011-06-21 Eastman Kodak Company Printing of raised multidmensional toner by electography
US8214362B1 (en) * 2007-09-07 2012-07-03 Google Inc. Intelligent identification of form field elements
US8635127B1 (en) 2007-09-14 2014-01-21 Hrb Innovations, Inc. System and method for identifying tax documents to customize preparation of a tax return
US20090089653A1 (en) * 2007-09-28 2009-04-02 Microsoft Corporation Auto-generation and syndication of tables as forms
US9747598B2 (en) * 2007-10-02 2017-08-29 Iii Holdings 1, Llc Dynamic security code push
JP4900194B2 (en) * 2007-10-24 2012-03-21 富士通株式会社 How to form input support, form input support apparatus and a form input support program
US8713029B2 (en) * 2007-11-05 2014-04-29 Verizon Patent And Licensing Inc. Method and apparatus for providing auto-completion of information
US20090182671A1 (en) * 2007-12-10 2009-07-16 Computer Patent Annuities Limited Interface system for annuity database for management of assets
US8181111B1 (en) 2007-12-31 2012-05-15 Synchronoss Technologies, Inc. System and method for providing social context to digital activity
US9846689B2 (en) * 2008-01-29 2017-12-19 Adobe Systems Incorporated Method and system to provide portable database functionality in an electronic form
US20090192848A1 (en) * 2008-01-30 2009-07-30 Gerald Rea Method and apparatus for workforce assessment
US9495386B2 (en) * 2008-03-05 2016-11-15 Ebay Inc. Identification of items depicted in images
JP2009271831A (en) * 2008-05-09 2009-11-19 Sharp Corp Image data processing apparatus
US8800043B2 (en) * 2008-05-19 2014-08-05 Microsoft Corporation Pre-emptive pre-indexing of sensitive and vulnerable assets
JP5366178B2 (en) * 2008-05-22 2013-12-11 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation How to support the input to the input fields of a web page, a computer program and terminal
US8719838B1 (en) 2008-05-28 2014-05-06 United Services Automobile Association (Usaa) Systems and methods for generating scripts to interact with web sites
WO2010005681A1 (en) * 2008-06-16 2010-01-14 Visa U.S.A. Inc. System and method for authorizing financial transactions with online merchants
US8265606B2 (en) * 2008-10-09 2012-09-11 Microsoft Corporation Targeted advertisements to social contacts
US7827108B2 (en) * 2008-11-21 2010-11-02 Visa U.S.A. Inc. System and method of validating a relationship between a user and a user account at a financial institution
US8527897B2 (en) * 2009-01-26 2013-09-03 International Business Machines Corporation System, method, and computer program product for toggling back and forth between unformatted and formatted editable views of data
US8638363B2 (en) 2009-02-18 2014-01-28 Google Inc. Automatically capturing information, such as capturing information using a document-aware device
US8825660B2 (en) 2009-03-17 2014-09-02 Ebay Inc. Image-based indexing in a network-based marketplace
US9639626B2 (en) * 2009-04-09 2017-05-02 International Business Machines Corporation Web-browser based state repository
US9715681B2 (en) * 2009-04-28 2017-07-25 Visa International Service Association Verification of portable consumer devices
US8602293B2 (en) 2009-05-15 2013-12-10 Visa International Service Association Integration of verification tokens with portable computing devices
US8534564B2 (en) 2009-05-15 2013-09-17 Ayman Hammad Integration of verification tokens with mobile communication devices
US9105027B2 (en) 2009-05-15 2015-08-11 Visa International Service Association Verification of portable consumer device for secure services
US9038886B2 (en) 2009-05-15 2015-05-26 Visa International Service Association Verification of portable consumer devices
US8601015B1 (en) 2009-05-15 2013-12-03 Wolfram Alpha Llc Dynamic example generation for queries
US8788524B1 (en) 2009-05-15 2014-07-22 Wolfram Alpha Llc Method and system for responding to queries in an imprecise syntax
US8893967B2 (en) 2009-05-15 2014-11-25 Visa International Service Association Secure Communication of payment information to merchants using a verification token
US7891560B2 (en) 2009-05-15 2011-02-22 Visa International Service Assocation Verification of portable consumer devices
US8570281B2 (en) * 2009-06-25 2013-10-29 Ncr Corporation Method and apparatus for multi-touch surface interaction for a financial application within a bank branch
ITMI20091560A1 (en) * 2009-09-11 2011-03-12 Prb Srl Improved method for automatically filling in document templates.
US8589433B2 (en) * 2009-10-21 2013-11-19 International Business Machines Corporation Dynamic tagging
US8676639B2 (en) * 2009-10-29 2014-03-18 Visa International Service Association System and method for promotion processing and authorization
US8280788B2 (en) 2009-10-29 2012-10-02 Visa International Service Association Peer-to-peer and group financial management systems and methods
US8332325B2 (en) * 2009-11-02 2012-12-11 Visa International Service Association Encryption switch processing
US8255006B1 (en) 2009-11-10 2012-08-28 Fusionone, Inc. Event dependent notification system and method
US9081799B2 (en) 2009-12-04 2015-07-14 Google Inc. Using gestalt information to identify locations in printed information
US9323784B2 (en) 2009-12-09 2016-04-26 Google Inc. Image search using text-based elements within the contents of images
US10255591B2 (en) 2009-12-18 2019-04-09 Visa International Service Association Payment channel returning limited use proxy dynamic value
US9164577B2 (en) 2009-12-22 2015-10-20 Ebay Inc. Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
US8429048B2 (en) 2009-12-28 2013-04-23 Visa International Service Association System and method for processing payment transaction receipts
US8484015B1 (en) 2010-05-14 2013-07-09 Wolfram Alpha Llc Entity pages
US10242118B2 (en) 2010-06-21 2019-03-26 International Business Machines Corporation Multi-source electronic forms with concealed fields
US8812298B1 (en) 2010-07-28 2014-08-19 Wolfram Alpha Llc Macro replacement of natural language input
US10127606B2 (en) 2010-10-13 2018-11-13 Ebay Inc. Augmented reality system and method for visualizing an item
US8943428B2 (en) 2010-11-01 2015-01-27 Synchronoss Technologies, Inc. System for and method of field mapping
US9959263B2 (en) * 2010-12-07 2018-05-01 Microsoft Technology Licensing, Llc. User interface form field expansion
CN103503010B (en) 2011-03-04 2017-12-29 维萨国际服务协会 Ability to pay combined elements of a computer security
US9069814B2 (en) 2011-07-27 2015-06-30 Wolfram Alpha Llc Method and system for using natural language to generate widgets
US20130097479A1 (en) * 2011-08-24 2013-04-18 Graphium, LLC Electronic forms system
US8996981B2 (en) * 2011-09-06 2015-03-31 Onevizion, Inc. Managing forms in electronic documents
US9734252B2 (en) 2011-09-08 2017-08-15 Wolfram Alpha Llc Method and system for analyzing data using a query answering system
US9449342B2 (en) 2011-10-27 2016-09-20 Ebay Inc. System and method for visualization of items in an environment using augmented reality
US9851950B2 (en) 2011-11-15 2017-12-26 Wolfram Alpha Llc Programming in a precise syntax using natural language
US10282724B2 (en) 2012-03-06 2019-05-07 Visa International Service Association Security system incorporating mobile device
US20140047319A1 (en) * 2012-08-13 2014-02-13 Sap Ag Context injection and extraction in xml documents based on common sparse templates
US9405424B2 (en) 2012-08-29 2016-08-02 Wolfram Alpha, Llc Method and system for distributing and displaying graphical items
US20140215378A1 (en) * 2013-01-31 2014-07-31 Comverse, Inc. One-Line Login
US20140258828A1 (en) * 2013-03-11 2014-09-11 Brent Lymer Pick-and-place webform autofill
US20150039989A1 (en) * 2013-08-01 2015-02-05 Oracle International Corporation Entry of values into multiple fields of a form using touch screens
KR20160101117A (en) 2013-12-19 2016-08-24 비자 인터네셔널 서비스 어소시에이션 Cloud-based transactions methods and systems
US9928221B1 (en) * 2014-01-07 2018-03-27 Google Llc Sharing links which include user input
CN104869128B (en) 2014-02-20 2018-08-31 阿里巴巴集团控股有限公司 Methods kinds upload form attachments, and web server system
US10176159B2 (en) * 2014-05-05 2019-01-08 Adobe Systems Incorporated Identify data types and locations of form fields entered by different previous users on different copies of a scanned document to generate an interactive form field
US9775029B2 (en) 2014-08-22 2017-09-26 Visa International Service Association Embedding cloud-based functionalities in a communication device
US9917802B2 (en) 2014-09-22 2018-03-13 Roy S. Melzer Interactive user interface based on analysis of chat messages content
US10187363B2 (en) 2014-12-31 2019-01-22 Visa International Service Association Hybrid integration of software development kit with secure execution environment
US20160314109A1 (en) * 2015-04-27 2016-10-27 Adobe Systems Incorporated Recommending form fragments
US20180174136A1 (en) * 2016-12-15 2018-06-21 Parveen Bansal Alarm access override
US5394487A (en) * 1993-10-27 1995-02-28 International Business Machines Corporation Forms recognition management system and method
US5602997A (en) 1992-08-27 1997-02-11 Starfish Software, Inc. Customizable program control interface for a computer system
US5640577A (en) 1991-12-30 1997-06-17 Davox Corporation Data processing system with automated at least partial forms completion
US5794259A (en) 1996-07-25 1998-08-11 Lextron Systems, Inc Apparatus and methods to enhance web browsing on the internet
US5799115A (en) 1995-03-16 1998-08-25 Kabushiki Kaisha Toshiba Image filing apparatus and method
EP0918424A2 (en) 1997-11-24 1999-05-26 International Business Machines Corporation Automatic association of predefined user data with query entry fields
US5909678A (en) * 1996-09-13 1999-06-01 International Business Machines Corporation Computer systems, method and program for constructing statements by dragging and dropping iconic representations of subcomponent statements onto a phrase template
WO1999046701A1 (en) 1998-03-09 1999-09-16 Amazon.Com, Inc. Method and system for automatically filling forms in an integrated network based transaction environment
US5974430A (en) 1997-09-30 1999-10-26 Unisys Corp. Method for dynamically embedding objects stored in a web server within HTML for display by a web browser
US6088700A (en) 1999-08-06 2000-07-11 Larsen; Kenneth N. Automated forms completion for global information network applications
US6192380B1 (en) 1998-03-31 2001-02-20 Intel Corporation Automatic web based form fill-in
US6199079B1 (en) 1998-03-09 2001-03-06 Junglee Corporation Method and system for automatically filling forms in an integrated network based transaction environment
US6247029B1 (en) 1998-05-01 2001-06-12 International Business Machines Corporation Web browser form enhancements
US6272467B1 (en) 1996-09-09 2001-08-07 Spark Network Services, Inc. System for data collection and matching compatible profiles
US20020023108A1 (en) * 1999-09-09 2002-02-21 Neil Daswani Automatic web form interaction proxy
US6363479B1 (en) 1998-07-22 2002-03-26 Entrust Technologies Limited System and method for signing markup language data
US6421693B1 (en) 1998-04-20 2002-07-16 Fujitsu Limited Method to automatically fill entry items of documents, recording medium and system thereof
US6499042B1 (en) 1998-10-07 2002-12-24 Infospace, Inc. Selective proxy approach to filling-in forms embedded in distributed electronic documents
US6589290B1 (en) 1999-10-29 2003-07-08 America Online, Inc. Method and apparatus for populating a form with data
US20030188262A1 (en) 1999-10-29 2003-10-02 Duane Maxwell Method and apparatus for populating a form with data
US20060206801A1 (en) 1999-10-29 2006-09-14 America Online, Inc. Method and apparatus for populating a form with data
US7962845B2 (en) 1999-10-29 2011-06-14 Aol Inc. Method and apparatus for populating a form with data
"Final Office Action", U.S. Appl. No. 10/426,182, (Aug. 23, 2005), 5 pages.
"Final Office Action", U.S. Appl. No. 11/413,680, (May 14, 2010), 11 pages.
"How to use the AutoComplete feature in Internet Explorer 5 and 6", Retrieved from: <http://support.microsoft.com/?kbid=217148 > on Jan. 25, 2011, Jan. 24, 2007, 4 pages.
"How to use the AutoComplete feature in Internet Explorer 5 and 6", Retrieved from: on Jan. 25, 2011, Jan. 24, 2007, 4 pages.
"International Search Report", Application No. PCT/US2000/027364, (Apr. 14, 2003), 3 pages.
"Non-Final Office Action", U.S. Appl. No. 10/426,182, (Feb. 13, 2004), 4 pages.
"Non-Final Office Action", U.S. Appl. No. 10/426,182, (Mar. 11, 2005), 4 pages.
"Non-Final Office Action", U.S. Appl. No. 11/413,680, (Oct. 30, 2009), 10 pages.
"Non-Final Office Action", U.S. Appl. No. 11/413,680, (Sep. 22, 2010), 12 pages.
"Notice of Allowance", U.S. Appl. No. 10/426,182, (Jan. 17, 2006), 4 pages.
"Notice of Allowance", U.S. Appl. No. 11/413,680, (Feb. 3, 2011), 7 pages.
Friedman, Will et al., "Collect Demographic Data More Easily with Internet Explorer 5", (Mar. 18, 1999), 4 pages.
US6714933B2 (en) 2004-03-30 Content aggregation method and apparatus for on-line purchasing system
US7490135B2 (en) 2009-02-10 Method for providing node targeted content in an addressable network
US7472089B2 (en) 2008-12-30 Loan origination system interface for online loan application processing
US6507867B1 (en) 2003-01-14 Constructing, downloading, and accessing page bundles on a portable client having intermittent network connectivity
US6278993B1 (en) 2001-08-21 Method and apparatus for extending an on-line internet search beyond pre-referenced sources and returning data over a data-packet-network (DPN) using private search engines as proxy-engines
KR100264535B1 (en) 2000-09-01 Computer apparatus and method for communicating between software applications and computers on the world-wide web
US10204363B2 (en) 2019-02-12 System and method for modifying electronic documents transmitted through an intermediary
US6085229A (en) 2000-07-04 System and method for providing client side personalization of content of web pages and the like
US5905908A (en) 1999-05-18 Open network system for I/O operations with non-standard I/O devices utilizing extended protocol including device identifier and identifier for operation to be performed with device
US6725222B1 (en) 2004-04-20 Automated on-line commerce method and apparatus utilizing shopping servers which update product information on product selection
US9524280B2 (en) 2016-12-20 Method and system to automatically insert a relevant hyperlink into a webpage
EP0958546B1 (en) 2006-03-15 System and method for accessing internet-based information resources by scanning java-applet encoded bar code symbols
EP1166216B1 (en) 2004-09-29 Server for enabling the automatic insertion of data into electronic forms on a user computer
US6199104B1 (en) 2001-03-06 Server-based host monitor
US7016877B1 (en) 2006-03-21 Consumer-controlled limited and constrained access to a centrally stored information account
KR101367928B1 (en) 2014-03-14 Remote module incorporation into a container document
JP4959817B2 (en) 2012-06-27 Method in a server system that accepts the order of the methods and items in the client system for ordering an item
CN1234088C (en) 2005-12-28 Method and system for tracking WEB user conversation
EP1330739B1 (en) 2006-08-02 Accessing data stored at an intermediary from a service
US7437312B2 (en) 2008-10-14 Method for context personalized web browsing
US9069745B2 (en) 2015-06-30 Electronic form automation
CN1313951C (en) 2007-05-02 Method and apparatus for controlling softward interview of system resonrce
KR100368353B1 (en) 2003-01-24 Kiosk and server connected to computer network
US6505230B1 (en) 2003-01-07 Client-server independent intermediary mechanism
Owner name: ENTRYPOINT, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MAXWELL, DUANE;VON REIS, WILLIAM;SCOTT, GEOFFREY D.;SIGNING DATES FROM 19991208 TO 19991209;REEL/FRAME:026322/0561
Owner name: AMERICA ONLINE, INCORPORATED, VIRGINIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ENTRYPOINT, INC.;REEL/FRAME:026322/0679
Owner name: AOL LLC, VIRGINIA
Free format text: CHANGE OF NAME;ASSIGNOR:AMERICA ONLINE, INC.;REEL/FRAME:026323/0323
Owner name: AOL INC., VIRGINIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AOL LLC;REEL/FRAME:026322/0870
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:AOL INC.;AOL ADVERTISING INC;MAPQUEST, INC;REEL/FRAME:034113/0557