text:
Portable electronic device performing similar operations for different gestures
US 10,838,617 B2
Issued: 11/17/2020
Est. Priority Date: 09/06/2006
Status: Active Grant
Create Patent Alert
District Court Events
PTAB Events
ITC Events
Federal Circuit Events
RPX Reports
Daily (M-F)
*Certain alert events are not available for your current subscription level. Upgrade
Associated Defendants
Patent Images
1. A portable electronic device, comprising:
a touch screen display;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;
displaying, on the touch screen display, a plurality of application windows, wherein the plurality of application windows are displayed in an ordered set, and wherein at least one of the plurality of application windows is partially hidden;
while displaying the plurality of application windows, detecting a gesture on the touch screen display;
in response to detecting the gesture;
in accordance with a determination that the gesture corresponds to a tap gesture at a first predefined location on the touch screen display associated with a first application window of the plurality of application windows, enlarging the first application window of the plurality of application windows;
in accordance with a determination that the gesture corresponds to a tap gesture at a second predefined location on the touch screen display that corresponds to a position of a second application window of the plurality of application windows on the touch screen display, moving the second application window of the plurality of application windows toward a center of the display;
in accordance with a determination that the gesture corresponds to a swipe gesture in a first direction, translating the ordered set in the first direction; and
in accordance with a determination that the gesture corresponds to a swipe gesture in a second direction, translating the ordered set in the second direction.
View all claims
0 Assignments
Assignment View
{{noDetailsMessage}}
0 Petitions
Accused Products
A portable electronic device with a touch-sensitive display is disclosed. One aspect of the invention involves a computer-implemented method in which the portable electronic device: displays an application on the touch-sensitive display; and when the application is in a predefined mode, performs a predefined operation in response to each gesture of a set of multiple distinct gestures on the touch-sensitive display. Another aspect of the invention involves a computer-implemented method in which the portable electronic device: displays a first application; when the first application is in a first mode, performs a first operation upon detecting a first gesture on the touch-sensitive display; and performs the first operation upon detecting a second gesture on the touch-sensitive display, wherein the second gesture is different from the first gesture.
0 Forward Citations
170 References Cited
No References
Portable electronic device, method, and graphical user interface for displaying structured electronic documents
Patent #
US 7,864,163 B2
Current Assignee
Video manager for portable multifunction device
In-page full screen internet video method
Peel back user interface to show hidden functions
Microsoft Technology Licensing LLC
Resolution independent display of internet content
SoftView LLC
Touch screen with user interface enhancement
Wacom Co Limited
Synaptics Incorporated
System and method for providing media samples on-line in response to media related searches on the internet
Nokia US Holdings. Inc.
Nokia Corporation
Scalable display of internet content on mobile devices
Touch screen device, method, and graphical user interface for determining commands by applying heuristics
Indication of progress towards satisfaction of a user input condition
Portable electronic device with interface reconfiguration mode
Application user interface with navigation bar showing current and prior application contexts
Image repositioning, storage and retrieval
Palm Inc.
DEVICE AND METHOD FOR SCROLLING THROUGH LIST IN PORTABLE TERMINAL WITH TOUCH PAD
US 20080042984A1
Samsung Electronics Co. Ltd.
Composition of local media playback with remotely generated user interface
Touch actuation controller for multi-state media presentation
Apple Computer Incorporated
Method and system for switching between multiple computer applications
Portable Electronic Device, Method, and Graphical User Interface for Displaying Inline Multimedia Content
Portable Multifunction Device, Method, and Graphical User Interface Supporting User Navigations of Graphical Objects on a Touch Screen Display
Modal Change Based on Orientation of a Portable Multifunction Device
GESTURES FOR TOUCH SENSITIVE INPUT DEVICES
Gary B. Rohrabaugh
Graphical user interface and methods of use thereof in a multimedia player
Controlling functions of a handheld multifunction device
Scenera Mobile Technologies LLC
Double-clicking a point-and-click user interface apparatus to enable a new interaction with content represented by an active visual display element
Actify Incorporated
System and method for indexing, searching, identifying, and editing multimedia files
VMark Inc.
Portable electronic apparatus and associated method
EXTENSIBLE, FILTERED LISTS FOR MOBILE DEVICE USER INTERFACE
PRESENTING AND MANAGING CLIPPED CONTENT
Telephone Interface for a Portable Communication Device
Portable electronic device with multi-touch input
Advertising with video ad creatives
Method, Terminal Device and Program for Dynamic Image Scaling Display in Browsing
Access Company Limited
Raiko Funakami
Display system for displaying lists of linked documents
Xerox Corporation
Zoom-enabled handheld device
Compal Electronics Incorporated
Browser hierarchical contextual information for web pages
View navigation and magnification of a hand-held device with a display
Innoventions Incorporated
Control of a computer through a position-sensed stylus
US 5,347,295 A
Go PLC
Touch screen drag and drop input technique
Nokia Technologies Oy
Providing multiple perspectives for a venue activity through an electronic hand held device
Front Row Technologies LLC
Luis M. Ortiz, Kermit D. Lopez
System and method for packing multi-touch gestures onto a hand
FingerWorks Limited
Methods and apparatuses for operating a portable device based on an accelerometer
Unique method for performing zoom-in and zoom-out operations with horizontal and vertical video decimation within a wireless device having a video display
Avago Technologies General IP PTE Limited
Surface UI for gesture-based interaction
Mode-based graphical user interfaces for touch sensitive input devices
User Interface having a carousel view
Operation of a computer with touch screen interface
Web browser graphical user interface and method for implementing same
Blackberry Limited
Semantic thumbnails
Component for use as a portable computing device and pointing device
OQO Incorporated
Multipoint touchscreen
Gesture inputs for a portable display device
Nintendo Company Limited
User interfaces for data processing devices and systems
Picsel International Limited
PICSEL RESEARCH LIMITED
Display method, portable terminal device, and display program
Snaptrack Incorporated
Sony Ericsson Mobile Communications Japan Incorporated, Sony Corporation
Touch driven method and apparatus to integrate and display multiple image layers forming alternate depictions of same subject matter
TOUCHTABLE INC.
Method and system for navigating a display screen for locating a desired item of information
Palmsource Incorporated
Method of zooming in a display image for a portable electrical device
Tatung Company
Touch position detecting device, method of detecting touch position and touch screen display device having the same
Samsung Display Company Limited
Image manipulation in response to a movement of a display
Technology Licensing Company Incorporated
Mobile terminal with ergonomic imaging functions
Sony Ericsson Mobile Communications USA Incorporated
Multi-functional hand-held device
Optimal viewing of digital images and voice annotation transitions in slideshows
Playlists and bookmarks in an interactive media guidance application system
Rovi Guides Inc.
Device and method of browsing an image collection
Koninklijke Philips N.V.
Method for making a Web-DVD
MADISON SOFTWARE INC.
System and method for a portable multimedia client
Move Mobile Systems Inc.
Navigation methods, systems, and computer program products for virtual three-dimensional books
Multimedia visual progress indication system
TiVo Solutions Inc.
Canon Kabushiki Kaisha
Item selection using helical menus
IDHL Holdings Inc.
Document representation for scalable structure
Gesture recognition method and touch system incorporating the same
PixArt Imaging Incorporated
Smart Technologies ULC
Portrayal of navigation objects
III Holdings 3 LLC
Method for dynamic key size prediction with touch displays and an electronic device using the method
Comprehensive and intuitive media collection and management tool
Fuji Xerox Company Limited
Method and apparatus for locking a mobile telephone touch screen
Presenting HTML content on a screen terminal display
Opera Software ASA
Apparatus and method for inputting character using touch screen in portable terminal
Changing an orientation of a user interface via a course of motion
Gula Consulting Limited Liability Company
Presentation of media content from multiple media sources
Sonic Solutions
Portable high speed internet access device with encryption
Raja Singh Tuli
Seekbar in taskbar player visualization mode
Systems and methods that utilize a dynamic digital zooming interface in connection with digital inking
Processing and presentation of infomercials for audio-visual programs
Vivcom Inc.
Rapid visual sorting of digital files and data
Systems and methods for browsing multimedia content on small mobile devices
British Telecommunications PLC
Linked portable and video game systems
Robert M. Best
Method and system to improve usability of a web application by providing a zoom function
Method of magnifying a portion of display
Inventec Appliances Corporation
Human interactive type display system
Tokyo University of Agriculture and Technology
Information retrieval and display system
Empire IP LLC
Robert Osann
System and method for simultaneous display of multiple information sources
Surfcast Incorporated
Small form factor web browsing
Method of deactivating device lock state, and electronic device
Portable information terminal, display control device, display control method, and computer readable program therefor
Kyocera Corporation
System and method for annotating web-based document
Page information display method and device and storage medium storing program for displaying page information
Portable computer system having application program launcher for low power consumption and method of operating the same
Information processing device and information processing program
Olympus Corporation
Method for providing an interaction in an electronic device and an electronic device
Method and system for designing, editing and publishing web page content in a live internet session
Dennis Wayne Altshuler
Self-orienting display
Displaying subheadings and hyperlinks in a scrollable long document
Control framework with a zoomable graphical user interface for organizing, selecting and launching media items
Quick starting video content
User interface for handheld communication device
Bodycom Inc.
System, method and apparatus for converting and integrating media files
Sensor-based menu for a touch screen panel
Information processing apparatus, screen display method, screen display program, and recording medium having screen display program recorded therein
Sony Corporation
Method and apparatus for accelerated scrolling
Mouse having a rotary dial
Methods, systems, and programming for computer display of images, text, and/or digital content
Bitstream Incorporated
John S. Collins, Robert J. Eggers, Michael R. Dewsnap, Sampo J. Kaasila
Method and apparatus for use of rotational user inputs
Method and apparatus for displaying images on a display
System and method for a simplified digital camera interface
Hewlett-Packard Development Company L.P.
System and method for interacting with a program guide displayed on a portable electronic device
Universal Electronics Inc.
Method for document viewing
Majandro LLC
Legibility of selected content
Method and apparatus for displaying miniaturized graphical representations of documents for alternative viewing selection
Methods and apparatus for controlling a portable electronic device using a touchpad
Tsera LLC
Chuang Li
Window scroll bar
Gesture-based user interface to multi-level and multi-modal sets of bit-maps
DigiMedia Tech LLC
Integrating broadcast television pause and web browsing
System for managing data objects
Tessera Advanced Technologies Inc.
Movable magnification icons for electronic device display screens
Telefonaktiebolaget LM Ericsson
Computer touch screen adapted to facilitate selection of features at edge of screen
Round Rock Research LLC
Adaptive display for video conferences
Hand-held with auto-zoom for graphical display of Web page
Active ALT tag in HTML documents to increase the accessibility to users with visual, audio impairment
Method of previewing web page content while interacting with multiple web page controls
ATT Inc.
Method and system for providing touch-sensitive screens for the visually impaired
System and method for improved navigation between open windows in an application program using window tabs
Method for delivering separate design and content in a multimedia publishing system
Touch-sensitive panel with selector
Unwired Planet LLC
Method and apparatus for managing and navigating within stacks of document pages
ScanSoft Inc. nka Nuance Communications Inc.
Small information processing apparatus
Lenovo PC International Limited
System and method for web browsing
Browse3D LLC
Browse3D Corporation
TV centric layout
Comcast Cable Communications Management LLC
Liberate Technologies
System and method for window queues and white space activation for toggling windows
Information display system with touch panel
Aisin AW Corporation Limited
Display of multiple images based on a temporal relationship among them with various operations available to a user as a function of the image size
Sony Electronics Inc., Sony Corporation
Mobile station with touch input having automatic symbol magnification function
Nokia Mobile Phones UK Limited
Graphical user interface providing access to files downloaded over a network
Method for pointing a window frame or an icon of a window interface
Hanger Solutions LLC
Primax Electronics Limited
Methods and apparatus for interacting with data objects using action handles
Video delivery system and method for displaying indexing slider bar on the subscriber video screen
OpenTV Inc.
Thomson Consumer Electronics Incorporated, Sun Microsystems Incorporated
Method and system for automatically tracking a zoomed video image
CustomPlay LLC
Max Abecassis
Gesture sensitive buttons for graphical user interfaces
Touchscreen interface having pop-up variable adjustment displays for controllers and audio processing systems
Method, system, and graphical user interface for viewing multiple application windows
Filtering Documents Based on Device Orientation
EL display panel, power supply line drive apparatus, and electronic device
18 Claims
View Dependent Claims (2, 3, 4, 5, 6)
2. The portable electronic device of claim 1, wherein the plurality of application windows correspond to respective web browser application windows.
3. The portable electronic device of claim 1, wherein enlarging the first application window includes filling the touch screen display with the first application window.
4. The portable electronic device of claim 1, the one or more programs further including instructions for:
in accordance with a determination that the gesture corresponds to a predefined gesture associated with a delete operation for the first application window;
ceasing to display the first application window.
in accordance with the determination that the gesture corresponds to the predefined gesture associated with a delete operation for the first application window;
moving an application window neighboring the first application window to occupy the location previously occupied by the first application window.
6. The portable electronic device of claim 4, wherein the predefined gesture is a tap gesture on a delete icon associated with the first application window.
7. A non-transitory computer-readable storage medium, storing one or more programs configured to be executed by one or more processors of a portable electronic device with a touch screen display, the one or more programs including instructions for:
View Dependent Claims (8, 9, 10, 11, 12)
8. The non-transitory computer-readable storage medium of claim 7, wherein the plurality of application windows correspond to respective web browser application windows.
9. The non-transitory computer-readable storage medium of claim 7, wherein enlarging the first application window includes filling the touch screen display with the first application window.
10. The non-transitory computer-readable storage medium of claim 7, the one or more programs further including instructions for:
ceasing to display the application window.
11. The non-transitory computer-readable storage medium of claim 10, the one or more programs further including instructions for:
12. The non-transitory computer-readable storage medium of claim 10, wherein the predefined gesture is a tap gesture on a delete icon associated with the first application window.
13. A method, comprising:
at a portable electronic device with a touch screen display;
View Dependent Claims (14, 15, 16, 17, 18)
14. The method of claim 13, wherein the plurality of application windows correspond to respective web browser application windows.
15. The method of claim 13, wherein enlarging the first application window includes filling the touch screen display with the first application window.
18. The method of claim 16, wherein the predefined gesture is a tap gesture on a delete icon associated with the first application window.
1 Specification
This application is a continuation of U.S. patent application Ser. No. 15/807,283, filed Nov. 8, 2017, which is a continuation of U.S. patent application Ser. No. 14/493,128, filed Sep. 22, 2014, which is a continuation of U.S. patent application Ser. No. 11/850,638, filed Sep. 5, 2007, which claims priority to U.S. Provisional Patent Application Nos. 60/937,993, "Portable Multifunction Device," filed Jun. 29, 2007; 60/879,469, "Portable Multifunction Device," filed Jan. 8, 2007; 60/883,817, "Portable Electronic Device Performing Similar Operations for Different Gestures," filed Jan. 7, 2007; 60/879,253, "Portable Multifunction Device," filed Jan. 7, 2007; and 60/824,769, "Portable Multifunction Device," filed Sep. 6, 2006. All of these applications are incorporated by reference herein in their entirety.
This application is related to the following applications: (1) U.S. patent application Ser. No. 10/188,182, "Touch Pad For Handheld Device," filed on Jul. 1, 2002; (2) U.S. patent application Ser. No. 10/722,948, "Touch Pad For Handheld Device," filed on Nov. 25, 2003; (3) U.S. patent application Ser. No. 10/643,256, "Movable Touch Pad With Added Functionality," filed on Aug. 18, 2003; (4) U.S. patent application Ser. No. 10/654,108, "Ambidextrous Mouse," filed on Sep. 2, 2003; (5) U.S. patent application Ser. No. 10/840,862, "Multipoint Touchscreen," filed on May 6, 2004; (6) U.S. patent application Ser. No. 10/903,964, "Gestures For Touch Sensitive Input Devices," filed on Jul. 30, 2004; (7) U.S. patent application Ser. No. 11/038,590, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices" filed on Jan. 18, 2005; (8) U.S. patent application Ser. No. 11/057,050, "Display Actuator," filed on Feb. 11, 2005; (9) U.S. Provisional Patent Application No. 60/658,777, "Multi-Functional Hand-Held Device," filed Mar. 4, 2005; and (10) U.S. patent application Ser. No. 11/367,749, "Multi-Functional Hand-Held Device," filed Mar. 3, 2006. All of these applications are incorporated by reference herein.
The disclosed embodiments relate generally to portable electronic devices, and more particularly, to portable electronic devices that perform similar operations in response to different finger gestures.
As portable electronic devices become more compact, and the number of functions performed by a given device increases, it has become a significant challenge to design a user interface that allows users to easily interact with a multifunction device. This challenge is particular significant for handheld portable electronic devices, which have much smaller screens than desktop or laptop computers.
One important aspect of measuring a user interface'"'"'s user-friendliness is whether the user interface accepts different types of user actions that correspond to the same function. Different users can choose different user actions based on their own preferences or habits. One user can choose different user actions at different times depending on which user action is more convenient than others at a specific moment.
But many conventional user interfaces, such as those that include physical pushbuttons, often have no such inflexibility. All users have to interact with the user interfaces in a specific manner to get desired results whether or not the manner is contrary to most users'"'"' preferences or habits. When coupled with the time consuming requirement to memorize these specific manners and the difficulty in activating a desired pushbutton, such inflexibility is becoming increasingly frustrating to most users.
Accordingly, there is a need for portable electronic devices with more flexible and intuitive user interfaces that perform similar operations in response to different finger gestures.
The above deficiencies and other problems associated with known portable devices are reduced or eliminated by the disclosed portable multifunction device. In some embodiments, the portable electronic device has a touch-sensitive display (also known as a "touch screen" or "touch screen display") with a graphical user interface (GUI), one or more processors, memory and one or more modules, programs or sets of instructions stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI primarily through finger contacts and gestures on the touch-sensitive display. Instructions for performing operations may be included in a computer readable storage medium or other computer program product configured for execution by one or more processors.
One aspect of the invention involves a computer-implemented method in which a portable electronic device with a touch screen: displays an application on the touch screen; and when the application is in a predefined mode, performs a predefined operation in response to each gesture of a set of multiple distinct gestures on the touch screen.
Another aspect of the invention involves a computer-implemented method in which a portable electronic device with a touch screen: displays a first application; when the first application is in a first mode, performs a first operation upon detecting a first gesture on the touch screen display; and performs the first operation upon detecting a second gesture on the touch screen display, wherein the second gesture is different from the first gesture.
Another aspect of the invention involves a portable electronic device. The device includes a touch screen display, one or more processors, memory, and one or more programs. The one or more program are stored in the memory and configured to be executed by the one or more processors. The one or more programs include: instructions for displaying an application; and instructions for performing a predefined operation in response to each gesture of a set of multiple distinct gestures on the touch screen display when the application is in a predefined mode.
Another aspect of the invention involves a computer-program product that includes a computer readable storage medium and a computer program mechanism (e.g., one or more computer programs) embedded therein. The computer program mechanism includes instructions, which when executed by a portable electronic device with a touch screen display, cause the device to: display an application; and when the application is in a predefined mode, perform a predefined operation in response to each gesture of a set of multiple distinct gestures on the touch screen display.
Another aspect of the invention involves a graphical user interface (GUI) on a portable electronic device with a touch screen display. The GUI has an application displayed in a predefined mode and the application performs a predefined operation in response to each gesture of a set of multiple distinct gestures on the touch screen display.
Another aspect of the invention involves a portable electronic device with a touch screen display, comprising: means for displaying an application; and means for performing a predefined operation in response to each gesture of a set of multiple distinct gestures on the touch screen display when the application is in a predefined mode.
Thus, the invention provides a transparent and intuitive user interface that performs similar operations in response to different finger gestures on a portable electronic device with a touch screen display.
For a better understanding of the aforementioned embodiments of the invention as well as additional embodiments thereof, reference should be made to the Description of Embodiments below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures.
FIG. 1 is a block diagram illustrating a portable electronic device with a touch-sensitive display in accordance with some embodiments.
FIG. 2 illustrates a portable electronic device having a touch screen in accordance with some embodiments.
FIG. 3 illustrates an exemplary user interface for unlocking a portable electronic device in accordance with some embodiments.
FIG. 4 illustrates an exemplary user interface for a menu of applications on a portable electronic device in accordance with some embodiments.
FIG. 5 illustrates an exemplary user interface for viewing albums in accordance with some embodiments.
FIG. 6 illustrates an exemplary user interface for viewing an album in accordance with some embodiments.
FIG. 7 illustrates an exemplary user interface for viewing enlarged images in an album in accordance with some embodiments.
FIGS. 8A through 8D illustrate exemplary user interfaces for a browser in accordance with some embodiments.
FIG. 9 is a generalized flowchart illustrating a process for performing a predefined operation upon detecting multiple types of user gestures on the portable electronic device'"'"'s touch screen in accordance with some embodiments.
DESCRIPTION OF EMBODIMENTS
Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the invention. However, it will be apparent to one of ordinary skill in the art that the invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
It will also be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first gesture could be termed a second gesture, and, similarly, a second gesture could be termed a first gesture, without departing from the scope of the present invention.
The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the description of the invention and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
As used herein, the term "if" may be construed to mean "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [a stated condition or event] is detected" may be construed to mean "upon determining" or "in response to determining" or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]," depending on the context.
Embodiments of a portable electronic device, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communications device such as a mobile telephone that also contains other functions, such as PDA and/or music player functions.
The user interface may include a physical click wheel in addition to a touch screen or a virtual click wheel displayed on the touch screen. A click wheel is a physical user-interface device that may provide navigation commands based on an angular displacement of the wheel or a point of contact with the wheel by a user of the portable electronic device. A click wheel may also be used to provide a user command corresponding to selection of one or more items, for example, when the user of the portable electronic device presses down on at least a portion of the wheel or the center of the wheel. Alternatively, breaking contact with a click wheel image on a touch screen surface may indicate a user command corresponding to selection. For simplicity, in the discussion that follows, a portable electronic device that includes a touch screen is used as an exemplary embodiment. It should be understood, however, that some of the user interfaces and associated processes may be applied to other devices, such as personal computers and laptop computers, which may include one or more other physical user-interface devices, such as a physical click wheel, a physical keyboard, a mouse and/or a joystick.
The device supports a variety of applications, such as one or more of the following: a telephone application, a video conferencing application, an email application, an instant messaging application, a blogging application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and/or a digital video player application.
The various applications that may be executed on the device may use at least one common physical user-interface device, such as the touch screen. One or more functions of the touch screen as well as corresponding information displayed on the device may be adjusted and/or varied from one application to the next and/or within a respective application. In this way, a common physical architecture (such as the touch screen) of the device may support the variety of applications with user interfaces that are intuitive and transparent.
The user interfaces may include one or more soft keyboard embodiments. The soft keyboard embodiments may include standard (QWERTY) and/or non-standard configurations of symbols on the displayed icons of the keyboard, such as those described in U.S. patent application Ser. No. 11/459,606, "Keyboards for Portable Electronic Devices," filed Jul. 24, 2006, and Ser. No. 11/459,615 "Touch Screen Keyboards for Portable Electronic Devices," filed Jul. 24, 2006, the contents of which are hereby incorporated by reference. The keyboard embodiments may include a reduced number of icons (or soft keys) relative to the number of keys in existing physical keyboards, such as that for a typewriter. This may make it easier for users to select one or more icons in the keyboard, and thus, one or more corresponding symbols. The keyboard embodiments may be adaptive. For example, displayed icons may be modified in accordance with user actions, such as selecting one or more icons and/or one or more corresponding symbols. One or more applications on the portable electronic device may utilize common and/or different keyboard embodiments. Thus, the keyboard embodiment used may be tailored to at least some of the applications. In some embodiments, one or more keyboard embodiments may be tailored to a respective user. For example, based on a word usage history (lexicography, slang, individual usage) of the respective user. Some of the keyboard embodiments may be adjusted to reduce a probability of a user error when selecting one or more icons, and thus one or more symbols, when using the soft keyboard embodiments.
Attention is now directed towards embodiments of the device. FIG. 1 is a block diagram illustrating a portable electronic device 100 with a touch-sensitive display 112 in accordance with some embodiments. The touch-sensitive display 112 is sometimes called a "touch screen" for convenience. The device 100 may include a memory 102 (which may include one or more computer readable storage mediums), a memory controller 122, one or more processing units (CPU'"'"'s) 120, a peripherals interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input/output (I/O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 may include one or more optical sensors 164. These components may communicate over one or more communication buses or signal lines 103.
It should be appreciated that the device 100 is only one example of a portable electronic device 100, and that the device 100 may have more or fewer components than shown, may combine two or more components, or a may have a different configuration or arrangement of the components. The various components shown in FIG. 1 may be implemented in hardware, software or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
Memory 102 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory 102 by other components of the device 100, such as the CPU 120 and the peripherals interface 118, may be controlled by the memory controller 122.
The peripherals interface 118 couples the input and output peripherals of the device to the CPU 120 and memory 102. The one or more processors 120 run or execute various software programs and/or sets of instructions stored in memory 102 to perform various functions for the device 100 and to process data.
In some embodiments, the peripherals interface 118, the CPU 120, and the memory controller 122 may be implemented on a single chip, such as a chip 104. In some other embodiments, they may be implemented on separate chips.
The RF (radio frequency) circuitry 108 receives and sends RF signals, also called electromagnetic signals. The RF circuitry 108 converts electrical signals to/from electromagnetic signals and communicates with communications networks and other communications devices via the electromagnetic signals. The RF circuitry 108 may include well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and so forth. The RF circuitry 108 may communicate with networks, such as the Internet, also referred to as the World Wide Web (WWW), an intranet and/or a wireless network, such as a cellular telephone network, a wireless local area network (LAN) and/or a metropolitan area network (MAN), and other devices by wireless communication. The wireless communication may use any of a plurality of communications standards, protocols and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), voice over Internet Protocol (VoIP), Wi-MAX, a protocol for email, instant messaging, and/or Short Message Service (SMS)), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
The audio circuitry 110, the speaker 111, and the microphone 113 provide an audio interface between a user and the device 100. The audio circuitry 110 receives audio data from the peripherals interface 118, converts the audio data to an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal to human-audible sound waves. The audio circuitry 110 also receives electrical signals converted by the microphone 113 from sound waves. The audio circuitry 110 converts the electrical signal to audio data and transmits the audio data to the peripherals interface 118 for processing. Audio data may be retrieved from and/or transmitted to memory 102 and/or the RF circuitry 108 by the peripherals interface 118. In some embodiments, the audio circuitry 110 also includes a headset jack (not shown). The headset jack provides an interface between the audio circuitry 110 and removable audio input/output peripherals, such as output-only headphones or a headset with both output (e.g., a headphone for one or both ears) and input (e.g., a microphone).
The I/O subsystem 106 couples input/output peripherals on the device 100, such as the touch screen 112 and other input/control devices 116, to the peripherals interface 118. The I/O subsystem 106 may include a display controller 156 and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive/send electrical signals from/to other input or control devices 116. The other input/control devices 116 may include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so forth. In some alternate embodiments, input controller(s) 160 may be coupled to any (or none) of the following: a keyboard, infrared port, USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208, FIG. 2) may include an up/down button for volume control of the speaker 111 and/or the microphone 113. The one or more buttons may include a push button (e.g., 206, FIG. 2). A quick press of the push button may disengage a lock of the touch screen 112 or begin a process that uses gestures on the touch screen to unlock the device, as described in U.S. patent application Ser. No. 11/322,549, "Unlocking a Device by Performing Gestures on an Unlock Image," filed Dec. 23, 2005, which is hereby incorporated by reference. A longer press of the push button (e.g., 206) may turn power to the device 100 on or off. The user may be able to customize a functionality of one or more of the buttons. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.
The touch-sensitive touch screen 112 provides an input interface and an output interface between the device and a user. The display controller 156 receives and/or sends electrical signals from/to the touch screen 112. The touch screen 112 displays visual output to the user. The visual output may include graphics, text, icons, video, and any combination thereof (collectively termed "graphics"). In some embodiments, some or all of the visual output may correspond to user-interface objects, further details of which are described below.
A touch screen 112 has a touch-sensitive surface, sensor or set of sensors that accepts input from the user based on haptic and/or tactile contact. The touch screen 112 and the display controller 156 (along with any associated modules and/or sets of instructions in memory 102) detect contact (and any movement or breaking of the contact) on the touch screen 112 and converts the detected contact into interaction with user-interface objects (e.g., one or more soft keys, icons, web pages or images) that are displayed on the touch screen. In an exemplary embodiment, a point of contact between a touch screen 112 and the user corresponds to a finger of the user.
The touch screen 112 may use LCD (liquid crystal display) technology, or LPD (light emitting polymer display) technology, although other display technologies may be used in other embodiments. The touch screen 112 and the display controller 156 may detect contact and any movement or breaking thereof using any of a plurality of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with a touch screen 112. A touch-sensitive display in some embodiments of the touch screen 112 may be analogous to the multi-touch sensitive tablets described in the following U.S. Pat. No. 6,323,846 (Westerman et al.), U.S. Pat. No. 6,570,557 (Westerman et al.), and/or U.S. Pat. No. 6,677,932 (Westerman), and/or U.S. Patent Publication 2002/0015024A1, each of which is hereby incorporated by reference. However, a touch screen 112 displays visual output from the portable electronic device 100, whereas touch sensitive tablets do not provide visual output. The touch screen 112 may have a resolution in excess of 100 dpi. In an exemplary embodiment, the touch screen in the display system has a resolution of approximately 168 dpi. The user may make contact with the touch screen 112 using any suitable object or appendage, such as a stylus, a finger, and so forth. In some embodiments, the user interface is designed to work primarily with finger-based contacts and gestures, which are much less precise than stylus-based input due to the larger area of contact of a finger on the touch screen. In some embodiments, the device translates the rough finger-based input into a precise pointer/cursor position or command for performing the actions desired by the user.
A touch-sensitive display in some embodiments of the touch screen 112 may be as described in the following applications: (1) U.S. patent application Ser. No. 11/381,313, "Multipoint Touch Surface Controller," filed on May 2, 2006; (2) U.S. patent application Ser. No. 10/840,862, "Multipoint Touchscreen," filed on May 6, 2004; (3) U.S. patent application Ser. No. 10/903,964, "Gestures For Touch Sensitive Input Devices," filed on Jul. 30, 2004; (4) U.S. patent application Ser. No. 11/048,264, "Gestures For Touch Sensitive Input Devices," filed on Jan. 31, 2005; (5) U.S. patent application Ser. No. 11/038,590, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices," filed on Jan. 18, 2005; (6) U.S. patent application Ser. No. 11/228,758, "Virtual Input Device Placement On A Touch Screen User Interface," filed on Sep. 16, 2005; (7) U.S. patent application Ser. No. 11/228,700, "Operation Of A Computer With A Touch Screen Interface," filed on Sep. 16, 2005; (8) U.S. patent application Ser. No. 11/228,737, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard," filed on Sep. 16, 2005; and (9) U.S. patent application Ser. No. 11/367,749, "Multi-Functional Hand-Held Device," filed on Mar. 3, 2006. All of these applications are incorporated by reference herein.
In some embodiments, in addition to the touch screen, the device 100 may include a touchpad (not shown) for activating or deactivating particular functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touchpad may be a touch-sensitive surface that is separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.
In some embodiments, the portable electronic device 100 may include a physical or virtual click wheel as an input control device 116. A user may navigate among and interact with one or more graphical objects (henceforth referred to as icons) displayed in the touch screen 112 by rotating the click wheel or by moving a point of contact with the click wheel (e.g., where the amount of movement of the point of contact is measured by its angular displacement with respect to a center point of the click wheel). The click wheel may also be used to select one or more of the displayed icons. For example, the user may press down on at least a portion of the click wheel or an associated button. User commands and navigation commands provided by the user via the click wheel may be processed by an input controller 160 as well as one or more of the modules and/or sets of instructions in memory 102. For a virtual click wheel, the click wheel and click wheel controller may be part of the touch screen 112 and the display controller 156, respectively. For a virtual click wheel, the click wheel may be either an opaque or semitransparent object that appears and disappears on the touch screen display in response to user interaction with the device. In some embodiments, a virtual click wheel is displayed on the touch screen of a portable multifunction device and operated by user contact with the touch screen.
The device 100 also includes a power system 162 for powering the various components. The power system 162 may include a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable electronic devices.
The device 100 may also include one or more optical sensors 164. FIG. 1 shows an optical sensor coupled to an optical sensor controller 158 in I/O subsystem 106. The optical sensor 164 may include charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. The optical sensor 164 receives light from the environment, projected through one or more lens, and converts the light to data representing an image. In conjunction with an imaging module 143 (sometimes called a camera module), the optical sensor 164 may capture still images or video. In some embodiments, an optical sensor is located on the back of the device 100, opposite the touch screen display 112 on the front of the device, so that the touch screen display may be used as a viewfinder for either still and/or video image acquisition. In some embodiments, an optical sensor is located on the front of the device so that the user'"'"'s image may be obtained for videoconferencing while the user views the other video conference participants on the touch screen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and the sensor in the device housing) so that a single optical sensor 164 may be used along with the touch screen display for both video conferencing and still and/or video image acquisition.
The device 100 may also include one or more proximity sensors 166. FIG. 1 shows a proximity sensor 166 coupled to the peripherals interface 118. Alternately, the proximity sensor 166 may be coupled to an input controller 160 in the I/O subsystem 106. The proximity sensor 166 may perform as described in U.S. patent application Ser. No. 11/241,839, "Proximity Detector in Handheld Device," filed Sep. 30, 2005, and Ser. No. 11/240,788, "Proximity Detector in Handheld Device," filed Sep. 30, 2005, which are hereby incorporated by reference. In some embodiments, the proximity sensor turns off and disables the touch screen 112 when the multifunction device is placed near the user'"'"'s ear (e.g., when the user is making a phone call). In some embodiments, the proximity sensor keeps the screen off when the device is in the user'"'"'s pocket, purse, or other dark area to prevent unnecessary battery drainage when the device is a locked state.
In some embodiments, the software components stored in memory 102 may include an operating system 126, a communication module (or set of instructions) 128, a contact/motion module (or set of instructions) 130, a graphics module (or set of instructions) 132, a text input module (or set of instructions) 134, a Global Positioning System (GPS) module (or set of instructions) 135, and applications (or set of instructions) 136.
The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and/or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.
The communication module 128 facilitates communication with other devices over one or more external ports 124 and also includes various software components for handling data received by the RF circuitry 108 and/or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FIREWIRE, etc.) is adapted for coupling directly to other devices or indirectly over a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, or similar to and/or compatible with the 30-pin connector used on iPod (trademark of Apple Computer, Inc.) devices.
The contact/motion module 130 may detect contact with the touch screen 112 (in conjunction with the display controller 156) and other touch sensitive devices (e.g., a touchpad or physical click wheel). The contact/motion module 130 includes various software components for performing various operations related to detection of contact, such as determining if contact has occurred, determining if there is movement of the contact and tracking the movement across the touch screen 112, and determining if the contact has been broken (i.e., if the contact has ceased). Determining movement of the point of contact may include determining speed (magnitude), velocity (magnitude and direction), and/or an acceleration (a change in magnitude and/or direction) of the point of contact. These operations may be applied to single contacts (e.g., one finger contacts) or to multiple simultaneous contacts (e.g., "multitouch"/multiple finger contacts). In some embodiments, the contact/motion module 130 and the display controller 156 also detects contact on a touchpad. In some embodiments, the contact/motion module 130 and the controller 160 detects contact on a click wheel 116.
The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112, including components for changing the intensity of graphics that are displayed. As used herein, the term "graphics" includes any object that can be displayed to a user, including without limitation text, web pages, icons (such as user-interface objects including soft keys), digital images, videos, animations and the like.
The text input module 134, which may be a component of graphics module 132, provides soft keyboards for entering text in various applications (e.g., contacts 137, email client 140, IM 141, blogging 142, browser 147, and any other application that needs text input).
The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to telephone 138 for use in location-based dialing, to camera 143 and/or blogger 142 as picture/video metadata, and to applications that provide location-based services such as weather widgets, local yellow page widgets, and map/navigation widgets).
The applications 136 may include the following modules (or sets of instructions), or a subset or superset thereof:
a contacts module 137 (sometimes called an address book or contact list);
a telephone module 138;
a video conferencing module 139;
an email client module 140;
an instant messaging (IM) module 141;
a blogging module 142;
a camera module 143 for still and/or video images;
an image management module 144;
a video player module 145;
a music player module 146;
a browser module 147;
a calendar module 148;
widget modules 149, which may include weather widget 149-1, stocks widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widgets 149-6;
widget creator module 150 for making user-created widgets 149-6; and/or
search module 151.
Examples of other applications 136 that may be stored in memory 102 include memo pad and other word processing applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.
In conjunction with touch screen 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 may be used to arrange, modify or otherwise manipulate, label, delete, present (e.g., in a digital slide show or album), and store still and/or video images. Embodiments of user interfaces and associated processes using image management module 144 are described further below.
In conjunction with RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, the browser module 147 may be used to browse the Internet, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages. Embodiments of user interfaces and associated processes using browser module 147 are described further below.
Note that the above identified modules and applications (including the image management module 144 and the browser module 147) correspond to a set of instructions for performing one or more functions described above. These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules may be combined or otherwise re-arranged in various embodiments. In some embodiments, memory 102 may store a subset of the modules and data structures identified above. Furthermore, memory 102 may store additional modules and data structures not described above.
In some embodiments, the device 100 is a device where operation of a predefined set of functions on the device is performed exclusively through a touch screen 112 and/or a touchpad. By using a touch screen and/or a touchpad as the primary input/control device for operation of the device 100, the number of physical input/control devices (such as pushbuttons, dials, and the like) on the device 100 may be reduced.
The predefined set of functions that may be performed exclusively through a touch screen and/or a touchpad include navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 to a main, home, or root menu from any user interface that may be displayed on the device 100. In such embodiments, the touchpad may be referred to as a "menu button." In some other embodiments, the menu button may be a physical push button or other physical input/control device instead of a touchpad.
FIG. 2 illustrates a portable electronic device 100 having a touch screen 112 in accordance with some embodiments. The touch screen may display one or more graphics. In this embodiment, as well as others described below, a user may select one or more of the graphics by making contact or touching the graphics, for example, with one or more fingers 202 (not drawn to scale in the figure) or a stylus (not shown in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the contact may include a gesture, such as one or more taps, one or more swipes (e.g., from left to right, or right to left, or back-and-forth in both directions; upward, or downward, or upward and downward) and/or a rolling of a finger (from right to left, left to right, upward and/or downward) that has made contact with the device 100. In some embodiments, inadvertent contact with a graphic may not select the graphic. For example, a swipe gesture with that sweeps over an application icon may not select the corresponding application when the gesture corresponding to selection is a tap. In other words, the portable electronic device 100 interprets the meaning of a gesture and acts accordingly after considering which application or module is in use at the moment.
The device 100 may also include one or more physical buttons, such as "home" or menu button 204. As described previously, the menu button 204 may be used to navigate to any application 136 in a set of applications that may be executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI in touch screen 112.
In one embodiment, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for powering the device on/off and locking the device, and volume adjustment button(s) 208. The push button 206 may be used to turn the power on/off on the device by depressing the button and holding the button in the depressed state for a predefined time interval; to lock the device by depressing the button and releasing the button before the predefined time interval has elapsed; and/or to unlock the device or initiate an unlock process. In an alternative embodiment, the device 100 also may accept verbal input for activation or deactivation of some functions through the microphone 113.
Attention is now directed towards embodiments of user interfaces ("UI") and associated processes that may be implemented on a portable electronic device 100.
FIG. 3 illustrates an exemplary user interface for unlocking a portable electronic device in accordance with some embodiments. In some embodiments, user interface 300 includes the following elements, or a subset or superset thereof:
Unlock image 302 that is moved with a finger gesture to unlock the device;
Arrow 304 that provides a visual cue to the unlock gesture;
Channel 306 that provides additional cues to the unlock gesture;
Time 308;
Day 310;
Date 312; and
Wallpaper image 314.
In some embodiments, the device detects contact with the touch-sensitive display (e.g., a user'"'"'s finger making contact on or near the unlock image 302) while the device is in a user-interface lock state. The device moves the unlock image 302 in accordance with the contact. The device transitions to a user-interface unlock state if the detected contact corresponds to a predefined gesture, such as moving the unlock image across channel 306. Conversely, the device maintains the user-interface lock state if the detected contact does not correspond to the predefined gesture. As noted above, processes that use gestures on the touch screen to unlock the device are described in U.S. patent application Ser. No. 11/322,549, "Unlocking a Device by Performing Gestures on an Unlock Image," filed Dec. 23, 2005, which is hereby incorporated by reference.
FIG. 4 illustrates an exemplary user interface for a menu of applications on a portable electronic device in accordance with some embodiments. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:
Signal strength indicator 402 for wireless communication;
Battery status indicator 406;
Tray 408 with icons for frequently used applications, such as:
Phone 138;
Email client 140, which may include an indicator 410 of the number of unread emails;
Browser 147; and
Music player 146; and
Icons for other applications, such as:
IM 141;
Image management 144;
Camera 143;
Video player 145;
Weather 149-1;
Stocks 149-2;
Blog 142;
Calendar 148;
Calculator 149-3;
Alarm clock 149-4;
Dictionary 149-5; and
User-created widget 149-6.
In some embodiments, UI 400 displays all of the available applications 136 on one screen so that there is no need to scroll through a list of applications (e.g., via a scroll bar). In some embodiments, as the number of applications increase, the icons corresponding to the applications may decrease in size so that all applications may be displayed on a single screen without scrolling. In some embodiments, having all applications on one screen and a menu button enables a user to access any desired application with at most two inputs, such as activating the menu button 204 and then activating a desired application (e.g., activating the image management module 144 by a finger tap 412 or other finger gesture on the icon corresponding to the application). Activating the desired application leads to another user interface corresponding to the user-selected application.
FIG. 5 illustrates an exemplary user interface for viewing photo albums in accordance with some embodiments. In some embodiments, user interface 500 includes the following elements, or a subset or superset thereof:
402, 404, and 406, as described above;
Graphics 504, e.g., thumbnail images of the first picture or a user-selected picture in the corresponding albums;
Album names 506;
Selection icons 508 that when activated (e.g., by a finger gesture on the icon) initiates display of the corresponding album (e.g., UI 600, FIG. 6); and
Settings icon 510, that brings up a settings menu when activated by a user gesture (e.g., a tap gesture).
FIG. 6 illustrates an exemplary user interface for viewing an album in accordance with some embodiments. In some embodiments, user interface 1000 includes the following elements, or a subset or superset thereof:
Photo albums icon 602 that when activated (e.g., by a finger gesture on the icon) initiates transfer to the photo albums UI (e.g., UI 500);
Thumbnail images 606 of images in the corresponding album;
Play icon 608 that when activated (e.g., by a finger gesture on the icon) initiates a slide show of the images the album;
In some embodiments, the user may scroll through the thumbnails 606 using vertically upward/downward gestures 610 on the touch screen. A stationary gesture on a particular thumbnail (e.g., a finger tap 612 on thumbnail 606-11) initiates transfer of the application to a different mode, i.e., an enlarged display of the corresponding image (e.g., UI 700, FIG. 7).
FIG. 7 illustrates an exemplary user interface for viewing enlarged images in an album in accordance with some embodiments. In some embodiments, user interface 700 includes the following elements, or a subset or superset thereof;
Album name icon 702 that when activated (e.g., by a finger gesture on the icon) initiates transfer to the corresponding album UI (e.g., UI 600);
Image 706;
Additional options icon 708 that when activated (e.g., by a finger gesture on the icon) initiates transfer to a UI with additional options for use of image 706;
Previous image icon 710 that when activated (e.g., by a finger gesture 722 on the icon) initiates display of the previous image in the album (e.g., 606-10);
Play icon 712 that when activated (e.g., by a finger gesture on the icon) initiates a slide show of the images in the album; and
Next image icon 714 that when activated (e.g., by a finger gesture 724 on the icon) initiates display of the next image in the album (e.g., 606-12).
In some embodiments, selecting the previous or next image icon is not the only way of displaying the previous or next image in the album. For example, the user can initiate viewing of the previous image by making a tap gesture 718 on the left side of the image or making a swipe gesture 716 from left to right on the image. The image 706 moves off screen to the right as the previous image moves on screen from the left. Similarly, the user can initiate viewing of the next image by making a tap gesture 720 on the right side of the image or making a swipe gesture 716 from right to left on the image. The image 706 moves off screen to the left as the next image moves on screen from the right.
With multiple ways to perform the same task, the portable electronic device enables a user to choose whichever the user prefers, thereby making the photo management simpler and more intuitive.
In some embodiments, user interface 800A includes the following elements, or a subset or superset thereof;
Previous page icon 802 that when activated (e.g., by a finger tap on the icon) initiates display of the previous web page;
Web page name 804;
Next page icon 806 that when activated (e.g., by a finger tap on the icon) initiates display of the next web page;
URL (Uniform Resource Locator) entry box 808 for inputting URLs of web pages;
Refresh icon 810 that when activated (e.g., by a finger tap on the icon) initiates a refresh of the web page;
Web page 812 or other structured document, which includes one or more blocks 814 of text content and other graphics (e.g., images);
Settings icon 816 that when activated (e.g., by a finger tap on the icon) initiates display of a settings menu for the browser;
Bookmarks icon 818 that when activated (e.g., by a finger tap on the icon) initiates display of a bookmarks list or menu for the browser;
Add bookmark icon 820 that when activated (e.g., by a finger tap on the icon) initiates display of a UI for adding bookmarks; and
New window icon 822 that when activated (e.g., by a finger tap on the icon) initiates display of a UI for adding new windows to the browser (e.g., UI 800D, FIG. 8D).
In some embodiments, in response to a predefined gesture by the user on a block 814 (e.g., a single tap gesture or a double tap gesture), the portable device initiates a predefined mode of the browser application that, e.g., causes the block to be enlarged and centered (or substantially centered) in the web page display. For example, in response to a single tap gesture 823 on block 814-5, block 814-5 may be enlarged and centered the display, as shown in UI 800B, FIG. 8B.
In some embodiments, the width of the user-selected block is scaled to fill the touch screen display. In some embodiments, the width of the block is scaled to fill the touch screen display with a predefined amount of padding along the sides of the display. In some embodiments, a zooming animation of the block is displayed during enlargement of the block. Similarly, in response to a single tap gesture 825 on block 814-2, block 814-2 may be enlarged with a zooming animation and two-dimensionally scrolled to the center of the display (not shown).
In some embodiments, the device analyzes the render tree of the web page 812 to determine the blocks 814 in the web page. In some embodiments, a block 814 corresponds to a render node that is: a replaced inline, a block, an inline block, or an inline table.
In some embodiments, in response to the same predefined gesture by the user on a block 814 (e.g., a single tap gesture or a double tap gesture) that is already enlarged and centered, the enlargement and/or centering is substantially or completely reversed. As shown in the UI 800B (FIG. 8B), in response to a single tap gesture 829 on block 814-5, the web page image may zoom out and return to UI 800A, FIG. 8A.
In some embodiments, in response to a predefined gesture (e.g., a single tap gesture or a double tap gesture) by the user on a block 814 that is already enlarged but not centered, the block is centered (or substantially centered) in the web page display. For example, in response to a single tap gesture 827 on block 814-4, block 814-4 may be centered (or substantially centered) in the web page display. Similarly, in response to a single tap gesture 835 on block 814-6, block 814-6 may be centered (or substantially centered) in the web page display. Thus, for a web page display that is already enlarged, in response to a predefined gesture, the device may display in an intuitive manner a series of blocks that the user wants to view. This same gesture may initiate different actions in different contexts (e.g., (1) zooming and/or enlarging a block in combination with scrolling when the block is displayed in reduced size, and (2) reversing the enlargement and/or centering if the block is already centered and enlarged).
In some embodiments, in response to a substantially vertical upward (or downward) swipe gesture 828 by the user, the web page (or, more generally, an electronic document) may scroll one-dimensionally upward (or downward) in the vertical direction.
In some embodiments, in response to a multi-touch 841 and 843 rotation gesture by the user, the web page may be rotated from portrait viewing (UI 800B, FIG. 8B) to landscape viewing (UI 800C, FIG. 8C), even if the amount of rotation in the multi-touch 841 and 843 rotation gesture is substantially different front 90°. Similarly, in response to a multi-touch 845 and 847 rotation gesture by the user, the web page may be rotated back from landscape viewing to portrait viewing, even if the amount of rotation in the multi-touch 845 and 847 rotation gesture is substantially different from 90°.
In some embodiments, multi-touch 841 and 843 rotation is performed by a user performing two substantially simultaneous finger contact rotations on or near the touch screen 112 within the display area occupied by the web page (e.g., on block 814-5).
Thus, in response to imprecise gestures by the user, precise movements of graphics occur. The device behaves in the manner desired by the user despite inaccurate input by the user. Note that the gestures described above for UI 800B, which has a portrait view, are also applicable to UIs with a landscape view (e.g., UI 800C) so that the user can choose whichever view the user prefers for web browsing.
FIG. 8D depicts a UI 800D for adding new windows to an application, such as the browser 147. For example, in response to a user finger tap 848 on the New Window icon 822, UI 800D displays an application (e.g., the browser 147) in a predefined mode, which includes a displayed window (e.g., web page 812-2) and at least one partially hidden window (e.g., web pages 812-1 and 812-3 and possibly other web pages that are completely hidden off-screen). UI 800D also displays an icon for adding windows to the application (e.g., new window or new page icon 836). Upon detecting activation of the icon 836 for adding windows, the browser adds a window to the application (e.g., a new window for a new web page 812).
Upon detecting a gesture on the touch screen display, a displayed window in the application is moved off the display and a hidden window is moved onto the display. For example, in response to detecting a tap gesture 849 on the left side of the screen, the window with web page 812-2 moves partially off-screen to the right to occupy the position left by the window with web page 812-3, which may move completely off-screen. Meanwhile, the partially hidden window with web page 812-1 moves to the center of the display, and another completely hidden window with a web page (not shown) may move partially onto the display. Alternatively, a left-to-right swipe gesture 851 on the touch screen may achieve the same effect.
Conversely, in response to detecting a tap gesture 853 on the right side of the screen, the window with web page 812-2 moves partially to the left and pushes the window with web page 812-1 off the display. Meanwhile, the partially hidden window with web page 812-3 moves to the center of the display, and another completely hidden window with a web page (not shown) may move partially onto the display. Alternatively, a right-to-left swipe gesture 851 may achieve the same effect.
In some embodiments, the tap gestures 849 or 853 may or may not be performed on (or within) the corresponding windows 812-1 or 812-3. The portable device operates in the same manner mentioned above as long as the tap gestures are within a predefined range from the corresponding windows.
In some embodiments, in response to a tap or other predefined gesture on a delete icon 834, the corresponding window 812 is deleted. In some embodiments, after the user-selected window is deleted from the display, a neighboring window moves in from the left or right to occupy the spot used to be occupied by the deleted window. In some embodiments, in response to a tap or other predefined gesture on Done icon 838, the window in the center of the display (e.g., 812-2) is enlarged to fill the screen. The operations described above in connection with UI 800D, which has a landscape view, are also applicable to UIs with a landscape view (e.g., UI 800A) so that the user can choose whichever view the user prefers for web browsing.
A comparison between the image management application (e.g., UI 700, FIG. 7) and the browser application (e.g., UI 800D, FIG. 8D) indicates that both applications have the feature of performing the same set of operations in response to different types of user gestures. FIG. 9 is a generalized flowchart illustrating a process for performing a predefined operation upon detecting multiple types of user gestures on the portable electronic device'"'"'s touch screen in accordance with some embodiments.
Upon a user selection of an icon in an application UI, the device displays a set of objects associated with the application on its touch screen (902). Depending on the application, the set of objects may be a set of thumbnail images (UI 600, FIG. 6), browsing windows, web page blocks, or the like.
Upon detecting a user selection of one of the objects (904), the device displays a specific, user-selected object (e.g., an enlarged image) on the touch screen (906) and then starts monitoring user gestures on the touch screen (908).
If the user gesture is a horizontal/vertical finger swipe on the touch screen (910), a finger tap on an edge of the touch screen (912), or a finger tap on the previous/next object icon (914), the device identifies in the set the previous or next object that is chosen by the user (916) and displays the previous or next object on the touch screen in replacement of the current object on the display (918, 920).
The foregoing description, for purpose of explanation, has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.
Litigation Campaign Assessment
Thank you for your request. You will receive a custom alert email when the Litigation Campaign Assessment is available.
Christie, Gregory N., Forstall, Scott, Westerman, Wayne C., Herz, Scott M., Ording, Bas
Primary Examiner(s)
Cerullo, Liliana
Time in patent office
Field of Search
US Class Current
CPC Class Codes
G06F 3/0412 Digitisers structurally int...
G06F 3/0416 Control or interface arrang...
G06F 3/04817 using icons graphical progr...
G06F 3/0482 interaction with lists of s...
G06F 3/04845 for image manipulation, e.g...
G06F 3/0485 Scrolling or panning
G06F 3/04883 for entering handwritten da...
G06F 3/14 Digital output to display d...
G06F 3/1431 using a single graphics con...
G06F 9/451 Execution arrangements for ...
H04M 1/72403 with means for local suppor...
H04M 1/72522 With means for supporting l...
233 Family Members
Method And Apparatus For Integrating Manual Input
Issued 11/27/2001
Current Assignee Apple Inc.
Original Assignee University of Delaware
Touch Pad Handheld Device
Current Assignee Apple Computer Incorporated (Apple Inc.)
Original Assignee Apple Computer Incorporated (Apple Inc.)
Original Assignee Apple Inc.
Touch Pad For Handheld Device
List Scrolling And Document Translation, Scaling, And Rotation On A Touch Screen Display
Method And Apparatus For Remotely Detecting Presence
Identifying Contacts On A Touch Surface
Automated Response To And Sensing Of User Activity In Portable Devices
Proximity Detector In Handheld Device
Electronic Device Having Display And Surrounding Touch Sensitive Bezel For User Interface And Control
User Interface Gestures
US D610,126 S1
Portable Electronic Device With Alert Silencing
Shape Detecting Input Device
Keyboards For Portable Electronic Devices
Integrated Proximity Sensor And Light Sensor
Visual Expander
Capacitive Sensing Arrangement
Maintaining Activity After Contact Liftoff Or Touchdown
Hand Held Electronic Device With Multiple Touch Sensing Devices
Ambidextrous Mouse
Ellipse Fitting For Multi Touch Surfaces
Wide Touchpad On A Portable Computer
Multi Touch Gesture Dictionary
Methods For Determining A Cursor Position From A Finger Contact With A Touch Screen Display
Activating Virtual Keys Of A Touch Screen Virtual Keyboard
Method, System, And Graphical User Interface For Positioning An Insertion Marker In A Touch Screen Display
Deletion Gestures On A Portable Multifunction Device
Web Clip Widgets On A Portable Multifunction Device
Soft Keyboard Display For A Portable Multifunction Device
Portable Multifunction Device, Method, And Graphical User Interface For Translating Displayed Content
Portable Multifunction Device, Method, And Graphical User Interface For Conference Calling
Portrait Landscape Rotation Heuristics For A Portable Multifunction Device
Screen Rotation Gestures On A Portable Multifunction Device
Voicemail Manager For Portable Multifunction Device
Missed Telephone Call Management For A Portable Multifunction Device
Creating Digital Artwork Based On Content File Metadata
Portable Electronic Device With Auto Dim Timers
Portable Electronic Device With Graphical User Interface Supporting Application Switching
System And Method For Managing Lists
Portable Electronic Device For Photo Management
Airplane Mode Indicator On A Portable Multifunction Device
Portable Electronic Device, Method, And Graphical User Interface For Displaying Electronic Lists And Documents
Touch Screen Device, Method, And Graphical User Interface For Displaying And Selecting Application Options
Device, Method, And Graphical User Interface For List Scrolling On A Touch Screen Display
Mode Based Graphical User Interfaces For Touch Sensitive Input Devices
Device, Method, And Graphical User Interface For Electronic Document Translation On A Touch Screen Display
Email Client For A Portable Multifunction Device
Touch Screen Device, Method, And Graphical User Interface For Providing Maps, Directions, And Location Based Information
Device And Method For Screen Rotation On A Touch Screen Display
Multi Touch Touch Surface
Portable Multifunction Device, Method, And Graphical User Interface For Viewing And Managing Electronic Calendars
Generating Control Signals From Multiple Contacts
Multi Touch Contact Tracking Using Predicted Paths
Device, Method, And Graphical User Interface For Zooming Out On A Touch Screen Display
Portable Electronic Device For Instant Messaging Multiple Recipients
Contact Tracking And Identification Module For Touch Sensing
Portable Multifunction Device, Method, And Graphical User Interface For Interacting With User Input Elements In Displayed Content
Multi Touch Contact Motion Extraction
Degree Of Freedom Extraction From Multiple Contacts
Portable Multifunction Device, Method, And Graphical User Interface For Interpreting A Finger Gesture On A Touch Screen Display
Port Discovery And Message Delivery In A Portable Electronic Device
Touch Screen Device, Method, And Graphical User Interface For Customizing Display Of Content Category Icons
Portable Multifunction Device, Method, And Graphical User Interface For Adjusting An Insertion Point Marker
Email Fetching System And Method In A Portable Electronic Device
Typing With A Touch Sensor
Portable Multifunction Device, Method, And Graphical User Interface For Providing Maps And Directions
Editing Interface
Touch Sensing Architecture
Sensor Arrangement For Use With A Touch Sensor That Identifies Hand Parts
Portable Multifunction Device, Method, And Graphical User Interface For Interpreting A Finger Gesture
Multi Touch Hand Position Offset Computation
Portable Electronic Device, Method, And Graphical User Interface For Displaying Electronic Documents And Lists
Touch Sensor Contact Information
Touch Sensing Through Hand Dissection
Touch Sensitive Electronic Apparatus For Media Applications, And Methods Therefor
Portable Multifunction Device, Method, And Graphical User Interface For Managing Communications Received While In A Locked State
Device, Method, And Graphical User Interface For Zooming In On A Touch Screen Display
Gesturing With A Multipoint Sensing Device
Portable Electronic Device For Instant Messaging
Gesture Learning
Touch Sensing With Mobile Sensors
Writing Using A Touch Sensor
Resting Contacts
Disambiguation Of Multitouch Gesture Recognition For 3 D Interaction
Device, Method And Graphical User Interface For Zooming In On A Touch Screen Display
Device, Method, And Graphical User Interface For Viewing Application Launch Icons
Sensor Arrangement For Use With A Touch Sensor
Back Side Interface For Hand Held Devices
Using Gestures To Slide Between User Interfaces
Portable Multifunction Device, Method, And Graphical User Interface For Displaying User Interface Objects Adaptively
Portable Multifunction Device, Method, And Graphical User Interface For Playing Online Videos
Portable Electronic Device With Conversation Management For Incoming Instant Messages
Scrolling Based On Rotational Movement
Portable Multifunction Device, Method, And Graphical User Interface For Configuring And Displaying Widgets
Input Apparatus And Button Arrangement For Handheld Device
Electronic Device Having Display And Surrounding Touch Sensitive Surfaces For User Interface And Control
Replacing Display Of Icons In Response To A Gesture
Portable Multifunction Device With Animated User Interface Transitions


CONFESSION: I had zero cooking skills prior to AIP.
There. I've said it. It's out in the open, exposed and ugly for all the world to see.
I was the gal everyone teased at allll the family activities for not knowing how to dice an onion, crack an egg, peel a potato without digging half of it out, make gravy without burning it, and certainly not knowing how to clean a chicken.
Christmas was always a pleasure….why yes, I can wash the cranberries! SINCE THAT'S ALL I CAN DO!
So when I set out to clean up my health by cleaning up my diet, I had my work cut out for me. God bless my husband and child for sticking with me through it all!
Now let's talk about a few things I learned along the way. Namely, FOOD SWAPS.
And no, I don't mean swapping recipes (although that's fun, too). I mean healthier ingredients we can swap for the not-so-healthy versions.
If you're reading this, you're probably already familiar with the AIP "avoid" list. So, in this post I'll talk specifically about AIP swaps, though all of these are great for anyone wanting to avoid potential allergens or inflammatory foods (except coconut…potential allergies there 😊).
And for the record, let me just say this is a GREAT time to be creative! Don't be afraid to get in the kitchen and experiment – that's how I learned and actually came up with some pretty fun recipes in the process!


Disney Interactive Studios will release LEGO® Pirates of the Caribbean: The Video Game in May 2011.
The game is an action adventure game bringing to life the Pirates of the Caribbean world and all its colorful characters in LEGO brick form. Players will experience all the memorable scenes from the first three films, as well as those in the upcoming fourth film, "Pirates of the Caribbean: On Stranger Tides," in the humorous and quirky LEGO video games style.
LEGO® Pirates of the Caribbean: The Video Game can be played on Xbox 360® video game and entertainment system, PlayStation®3 computer entertainment system, the Wii™ console, Games for Windows PC/Mac Hybrid , the Nintendo DS™ family of hand-held systems and the PSP® (PlayStation®Portable) system.
Change the dynamics of your household and make positive adjustments to your child's behaviour with the help of the newly launched program called 'the me strategies' Family Edition.
'the me strategies' has been developed by leading psychologist Jenny Chapman, an industry expert who predominantly works with children and is the principal psychologist of a private practice in NSW.
Jenny, who has worked for many years with families, including foster families and blended families, has developed a behaviour adjustment strategy which has been successfully used to amend the normal development difficulties of young children and those with severe challenging behaviours.
'the me strategies' Family Edition is the simple and fun intervention program that is emerging as a successful alternative parenting strategy and is promoting healthier relationships between family members as well as encouraging a peaceful and relaxed household.
It is designed to successfully adjust patterns of behaviour, teach new skills and/or encourage participation in completing tasks and contributing to the family unit. 'the me strategies' is based on choices and consequences that see children motivated to choose to earn incentives and privileges.
These incentives and privileges are identified to promote positive changes in a child's pattern of behaviour as an alternative to punishing. This technique in contrast to reactive methods of parenting, is preventative; a strategy that reduces the likelihood of a behaviour occurring in the first place.
Whilst Jenny sees extreme behavioural issues in her practice, the successful strategies she has implemented with these families has inspired her to develop an alternative parenting technique that can be implemented in a variety of family settings. Behavioural issues can be as simple as having to repeatedly ask your child to pick up after themselves, make their bed, or set the table for dinner, which in itself is not major, but having to ask constantly every time and every day is wearing on you and the rest of the household.
'the me strategies' kit comes complete with all the contents you and your family will need to create magnetic charts for two children. Using the tasks and character sheets with the behaviour point numbers, parents can sit down with their children to create a fun and interactive incentive program that really works. As a family, parents and kids can agree upon weekly tasks or behaviours that need improvement and negotiate incentives once these points have been achieved.
Jenny notes that parents may feel familiar with this theory but 'the me strategies' intervention strategy is indeed unique. "Most parents have possibly tried something like this before or may recognise elements of this strategy, but it is the combination of elements, together with the rules of implementation, that set it apart from other behavioural change strategies, particularly reward charts. This strategy has evolved due to a demand for a successful alternative parenting intervention and families who use 'the me strategies' continue to report positive results," Jenny says.
Whilst reward charts may assist to 'switch off' a behaviour, they usually don't teach the skill associated with the learning that occurs with 'the me strategies'. Parents can use this strategy with children as young as four or five years old, right up until the child leaves home.


This book cover has 3 lines for the title, 1 line for the subtitle, 1 line for the author, 2 lines for the hook.
The most popular tags describing this Surreal premade book cover are man, fantasy, concept, person and white.
Other keywords revelant to this premade cover are sky, portrait, face, vintage, abstract, symbol, business, view, creative, head, imagination, cloud, idea, dream, surreal, elegance, conceptual, businessman, hat, weather, creativity, angry, brown, inspiration, mind, solution, meditation, air, brain, mystical, problem, message, birds, minimal, soft, thought, pollution, busy, blind, confusion, passing, psyche, humor, visibility, covered.


"Nest Bedding is one of the leading mattress and bedding stores in the USA. A family owned and operated chain with stores in New York, LA and San Francisco." - nestbedding.com. At Couponists.com, we're continuously looking for the best Nest Bedding coupons and Nest Bedding promo codes. When you make your next purchase make sure to check us out and get your latest coupons for Nest Bedding from couponists.com. Before you finalize your purchase, enter your Nest Bedding coupon for an instant discount. If we have a free shipping coupon for Nest Bedding, you can enter it during the checkout process and get free shipping as well.


text:
Q: Linux: Invalid TCP Flags It is often recommended in tutorials and books to filter invalid TCP flags with iptables. I wonder if those aren't already filtered by the kernel itself or the iptables state module. Does anyone have further information on this?

A: I guess the TCP specifications do not prohibit some invalid flag configurations. Some systems may choose to send (or had used to send) strange flag combinations, but nowadays only "bad guys" send them(for FIN scan, etc.), so it's advised to filter them out.
By the way, here are the iptables rules that I use to filter them out (probably got these from frozentux iptables tutorial)
#new not syn
-A bad_tcp_packets -p tcp ! --syn -m state --state NEW -j DROP

-A bad_tcp_packets -p tcp --tcp-flags ALL NONE -j DROP
-A bad_tcp_packets -p tcp --tcp-flags ALL ALL -j DROP
-A bad_tcp_packets -p tcp --tcp-flags ALL FIN,URG,PSH -j DROP
-A bad_tcp_packets -p tcp --tcp-flags ALL SYN,RST,ACK,FIN,URG -j DROP
-A bad_tcp_packets -p tcp --tcp-flags SYN,RST SYN,RST -j DROP
-A bad_tcp_packets -p tcp --tcp-flags SYN,FIN SYN,FIN -j DROP

A: Filtering weird TCP flags is typically a good idea for two reasons:

*

*It prevents several types of network scanning

*Some (older) system can behave badly when sent weird TCP flags

In iptables you have to do the filtering of such packets by hand (as far as I know), other firewalls such as PF has "scrubbing" modules. Scrubbing is a set of standard rules which tries to remove invalid packets from the stream, ensures all packets have the same TTL etc.

A: New versions of kernels not respond to messages with invalid TCP flags. You could be tested by sending packets with invalid flags Hping3 using the tool. If you need to use iptables , I leave my script:
#!/bin/bash

# -- UTF 8 --

iptables="/sbin/iptables"

CADENA="put INPUT, FORWARD or OUTPUT"

IPWS="put destination IP"

IFACE_Nro1="put input interface (example: wlan0 or eth0)"

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags SYN,RST SYN,RST -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags SYN,FIN SYN,FIN -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags FIN,RST FIN,RST -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags SYN,FIN,PSH SYN,FIN,PSH -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags SYN,FIN,URG SYN,FIN,URG -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags SYN,FIN,RST SYN,FIN,RST -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags ALL SYN,FIN,RST,PSH -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags ALL ACK,RST,SYN,FIN -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags ALL FIN,URG,PSH -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags ALL SYN,RST,ACK,FIN,URG -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags ALL SYN,RST,ACK,FIN,PSH -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags ALL ALL -j DROP

$iptables -A $CADENA -i $IFACE_Nro1 -d $IPWS -p tcp --tcp-flags ALL NONE -j DROP

redpajama_set_name: RedPajamaStackExchange


text:
#include "LLVMCodeGen.h"

using namespace std;
using namespace llvm;
using namespace codegen;
using namespace common;

void LLVMCodeGen::initTypes() {
    // Type constants
    Int1 = llvm::Type::getInt1Ty(Ctx);
    Int8 = llvm::Type::getInt8Ty(Ctx);
    Int32 = llvm::Type::getInt32Ty(Ctx);
    VoidPtr = PointerType::getUnqual(Int8);

    Int = llvm::Type::getInt64Ty(Ctx);
    Float = llvm::Type::getDoubleTy(Ctx);

    // Union type used for easy bitcast
    /*
    UnionType = StructType::create(Ctx, Int, "Union");

    // Runtime type
    RuntimeType = StructType::create(Ctx);
    llvm::Type *Body[] = { Int, PointerType::getUnqual(RuntimeType) };
    RuntimeType->setBody(Body);
     */

    // Main type
    MainType = FunctionType::get(Int32,
                                 vector<llvm::Type *> {
                                         Int32,
                                         PointerType::getUnqual(VoidPtr)
                                 },
                                 false);
}

llvm::Type *LLVMCodeGen::getLLVMType(common::Type Ty) {
    switch (Ty.Id) {
    case common::TypeId::FLOAT:
        return Float;
    case common::TypeId::INT:
        return Int;
    case common::TypeId::BOOL:
        return Int;
    case common::TypeId::CHAR:
        return Int;
    case common::TypeId::TUPLE:
        return PointerType::getUnqual(getLLVMTupleType(Ty));
    case common::TypeId::LIST:
    case common::TypeId::EMPTYLIST:
    case common::TypeId::STRING:
        return PointerType::getUnqual(getLLVMListType(Ty));
    case common::TypeId::SIGNATURE:
        return PointerType::getUnqual(getLLVMFuncType(Ty));
    case common::TypeId::VOID:
        return llvm::Type::getVoidTy(Ctx);
    default:
        assert(0 && "Type not supported");
    }
}

llvm::StructType *LLVMCodeGen::getLLVMTupleType(common::Type Ty) {
    auto CacheTy = TupleTypes.find(Ty);

    if (CacheTy != TupleTypes.end())
        return CacheTy->second;

    std::vector<llvm::Type *> Subtypes;
    for (auto &Subtype : Ty.Subtypes)
        Subtypes.push_back(getLLVMType(Subtype));

    return TupleTypes[Ty] = StructType::create(Ctx, Subtypes, Ty.str());
}

llvm::StructType *LLVMCodeGen::getLLVMListType(common::Type Ty) {
    auto CacheTy = ListTypes.find(Ty);

    if (CacheTy != ListTypes.end())
        return CacheTy->second;

    llvm::Type *ElementTy;
    StructType *ListTy;
    if (!Ty.Subtypes.empty()) {
        ElementTy = getLLVMType(Ty.Subtypes.front());
        ListTy = StructType::create(Ctx, Ty.str());
    } else {
        ElementTy = VoidPtr;
        ListTy = StructType::create(Ctx, "VoidPtr");
    }

    llvm::Type *Body[] = { ElementTy, PointerType::getUnqual(ListTy) };
    ListTy->setBody(Body);

    return ListTypes[Ty] = ListTy;
}

llvm::FunctionType *LLVMCodeGen::getLLVMFuncType(common::Type Ty) {
    auto CacheType = FuncTypes.find(Ty);

    if (CacheType != FuncTypes.end())
        return CacheType->second;

    auto OutputType = getLLVMType(Ty.Subtypes.back());
    std::vector<llvm::Type *> InputTypes;
    for (size_t i = 0; i < Ty.Subtypes.size() - 1; ++i) {
        InputTypes.push_back(getLLVMType(Ty.Subtypes[i]));
    }

    return FuncTypes[Ty] = FunctionType::get(OutputType, InputTypes, false);
}

llvm::GlobalVariable *LLVMCodeGen::getRuntimeType(common::Type Ty) {
    auto CacheType = RunTypes.find(Ty);

    if (CacheType != RunTypes.end())
        return CacheType->second;

    auto ElementTy = PointerType::getUnqual(RunType);
    auto ArrayTy = ArrayType::get(ElementTy, Ty.Subtypes.size() + 1);

    vector<Constant *> ArrayElements;
    for (auto Subtype : Ty.Subtypes) {
        auto Element = getRuntimeType(Subtype);
        ArrayElements.push_back(static_cast<Constant *>(Builder.CreateBitCast(Element, ElementTy)));
    }
    ArrayElements.push_back(ConstantPointerNull::get(ElementTy));

    // Create runtime type
    auto Array = ConstantArray::get(ArrayTy, ArrayElements);
    auto StructTy = StructType::get(Ctx, { Int, ArrayTy });
    auto ConstVal = ConstantStruct::get(StructTy, { ConstantInt::get(Int, (uint64_t)Ty.Id), Array } );

    return RunTypes[Ty] = new GlobalVariable(*Module, ConstVal->getType(), true,
                                GlobalVariable::ExternalLinkage, ConstVal);
}

common::Type LLVMCodeGen::getType(llvm::Type *Ty) {
    if (Ty == Int)
        return common::Type(TypeId::INT);
    if (Ty == Float)
        return common::Type(TypeId::FLOAT);
    if (Ty == VoidPtr)
        return common::Type(TypeId::STRING, vector<common::Type> { common::Type(TypeId::CHAR) });
    if (Ty->isVoidTy())
        return common::Type(TypeId::VOID);
    if (Ty->isFunctionTy())
        return getFuncType(static_cast<FunctionType *>(Ty));

    assert(0);
}

common::Type LLVMCodeGen::getFuncType(FunctionType *FuncTy)
{
    common::Type Res(TypeId::SIGNATURE);

    auto Subtypes = FuncTy->subtypes();
    for (size_t i = 1; i != Subtypes.size(); ++i) {
        Res.Subtypes.push_back(getType(Subtypes[i]));
    }
    Res.Subtypes.push_back(getType(FuncTy->getReturnType()));

    return Res;
}

common::Type LLVMCodeGen::getFuncType(GlobalVariable *FuncRunTy)
{
    // TODO: SPPL_DECL support for any type
    return common::Type(TypeId::SIGNATURE);
}

redpajama_set_name: RedPajamaGithub