By Aidan Malley
Published: 07:45 PM EST
In what's considered the definitive overview of Apple's attempts to patent its multi-touch interface, a deluge of newly-public filings show Apple considering technology that hasn't yet been used in the iPhone or the Mac -- including sensing the difference between body parts, explaining gestures through activities, and even responding differently to input from fingernails.
A majority of the patents just published on Thursday not only relate to multi-touch in the iPhone, iPod touch, and Macs but were all originally submitted on January 3rd, 2007 -- a week before the iPhone's first showing, when Apple chief Steve Jobs touted over a hundred patents for the handset.
Many also credit the inventions to either John Elias or Wayne Westerman, both of whom founded FingerWorks. The company was one of the pioneers of multi-touch input and was subsumed into Apple in early 2005 along with Elias and Westerman.
While some of these patents relate to the basic operation of Apple's multi-touch devices as users already know them, others reveal directions that Cupertino, Calif.-based Apple has never taken with its current touch hardware.
In some cases, this includes advancements the touch panel itself can recognize. One filing for
input discrimination would compare the pixel values in images captured by the touchscreen and intelligently recognize different parts of the body. A device could change its behavior depending on not just its proximity to a user's face (by visualizing the ear) but to nearly any event: an iPhone could automatically wake itself on a finger clasp that takes the device out of a pocket, or ignore its owner's accidental palm presses.
An extra approach, described as a
multi-event system, would also let Apple add context-sensitive menus, guides, and other information by detecting whether or not input comes from skin or an inanimate source. A user could tap items with the flesh of their finger for normal input but flip over to their fingernail and apply pressure for a separate menu, according to Apple.
Opening a menu using a fingernail.
The electronics firm has also buffered itself against the possibility that multi-touch gestures may become too complex to be immediately intuitive. Instead of just providing video demos, as users see today for multi-touch trackpads on some MacBooks, a
gesture learning system could guide the user through mimicking pinches, rotations, and swipes to understand how they work, including through color trails that follow fingers or the outline of a hand that performs the correct version of a gesture at the same time.
As in a test, the system could actively provide audiovisual or text feedback until the user performs the action correctly.
An example Apple's proposed method for learning gestures.
The patent filings reveal a more complex vision of multi-touch in Apple products than first thought and show that even the late stages of iPhone development produced inventions that never reached the finished product. However, it's unclear as to whether this is simply a snapshot of Apple's discovery process in January of last year or whether some, if any, of the described technology is ultimately part of a roadmap for future computers, media players, or phones.
All of Apple's directly touch-related patent filings revealed today are available below.
Gesture learning
Multi-touch auto scanning
Projection scan multi-touch sensor array
Multi-Touch Input Discrimination
Error compensation for multi-touch surfaces
Double-sided touch-sensitive panel with shield and drive combined layer
Periodic sensor panel baseline adjustment
Double-sided touch sensitive panel and flex circuit bonding
Scan sequence generator
Advanced frequency calibration
Front-end signal compensation
Master/slave mode for sensor processing devices
Full scale calibration measurement for multi-touch surfaces
Minimizing mismatch during compensation
Multi-touch surface stackup arrangement
Proximity and multi-touch sensor detection and demodulation
MULTI-EVENT INPUT SYSTEM
NOISE DETECTION IN MULTI-TOUCH SENSORS
FAR-FIELD INPUT IDENTIFICATION
SIMULTANEOUS SENSING ARRANGEMENT
PERIPHERAL PIXEL NOISE REDUCTION
IRREGULAR INPUT IDENTIFICATION
Noise reduction within an electronic device using automatic frequency modulation
Automatic frequency calibration
Analog boundary scanning based on stray capacitance
