Biblio 10

02.11.
13
(2008..2010) History of Pen and Gesture Computing
History of Pen and Gesture Computing: Annotated Bibliography in On-line Character Recognition, Pen Computing, Gesture User Interfaces and Tablet and Touch Computers
References from the approximate years 2008 to 2010.
This compilation and all annotations are copyright Jean Renard Ward, 1993, 2004, 2011. Permission is granted to use this information in publication, including confidential reports, provided that accompanying text clearly makes reference to the URL for this page, along with the statement:
S o u r c e :A n n o t a t e dB i b l i o g r a p h yi nO n l i n eC h a r a c t e rR e c o g n i t i o n , P e nC o m p u t i n g ,G e s t u r eU s e rI n t e r f a c e sa n dT a b l e ta n dT o u c h C o m p u t e r s C o p y r i g h tJ e a nR e n a r dW a r d
These are items in my personal collection, either as physical items or (sometimes) as PDF files. I can be contacted at jrward@alum.mit.edu. Copyright T h uO c t2 42 2 : 1 0 : 5 8E D T2 0 1 3.
Mirrors of this page can be found at: http://users.erols.com/rwservices/pens/biblio10.html http://216.15.114.196:81/pens/biblio10.html http://rwservices.no-ip.info:81/pens/biblio10.html (Generally most up-to-date)
Main Reference Page [3MTouch08a] ( * )3M Touch "Dispersive Signal Touch Technology: Technology Profile", 3M Touch, 2008
Acoustic touch digitizer, using bending waves within substrate/glass
users.erols.com/rwservices/pens/biblio10.html 1/74
02.11.13
instead of surface waves SAW, determins center location of smearing/dispersed/reflected acoustic waves. Compare with TouchDynamics / Acoustic Pulse Recognition?
[Acer10a] ( * )Acer "Acer Iconia: Dual-Display-Notebook", www.computerbild.de, 24 November 2010

Dual-touchscreen laptop with virtual keyboard or other elements in one side, regular display in other. Compare with Refalo, Microsoft Courier. Dual-touchscreen. Additional references in file.
[Adapx08a] ( * )Adapx.com "Adapx Digital Paper", www.adapx.com, fetched 2008

Paper forms for Anoto-type opctical digitizer pen: mentions 1200 dpi resolution of color printers certified by Anoto. Capturx capture software to upload electronic ink data directly into Microsoft OneNote, ArcGIS 9.2 Desktop geographical mapping software, and AutoCAD. "Rite in the Rain" all-weather waterproof writing paper.
[AFB10a] ( * )American Foundation for the Blind "Assistive Technology Timeline", www.afb.org, 2010
History of talking computers, DOS and Windows Screen readers, and other assistive technologies: Enhanced PC Talking Program by Ronald Hutchinson worked with word processors ands spreadsheets 1984, outSPOKEN for Macintosh 1989, ASAP Automatic Screen Access Program "with artificial intelligence" 1990. Virtual keyboards?
[AlasdairA10a] ( * )Alasdair, Allan "Learning iPhone Programming: From Xcode to App Store", O'Reilly Publishers, 2010
Development guide for iPhone (iPod, iPad) devices: Compass, Proximity, Accelerometor sensors, Objective-C, Tablet-based view controller objects, etc.
[AnalogDevices10a] ( * )Analog Devices, Inc. "Application Notes AN-925 Sensors for the AD7147 and AD7148 CapTouch Controllers", Analog Devices www.analog.com, 2010
Capacitive-to-digital A/D for single-electrode capacitive sensors (capacitance to ground). Intended for touch buttons, sliders, wheels, and matrix keypads (compare touchscreens). Matrix keypad, each button has two electrodes (connected to row and to column lines), single key detected by row + column ID. Eight sensor inputs, so up to 4x4 keypad.
[AnanthaswamyA09] ( * )Ananthaswamy, Anil "Vibrating touch screen puts Braille at the Fingertips", New Scientist Magazine, 31 March 2009
02.11.13
Accessibility technology: Haptic display device for Nokia haptic touchscreen with vibration (similar to iPod/iPhone) devices: six pulse/no-pulse signals via vibration corresponding to the six dots of a Braille character.
[AndreBK10a] ( * )Andre, Bartley K; Ording, Bas; and Christie, Greg "Activativating Virtual Keys of a Touch-Screen Virtual Keyboard", United States Patent 7,844,914, November 30, 2010
virtual/soft keyboard on touchscreen: find centroid of finger touch, and map it to (weigeted sitance) nearest key. Compare with stroke targeting/ink targeting in PenPoint, Tappert, and Slate PenApps?
[Apple08a] ( * )Apple.com "iPhone: Using the Multi-touch Display / Entering Text on the Multi-touch Display Keyboard", support.apple.com, July 10, 2008
iPhone/iPad gestures: flicking and dragging gestures does not select (press-and-hold or press gesture). Tapping halts dynamic zoom. Pinch and zoom gestures. Press to get magnified view of text while editing. Note: does not cover accessibility gestures, such as triple-flick.
[Apple09a] ( * )Apple.com "iPhone User Guide for iPhone OS 3.1 Software", www.apple.com, 2009
User Guide for iPhone: zoom/pinch, scroll, flick gestures on touchscreen, on-screen (virtual) keyboard: Japanese/Chinese keyboards show alternative characters to pick from: Pinyin and Zhuyin. Writing area for handwriting recognition of Simplified or Traditional Chinese handwriting. VoiceOver accessibility.
[Apple10a] ( * )Apple.com "It's easy to be good with Numbers", www.apple.com, April 2010
iWorks spreadsheet for iPad: refers to swip and tap gestures
[Apple10b] ( * )Apple.com "VoiceOver: Fr blinde und sehbehinderte Menschen hat Apple eine Loesung in jeden Mac integriert", www.apple.com, October 2010
(in German) Review of VoiceOver screen reader software for Maic with multi-touch trackpad: mentions "rotor" circle/rotational gesture to bring up navigation tools and command input. Supports up to 32-line braille (braillezeilter) output, 1 on Bluetooth, 31 on USB.
[Apple10c] ( * )Apple.com "Apple - Accessibility - iPhone - Vision", www.apple.com, fetched 2010

VoiceOver accesibility screen-reader software. Mentions voice prompting on what gesture is appropriate: Rotor gesture with two fingers to change
02.11.13
scope of other features: flick to move by pages or lines, etc. Double-tap with two or three fingers.
[Apple10d] ( * )Apple.com "Apple - Accessibility - VoiceOver - In Depth", www.apple.com, fetched 2010

VoiceOver accesibility screen-reader software. Drag of finger (or two) over item speaks the item. Gestures may be assigned new semantics: preferences may be stored removed on a server.
[ArrasK09a] ( * )Arras, Kai "Octave/Matlab Tutorial", Social Robotics Lab, Universitatet Freiburg, Germany, October 2009
Matlab/Octave tutorial: Octave is Matlab clone, interactive mathematical graphing and data calculation utility.
[Arrington08a] ( * )Arrington, Michael "Microsoft TouchWell can inexpensively turn any flat surface into a multi-touch display", www.crunchgear.com, May 14th, 2008
Microsoft TouchWall, three-laser sensor for multi touch on any flat surface, project display. Described as distinct from Microsoft Surface, which uses cameras to recognize objects placed on it (e.g. a cell phone, Surface reads photos from cell phone). See also CrunchPad about Arrington
[AshbrookD10a] ( * )Ashbrook, Daniel and Starner, Thad "MAGIC: A Motion Gesture Design Tool", Proc. CHI 2010, April 10-15, Atlanta. 10 pages
Trainable gesture recognition system by example. Includes some automaticion for false positive and recognition error rates. Input device is three-axis accelerometer, like a Wii.
[AshtianiB09a] ( * )Astiani, Behrooz and Stuerzlinger, Wolfgang "XNT: Object transformation on multi-touch surfaces", Poster paper, Interactive Tabletops and Surfaces (ACM), 2009
Three-finger translate/scale/pinch/zoom/rotate/move gesture instead of two-finger pinch/zoom: more stable hand posture, improves precision and control. Touchscreen is touch glove with LED light sources on fingertips, detected optically when touch surface with diffuser glass.
[Atmel08a] ( * )Atmel Inc. "Amtel's New Family of Touch Screen Solutions Enable Two Touch Gestures for Intuitive user Interfaces", www.atmel.com, press release, October 22, 2008
Amtel: formerly Quantum Research Group. QTouch touchscreen. Capacitive sensing, statement about detecting two touches, refers to multi-touch. Single layer of ITO (front surface?)
02.11.13
Additional material in paper files: Quantum acquired by Amtel: see Quantum file.
[Atmel08b] ( * )Atmel Inc. "Touch Sensors Design Guide / Amtel Touch Library User Guide", www.atmel.com
Amtel: formerly Quantum Research Group. QTouch touchscreen. Extensive discussion of functioning of capacitive touch sensors.
[Atmel09a] ( * )Atmel Inc. "Atmel QMatrix Touch Technology", www.atmel.com

Amtel: formerly Quantum Research Group. QTouch touchscreen. Capacitive sensing, statement about detecting two touches, refers to multi-touch. QMatrix touch sensor IC devices: scan touchscreen keys consisting of passive matrix of copper or transparent ITO indium in oxide, differential detection to reject capacitive pickup on adjacent keys. States spread spectrum signals to reduce interference. Shows electrode configurations including serpentine and spiral. QMatrix touch sensor IC devices: scan touchscreen keys consisting of passive matrix of copper or transparent ITO indium in oxide, differential detection to reject capacitive pickup on adjacent keys. States spread spectrum signals to reduce interference.
[AutioMT09a] ( * )Autio, Markku Autlo and Jaervioe, Jami Jarkko Juhani "Graphical Functions by Gestures", United States Patent 7,623,119, November 24, 2009
Gesture on an inactive area (not an icon, link, scrollbar, etc.) is processed as a command if the handwritten character matches character. Compare with PenPoint.
[BaileyRPS09a] ( * )Bailey, Ralph-Peter Steven "Haptic Input Devices", United States Patent 7,499.021, March 3, 2009
Multi-pod (hexapod/pentapod) linkage mechanism for force feedback using magneto-restrictive fluid brakes. Has squeezable (pressure, but not tipforce) stylus for input.
[BarnkowL10a] ( * )Barnkow, Lorenz "Eine Multitouch-fhige Kchentheke: Im Kontext des Living Place Hamburg", Hochschule fr Angewandte Wissenschaften Hamburg, 2010
Report on multi-touch-enabled kitchen in experimental setting: multi-touch touchscreen / surface using under-the-table optical tracking and internal reflection from finger contact. Cites to NUI Group Community for
02.11.13
construction of multi-touch surface.
[BarrettGL10a] ( * )Barrett, Gary L. and Omote, Ryomei "ProjectedCapacitance Touch Technology", Information Display, March 2010, pp. 16-21
. Overview of capacitive touch tablet technology. "grip supression" for handheld smartphones, similar to palm rejection. Describes true multi-touch as possible in multi-pad self-capacitance sensor and in intersection grid mutual capacitances.
[BarrettG10b] ( * )Barrett, Gary "Putting the "Touch" in Multi-Touch: An in-depth look at the future of interactivity", www.veritasesvisus.com, Touch Panel, December 2010, pp. 59-61
Brief overview of several multi-touch technologies: describes projected capacitive as multi-touch zones (compare with Kaplow?), multi-touch input seen by applications (in most OSs) as multip mouse/locator devices. States only three gestures unique to multi-touch (???): pinch, expand, rotate. Asserts that first iPad / iPhone touchscreens were resistive film with "ghosting" for multi-touch.
[BarrettGL10z] ( * )Barrett, Gary L. and Omote, Ryomei "Projected Capacitive Touch Screens", Whitepaper, Touch International
Appears to be alternative/revised/version of 2010 SID article by same authors. One difference is refering to glass vs. plastic substrates, plastic flexible and can be curved. (Microcracks?)
[BeavenDF10a] ( * )Beaven, Douglas F.; Ahlgren, Janet; Kelley, Kevin; Palmer, Gorham; and Rudolph, Stuart E. "System for Performing Collaborative Tasks", United States Patent 7,698,160
Graphical user interface allowing users to combine information from multiple internet and other sources into single web page and share information with others. Data from multiple sources can be combined based on keywords, field names, or other attributes present in the data. Patent assigned to Virtual Agility.
[Billinghurst09a] ( * )Billinghurst, Mark and Buxton, William "Gesture based Interaction: Chapter 14 of "Haptic Input" Draft Documents", www.billbuxton.com
Gesture defined as hand gesture ("a motion of the body that contain contains information", not as handwriting/shape gesture for pen-computing (cites to Kurtenbach90 for definition). Mentions Theremin as gesture-input device (non-computer). Mentions "put that there" (Bolt 84). Draft of May 27,
02.11.13
2009: File also contains 2002 Draft
[BishopT10a] ( * )Bishop, Todd "Dead 'Courier' walking: Microsoft gets dual-screen design patent", techflash.com, June 29, 2010
Dual-screen digitizer tablet by Microsoft: 3 Megapixel camera, compared with One Laptop Per Child XO-2 and MoleSkine. additional references on Courier in file.
[BlackS09a] ( * )Black, Sue; Boca, Paul P., Bowen, Jonathan P.; Gorman, Jason; Hinchey, Mike "Formal versus Agile: survival of the Fittest?", ICCC Computer, September 2009, pp. 37-ff
Review of Agile versus Formal development: refers to writing tests before implementation in Agile development. Numerous references, argues that formal proof of correctness and automatic test generation more valuable
[BogueA10a] ( * )Bogue, Adam "Segmenting a multi-touch input region by user", United States Patent Application 2010/0085323, August 8, 2010
On a multi-touch tablet/tabletop with multiple users (but not a tablet like DiamondTouch with extra electronics to identify each user), assign touches far apart (in space, mostly) to separate users, assign touches close to another touch (in space and time) to the same user as the first touch. Hardware can stream the assigned touches to different input streams, to maintain some compatibility with existing single-stream input applications.
[BonnerM10a] ( * )Bonner, Matthew N.; Brudvik, Jeremy; Abowd, Gregory D.; and Edwards, W. Keith "No-Look Notes: Accessible EyesFree Multi-touch Text Entry", Proc. 8th Int'. Conf. on Pervasive Computing, Helsinki Finland, May 17-20, 2010
Accessible on-screen keyboard on touchscreen for blind/visually impaired: divide screen into large regions for groups of characters (ABC, DEF), tap on region gives sub-menu of individual characters. Cites to VoiceOver and Quikwriting, includes review of accessibility techniques for touchscreens including multi-touch.
[BostonGlobe08a] ( * )Boston Globe "Tech Development: Taking creepy out of proximity sensing", The Boston Globe, Monday, June 9, 2008, page B6
Electrostatic digitizer proximity sensing in a picture frame: Synaptics.com
[BostonGlobe08b] ( * )Boston Globe "Tech Development: HP joins the campaign against keyboards", The Boston Globe, Monday, June 16, 2008, page B6
02.11.13
HP TouchSmart display, with integrated touchscreen. Comparison made to One Laptop Per Child PC design with no keyboard, instead second screen which can display a keyboard: compare with Refalo, Microsoft Courier.
[BragdonA08a] ( * )Bragdon, Andrew "GestureBar: A Training-Free Approach to Disclosing and Teaching Gestures", Dept. of Comp. Sci. report CS-08-06, Brown University, July 2008
Teach pen-gestures and multi-touch gestures by displaying gestures in a toolbar at the top of the application. Tapping on toolbar tab brings up practice area and explanation of the gesture. Cites to Microsoft Tablet PC Music Composition tool in 1998(??).
[BragdonA08b] ( * )Bragdon, Andrew "GestureBar: Making Gestures Browseable, Discoverable, Learnable and Training-Free", Master's Project, Dept. of Computer Science, Brown University, 2008
Teach pen-gestures and multi-touch gestures by displaying gestures in a toolbar at the top of the application. Tapping on toolbar tab brings up practice area and explanation of the gesture. Cites to Microsoft Tablet PC Music Composition tool in 1998(??).
[BragdonA09a] ( * )Bragdon, Andrew, Zeleznik, Robert; Williamson, Brian; Miller, Timothy; and La Viola, Joseph J. Jr. "GestureBar: Improving the Approachability of Gesture-based Interfaces", Proc. CHI 2009, April 4-9, 2009, Boston
Teach pen-gestures and multi-touch gestures by displaying gestures in a toolbar at the top of the application. Tapping on toolbar tab brings up practice area and explanation of the gesture. Cites to Kurtenbach Learning-while-Doing, Sketch-based user interfaces / Sketch recognition, Lineogrammer, and a simple crib sheet with tool-tips. Gestures must be discoverable/searchable.
[BricklinD09a] ( * )Bricklin, Dan "Bricklin On Technology", Wiley Publishing, 2009

Collection of Essays and historical notes by Dan Bricklin (Slate Corp. / Lotus 123) inventor of spreadsheet software. Chap 8: Hans On: Tablet and Gestural Computing includes essay from bricklin.com "Tablet Computing Old and New" (earlier "Pen Computing Old and New"). Some essays date to 2000.
[Brown09a] ( * )Brown University "Brown University - Microsoft Center for Research on Pen-Centric Computing: What is Pen Computing?", graphics.cs.brown.edu, 2009: fetched 2011
Final web page for Microsoft Center for Research on Pen-Centric
02.11.13
Computing at Brown University: three-year funding for research on applications for Microsoft Tablet PC operating system and tablet hardware: ChemPad, MathPad (mathematical notation) Music Notepad, Math Paper, Lineogrammer. Some work listed (SKETCH) pre-dates Tablet PC, dates to 1999.
[BrownC10a] ( * )Brown, Chris et al "A System LCD with Integrated 3Dimensional Input Device", SID Digest of Technical Papers, 2010, pp. 453-456
Integrated in-cell LCD display and touchscreen, senses in proximity. Optical sensors in pixes detect infrared light reflected from fingertips etc.
[BrownC10b] ( * )Brown, Chris; Kida, Kazutoshi; Yamagishi, Shinji; and Kato, Hiromi "In-Cell Capacitance Touch-Panel with Improved Sensitivity", SID Digest of Technical Papers, 2010, pp. 346-349
In-cell LCD touchscreen, capacitive sensing. Stylus or finger depresses conductive surface, changes capacitance to underlying (integrated into LCD) sensing electrode by changing distance to sensor. Second style, two-electrode sensor, approaching conductor changes coupling between electrodes.
[BrownSF08a] ( * )Brown, Stuart F. "Hand-on computing: Multi-touch screens could improve collaboration without a mouse or keyboard", Scientific American, July 2008, Vol 229 No 1, pp. 64-67
Jeff Han, Perceptive Pixel. Frustrated total internal reflection FTIR. Optical panel is both sensing surface and diffusion screen for rear projection. Also mentions Microsoft Surface, Mitsubishi Diamond Touch, and iPhone.
[BuckleyE09a] ( * )Buckley, Edward; Lacoste, Lilian; and Stindt, Dominik "Rear-View Virtual Image Displays", 2009 SID Vehicles and Photons Conference, 16th Annual Symposium on Vehicle Displays
Holographic 3-D three dimensional projection on windshield of automobile. see Light Blue Optics file.
[BuckleyE09b] ( * )Buckley, Edward; Stindt, Dominik; and Isele, Robert "Novel Human-Machine Interface (HMI) Design Enabled by Holographic Laser Projection", 2009 SID Symposium
pre-distorted projected image shown on curved surface to appear undistorted Holographic 3-D three dimensional projection on windshield of automobile
[BuckleyE10a] ( * )Buckley, Edward "A Projector of a Different Color", IEEE Spectrum, May 2010, p. 45
Holographic (portable) projector projects display and simulated/virtual
02.11.13
keyboard onto table-top, senses touchscreen surface by fan of low-power infrared laster light superimposed on projected image and infrared sensors that detect scattering.
[BuxtonW09a] ( * )Buxton, William "Chapter 14: Gesture Based Interaction / Haptic Input", www.billbuxton.com, dated 18 May, 2009
Book chapter in progress. Gesture recognition used broadly for natual gestures, gestures with the hands in free space.
[BuxtonW10a] ( * )Buxton, William "A chat with Microsoft Principal Researcher Bill Buxton", The Globe and Mail, Toronto, Canada, August 23, 2010 (theglobeandmail.com)
Historical interview with Bill Buxton concerning user interfaces, multi-touch, portable computing. Oscar winner (2003). multi-touch user intefface inveted in 1984. Casio wrist-watch with touch-screen in 1984: unistroke single-digits and arithmetic symbols for caclulator funcs. IBM Simon in 1993, precursor to iPhone. Non-contact (touch sensors) interfaces in 1982. Apple iPhone developers knew of IBM Simon smart touchscreen phone in 1993, described by Bill Buxton as precursor to iPhone. Online at http://www.theglobeandmail.com/news/technology/personaltech/controller-freak/a-chat-with-microsoft-principal-researcher-bill-buxtonpart-i/article1679332/
[BuxtonB10b] ( * )Buxton, William "Invited Paper: A Touching Story: A Personal Perspective on the History of Touch Interfaces Past and Future", Society for Information Display (SID) Symposium Digest of Technical Papers, May 2010, Vol. 41(1) Session 31, pp. 444-448
Touchscreens, like all new technologies go far back: Plato in 1960s, softmachines, Casio PF-8000 Data bank, IBM Simon, Multidimensional (X/Y/Z force, X/Y/Z torque) touchscreen .
[BuxtonWAS10a] ( * )Buxton, William A. S. and SanGiovanni, John "Click-through controller for mobile interaction", United States Patent Application 2010/0275122, October 28, 2010
Transparent/overlay menus and widgets for user interface on a touchscreen: compare with earlier click-through work. Cites to ToolGlass, transparent sheets, also to "Chameleon" system detecting position of handheld touchscreen for viewing virtual scene (compare with Tagliozzi video?)
[CakmakM10a] ( * )Cakmak, Mukerrem; Zhao, Wei; and Yalcin, Baris "Manufacturing of multifunctional electrically conductive-transparentflexible films", United States Patent Application US 2012/0153236 A1,
02.11.13
June 21, 2012

Transparent conductive films for touchscreens, films of conductive fibers. Cites to ITO for transparency and very low resistivity, but is brittle especially on flexible substrates. Compare to Wang/Microtouch.
[CannyJ10a] ( * )Canny, John and Hartmann, Bjoern "Beyond the Cell Phone: Introduction and Historical Perspective", Seminar Notes, COMPSCI 298-50, Univ. Berkeley, California, September 2010
IBM Simon 1994, Osborne I luggable computer 1981, Grid Comppass laptop, PARCTAB hand-held ubiquitous computing unit 1989/1992, Palm PDA with Unistroke Graffiti
[CaoX08a] ( * )Cao, Xiang; Wilson, Andrew D.; Balakrishnan, Ravin; Hinckley, Ken; and Hudson, Scott E. "ShapeTouch: Leveraging Contact Shape on Interactive Surfaces", Proc. TABLETOP: 2008 IEEE Int'l. Workshop on Horizontal Interactive Human Computer Systems
User interface for large touchscreen surfaces (e.g. Microsoft Surface, Rekimoto surface): use area of contact (multi-touch number of fingers, hand area, etc.) to simulate larger or smaller forces on virtual objects. Also simulate pressing, colliding (pushing on virtual edge), friction (require more area contact to slide), flicking and rotate/scale around an anchor point.
[CasioCalculatorWatch10a] ( * )Casio Calculator Watch "Vintage Casio TC-600 Touch Screen Calculator Retro LCD wristwatch", casiocalculatorwatch.net, fetched 2010
Casio wristwatch with unistroke character input on touchscreen, circa 1984
[CechanowiczJ09a] ( * )Cechanowicz, Jared and Gutwin, Carl "What is Pen-Centric Computing?", Proc. INTERACT 2009, pp. 878-891
Addition of pressure sensors, Contrast of WIMP user interfaces with other numerous non-shape-recognition-based gestures: shift-click, double-click, timed gestures hover-help and spring-loaded folders.
[CenterForPenCentric08] ( * )Center for Research on Pen-Centric Computing, (Microsoft) "What is Pen-Centric Computing?", pen.cs.brown.edu
Microsoft funding of graphics research group under Andries van Dam at Brown University. Projects as of 2008 include MathPaper two-dimensional mathematics input and gesture/direct manipulation, Lineogrammer sketch recognition / diagram editing, *Pad SDK ink middleware experimental pencomputing UI kit, ChemPad for teaching chemistry and molecular models, MathPad, Music Notepad with twho-dimensional gesture input, Fluid Inking for gesture editing of electronic ink (compare with Van Raamsdonk?),
02.11.13
ReMarkable Texts digital note-taking. Devices include pen computers (Tablet PCs), PDAs, electronic whiteboards.
[CERNCourier10a] ( * )Stumpe, Bent and Sutton, Christine "The first capacitative touch screens at CERN", The CERN Courier, March 31, 2010
Historical article on capacitive touchscreens invented at CERN in the 1970's as simplified/better-organized user interface UI for complex computer ystem for SPS Super Proton Synchroton. Capacitor sensors etched into a film of copper on a shett of flass, each capacitor constructed to that a nearby flat conductor such as surface of a finger increases capacitance by a significant amount. Traces 80 micrometers wide, 80 micrometer spaceing, insulating lacquer coating on top. First prototype produced in shop at CERN on flexible transparent Mylar sheet. Gives details of construction using ion sputtering, traces were solderable. Phaselocked oscilator, change in capacitance changed phase not frequency, drift compensation by comparison to reference capacitor in same construction.
[ChangD08a] ( * )Change, Darius "Asus takes user interface to the next level", crave.cnet.net, June 5, 2008
Dual-display computer (compare with Refalo, OLPC One Laptop Per Child) with display on one half, display/touchscreen on other half. Also reads gestures by motion using video camera.
[ChaudhriI10] ( * )Chaudhri, Imruan; Ording, Bas; Anzures, Freey Allen; Van Os, Marcel; Lemay, Stephoen O.; Forstall, Scott; and Christie, Greg "Unlocking a Device by Performing Gestures on an Unlock Image", United States Patent 7,657,849, Feb. 2, 2010
Sliding/swipe slide-to-unlock gesture on Apple iPad and iPhone. Also US 8,046,721. Compare with direct manipulation, virtual devices?
[ChenJ10a] ( * )Chen, Jian; Eow, Andy; and Ma, Xiaoxu "Simple Techniques for Three-Dimensional Modeling", United States Patent Application 2010/0319100 A1, December 23, 2010
Structure-through-motion modeling of human shape, 3D model using single camera. Customer puts on patterned garment (with targets, may be irregular), multiple views from webcam, system determines 3D shape by analysis of the images. Compare with D. Holz, 2013, etc.
[ChenZ09a] ( * )Chen, Zhen; Li, Barn-Wan; Wang, Jian; Ma, Wei-Yin "Annotation Management in a Pen-based Computing System", United States Patent 7,555,706, June 30, 2009
pen-computing user interface, annotations can be added to documents.
02.11.13
Annotations can be recognized as gestures: recognizing a date annotation bring up a calendar application. Annotations anchored to context/text of document. Compare with Agulnick and Slate annotations and electronic ink indexing, deferred recognition.
[ChristianDopplerLaboratory10a] ( * )Christian Doppler Laboratory, for Handheld Augmented Reality "History of Mobile Augmented Reality", wordpress.com, fetched November 23, 2010
Timeline of mobile augmented reality and non-mobile augmented reality systems, defined as overlaying computer data on real world. Sutherland head-mounted display with 6-D sensors 1968. Cites Grid Compass 1000 as first clamshell laptop: compare with Data General DG/1? IBM Simon Personal Communicator 1992. Loomis GPS system for visually impaired 1993.
[Cirque09a] ( * )Cirque Technology (owned by ALPS) "Capacitive Touch with Near Field Communication", www.cirque.com
multi-touch multi-finger gestures on Cirque GlidPoint sensor. Additional materials in file: claim Cirque originatedcapacitive touchscreens in 1991
[CITT08] ( * )CITT Center for Instructional Technology and Training, University of Florida "Tablet PC Workshop", www.citt.ufl.edu/training/manuals/TabletPC.pdf, fetched 2008/03/03
Training manual for Tablet PCs, (physical) power button action can be changed
[CoE08] ( * )Co, Elise and Pshenkov, Nikita "Emerging Display Technologies for Organic User Interfaces", Communications of the ACM, June 2008, Vol 51 No 6; pp 45-ff.
Organic user interfaces / tangible user interfaces: E-Ink / electronic ink electrophoretic display technology, electroluminescent displays on clothing fabric.
[CockburnA08a] ( * )Cockburn, Andy; Karlson, Amy; and Bederson, Benjamin B. "A Review of Overview+Detail, Zooming and Focus+Context Interfaces", ACM Computing Surveys, Vol 41 No 1, Article 2, December 2008, pp 2:1..2:31
Review of of user interface systems that show more and less detail, both graphical zoom (original meaning of focus+context, and in Mac XDock) and semantic zoom. Classifies as zooming; overview plus detail; focus plus context; cue-based to highighlight or suppress items selectively. Fisheye zoom (enlargement in graphical context). Mentions pressure/force of touchcreen for zooming (Zliding, etc.).
02.11.13
Later version of 2006 technical report, U. Maryland, same authors
[CohenP08a] ( * )Cohen, Phil; Swindells, Colin; Oviatt, Sharon; and Authur, Alex "A high-performance dual-wizard infrastructure for designing speech, pen, and multimodal interfaces", Proc. ICMI '08, 10th I'tal Conf. on Multimodal Interfaces
Wizard-of-oz (two people) simulation of system reacting to group whiteboard utilizing both voice and real-time electronic ink/pen input streams. Compare with Freestyle at Wang.
[ConwayJ10a] ( * )iPhone Programming: The Big Nerd Ranch Guide "Conway, Joe and Hillegass, Aaron", Big Nerd Ranch Publishing, 2010
Development guide for IOS for iPhone (iPad, iPod) touchscreen devices: Simulator, Objective-C, etc.
[CoolestGadgets08a] ( * )Coolest Gadgets - Apple News "Apple files for 'swipe-gesture' patent application", www.coolest-gadgets.com, Dec. 26, 2008
Patent application publication of Apple filing for 'swipe-gesture': article refers to left, right, up, down gestures across the (simulated) keys of a keypad -- compare with 1980's Japenese calculator with handwriting input on physical keypad?
[CrossEM09a] ( * )Cross, Elisa M.; Moshrefzadeh, Robert S.; Bottari, Frank J.; Cairns, Darran R.; Chernefsky, Anthony F.; Richter, Paul J. "Capacitive touch screen with conductive polymer", United States Patent 7,477,242, January 13, 2009 (Filed 2002)
Conductive polymer for capacitive touch screens: higher resistance than ITO (desirable for for capacitive-sheet touchscreens), and not brittle, so may be used on flexible touchscreens.
[Crunchpad09] ( * )CrunchPad "CrunchPad photos leaked: Arrington builds dream tablet", Jennifer Bergin, blogs.zdnet.com, April 10, 2009
Web-only pen-computing web-tablet with no disk storage. Announced as an "open-source" hardware design, running Ubuntu Linux. File contains additional materials.
[CSAIL08a] ( * )CSAIL "MIT CSAIL: Design Rational", rationale.csail.mit.edu, 2008

List of research reports and publications, mostly relating to sketch recognition
[Cypress08] ( * )Cypress Inc. "TrueTouch touchscreen technology", www.cypress.co, Aug 25. 2008
02.11.13
Multi-touch touchscreen using projected capacitive technology (electrostatic?). Includes comparison chart for touchscreen technologies: Infrared, Surface-Acoustic-Wave (SAW), Surface Capacitance, Resistive
[DeckerS09] ( * )Decker, Susan "Microsoft Wins Reversal of $358 Million Alcatel Award (Update4)", Boomberg News: www.bloomberg.com Sept. 11, 2009
Partial reversal (basis for damages) in Lucent-Microsoft case: only mentions Date-Picker UI, not GO Corporation damages
[DegnerBW08a] ( * )Degner, Brett William; Staton, Kenneth Lawrence; Hotelling, Steve Porter; and Choi, Shin John "Multi-touch Sensor Pattersn and Stackups", United States Patent Application 2009/0273570, November 5, 2009
Capacitive grid / mutual capacitance touchscreen on flexible substrate, to fit to curved surfaces. Comb-like interdigitated pattern between rows and columns, also three layer with intermediate coupling conductors. Mentions running traces on single layer plus vias.
[DeNardiA08a] ( * )De Nardi, Alessandro "GRAFITI: Gesture Recognition mAnagement Framework for Interactive Tablettop interfaces", Master Degree Thesis, Niversita di Pisa, December 2008
Experimental multi-touch system (Rear Diffusion optical detection: rear DI) incorporating Z-order gestures by tunneling and bubbling (for overlapping objects). Refers to larger target area as "iceberg tips" of object. Gestures are simple, single-stroke, and few (touch, drag, etc. except for double-tap) to avoid recognition ambiguity. Discusses dynamic gestures (e.g. pinch/zoom) which are detected and interpreted progressively, and statis gestures (e.g. tap) which have no interpretation phase File contains additional material on open-source code. Not to be confused with Graffiti unistroke handwriting. Contains review of multi-touch hardware and software systems, some reference to Tablet PC but none to handwriting input. Multi-touch Vista, Mutitouch.Framework on MacOS/iPad, Sparsh-UI. Gestures recognized by both spatial (shape?) and temporal (motion/movement) aspects of fingers moving over surface (compare with Nokia in-air optical gestures?) Tangible User Interface (TUI)/ Graspable User Interface; lasso/lazo gestures. Defines gesture as including motion. Cooperative gesturing as distinct from multi-user gesture systems for collaboration. Hovering gesture is press-and-hold, not in-air hover: uses two-hand hover on two objects to link them. iPhone generally determines target of gesture on touch-down / hitTest:withEvent /
02.11.13
gesturestart, not finger-lift/mouse-up/gestureend
[DenoueL09a] ( * )Denoue, Laurent and Foote, Jonathan T. "Forcefeedback stylus and applications to freeform ink", United States Patent 7,508,382, March 24, 2009
Stylus with force feedback: magnetic fields acting on metal ball in tip.
[DerStandard10a] ( * )Der Standard "Toshiba bringt Dual-Screen-Tablet Libretto W100", Der Standard, derstandard.at, June 21, 2010
Dual-screen multitouch portablet computer with virtual keyboard, compare with Microsoft Courier and with Refalo, and with proposed design by Negroponte's project
[DiamondTouch08a]
( * )DiamondTouch,
Inc. "DiamondTouch", (various)
File on Diamond Touch, spin-off company for DiamondTouch multi-touch digitizer table developed at Mitsubishi, comparable to Microsoft Surface
[DignanL10a] ( * )Dignan, Larry "Apple's HTC patent suit: Can it derail Google's Android devices?", zdnet.com, March 2, 2010
Apple iPhone patents asserted against HTC/Android and Nokia
[DignanL10b] ( * )Dignan, Larry "Apple's HTC patent suit: Can it derail Google's Android devices?", zdnet.com, May 7, 2010
Apple iPhone patents asserted against HTC/Android and Nokia: antenna design, geographical positioning
[DignanL10c] ( * )Dignan, Larry "Nokia and Microsoft's Windows Phone 7: It could work, but why stop there?", zdnet.com, December 20, 2010
Nokia sell Windows Hpone 7 instead of Symbian.
[EchtlerF10a] ( * )Echtler, Florian; Klinker, Gudrun; and Butz, Andreas "Features, Regions, Gestures: Components of a Generic Gesture Recognition Engine", SIGCHI Workshop: Engineering Patterns for Multitouch Interfaces, June 20, 2010, Berlin, Germany
Recognize multi-touch gestures based on shared features: move/tap/rotate/spin gestures recognized on features motion/blobcount/rotation/scale. Focuses more on direct manipulation gestures. Describes event bubbling through parent windows for gestures.
[EchtlerF10b] ( * )Echtler, Florian; Pototsch, Thomas; and Klinker, Gudrun "An LED-based Multitouch Sensor for LCD Screans", Proc. ACM TEI 2010, Janaruy 2010, Cambridge, Mass, pp. 227-23Multitouch optical touchscreen sensor: infrared LEDs in pairs behind an LCD display -- LCD displays tranparent to infrared. One LED used as infrared emitter, other used as infrared detector, for infrared light reflected
02.11.13
from objects touching the screen. Has enough proximity sensing to detect hover. Compare Fig. 7 (image of hand) with Rekimoto 2002 paper (electrostatic/capacitive).
[Economist08a] ( * )Economist Magazine "Touching the Future: Computing: Touch screens are becoming an increasingly popular way to control mobile phone and other devices", The Economist Magazine, September 4, 2008
Article on touch screens, and multi-touch gestures. Cites Elo TouchSystems and Sam Hurst as first touchscreen (resistive tablet) in 1971 (missed earlier references). Quotes Bill Buxton on haptic design. Jeff Han of Perceptive Pixel on pressure-sensitive gestures, push harder to move something "under" another window instead of double-click operation.
[E-Ink08a] ( * )E-Ink Corporation "Wacom and E-Ink Partnership Delivers Pen Input to Electronic Paper Displays", Press Release, Wacom Technology, May 19, 2008
Touchscreen / integrated display and digitizer tablet from Wacom and EInk.
[eInstruction09] ( * )eInstruction.com "eInstruction Interwrite DualBoard", eInstruction.com product literature

Large whiteboard digitizer using projector, multiple small untethered electromagnetic tablets for other participants in a group: see KayeS. Interwrite DualBoard for Windows and Mac, Interwrite Mobi small wireless digitizer. See also Qomo HitVision RF wireless tablets.
[ElanMicroelectronics10] ( * )Elan Microelectronic Corporation "Elan Microelectronics Corporation", Elan Microelectronics, product information
Electrostatic digitizer / capacitive touchpad vendor
[ElektronikIndustrie10a] ( * )Elektronik Industrie "Der etwas andere touch", Elektronik Industrie, 10/22/2006, pp. 22-23
in German: overview article on capacitive touchscreens using ITO Indium Tin Oxide, based on Quantum Research Group (commercial company)
[EliasJG10a] ( * )Elias, John Greer; Westerman, Wayne Carl; and Haggerty, Myra Mary "Multi-touch Gesture Dictionary", United Statest Patent 7,840,912, November 23, 2010
Extension of chorded keyboard (on multi-touch touchpad) to defining chording input as user-defined chord (multi-finger) gestures. Numerous citations to Fingerworks.
02.11.13
[emsps.com10a] ( * )emsps.com "Old, Used and Out-of-Print SideKick(R) Software", www.emsps.com/olktools/borsk.htm

Borland SideKick with phone dialer, PIM: Versionn 1.0 through 20.0, 97 through 99, for DOS, Windows and MAC
[EMSSoftware08] ( * )EMS Software "Lotus 1-2-3 Version Information", www.oldsoftwareinfo.com

Version information for Lotus 123 versions: www.oldsoftwareinfo.com sells and collects old versions of software in original form. Lotus 123 for DOS only through 2.2X 1991, first Windows version 1.0 for Windows 9991, first MacIntosh version 1.0 1991, OS/2 version 2.0X, 1993.
[EoffBD09a] ( * )Eoff, Brian David and Hammond, Tracy "Who Dotted That `i'? : Context Free User Differentiation through Pressure and Tilt Pen Data", Proc. Graphics Interface Conf, May 2009, Kelowna B.C. Canada
In multi-touch / multi-pen / multi-user desktop with tablet or touch input, identify user inputs by physical characteristics of writing, rather than constraining users to keep track of which pen to use: pen tilt, pressure (force), and writing speed. tablet-PC lower case, not Tablet PC. Hardware was Wacom Cintiq tablet with tilt and tip force sensing.
[EsentherA08a] ( * )Esenther, Alan "Multi-Touch Gestures for Controlling Synchronized Map Views", Slide presentation, 2008 ESRI International User Conference, ESRI Incorporated, New York
Gestures: one finger to select, flick, mouse-operations; two fingers to resize/move/rotate object; five fingers to pan enire map; fist to scroll or tilt. Commerical multi-touch touchscreen tabletops PerceptivePixel, Microsoft surface, TouchTable, DiamondTouch CircleTwelve. For mouse gestures, multiple users handled first-to-touch wins. Middle finger tap for middle mouse button. "Precision-hover" when finger obscures pixel to be selected.
[EsslG09a] ( * )Essle, Georg; rohs, Michael; Kratz, Sven "Squeezing the Sandwich: A Mobile Pressure-Sensitive Two-sided Multi-touch Prototype", Proc. UIST '09, October 2009, Victoria BC, Canada
Two-sided (front/back) touchscreen/touchpad interfaces. Prototype built by taping two iPhones together. Citations to Chen, Hybridtouch, Lucid Touch, and Shape touch.
[FlemingN10a] ( * )Fleming, Nic "Magnet magic puts phone control in the air", New Scientis, 23 February 2010
Hand-gesture input using hand-held magnet and magnetic compass sensor
02.11.13
in an iPhone or portable device
[FihnM10a] ( * )Fihn, Mark "Touch Panel: Will Apple enable Microsoft's vision for the Tablet PC?", www.veritasetvisus.com, December 2010
Historical review (revised from 2002 and 2008) of Tablet PC and Apple iPad. Tablet PC announced August 1999 by Bill Gates, Prototype demonstrated June 2000. Comparison with success of Apple Newton concept in the form of smart phones. Cites to IBM TransNote and Sony Slimtop Pen Tablet.
[FingerSystem10a] ( * )Finger System USA "i-Pen Mouse product information", www.fingersystemusa.com, fetched 2010
Optical mouse in a pen-shapped barrel. Newer model includes audio recording: compare with LiveScribe and Plawa.
[FoleyMJ10a] ( * )Foley, Mary Jo "Microsoft's RearType: Physical keys to the iPad, Kindle and Tablet kingdoms?", www.zdnet.com, August 9, 2010
UI alternative to soft/simulated keyboard on touch-screen/pen computer: physical keys for separate hands on back of tablet-type computer.
[FrankeK09a] ( * )Franke, Katrin "Capturing Reliable Data for Computerbased Forensic Handwriting Analysis II: Pen-position Activations", 2009 10th International Conference on Document Analysis and Recognition
Pointing out unreliability of data from (electromagnetic) digitizer tablets, even though really only talks about stylus tilt error. One of few papers from handwriting motion analysis that shows insights into some of the problems with digitizer reliability and bad behaviors. Describes morphing of on-line and off-line traces/markings -- compare with Tappert elastic matching?
[Fraunhofer08] ( * )Fraunhofer Institut "Computer steuern per Fingerzeig / Gesture-driven computers", Fraunhofer Institute Press Release for CeBIT 2008 exhibition, February 2008
(in German) GestureID hand gestures, demonstrated at CeBIT exhibition for iPoint Presenter. Mentioned as replacement for touch-screen digitizers at infoterminals (kiosks). Uses optical pattern recognition (machine vision)
[FriedI08a] ( * )Fried, Ina "Microsoft to add multitouch interface to Windows 7", news.cnet.com, May 27, 2008
Windows 7 Vista will include multitouch, compares with Apple iPod user interface. Shown by Steve Ballmer and Bill Gates at trade show. Gestures include pinching (zoom) and two-finger rotating.
[FriedI08b]
( * )Fried,
Ina "Microsoft hopes 'Milan' table PC has magic

19/74
users.erols.com/rwservices/pens/biblio10.html
02.11.13
touch", news.cnet.com, May 29, 2008

Milan code name for "surface computer", Microsoft Surface tabletop PC, using multi-touch input.
[FriedI09a] ( * )Fried, Ina "Touch in Windows 7: Just for show?", news.cnet.com, July 1, 2009
Touch/multi-touch interface in Windows 7 just for show, because touchscreen digitizer hardware adds $100 to price of PC. N-Trig dual-mode digitizer (electrostatic+electromagnetic?) has funding from Microsoft
[Fujitsu10a] ( * )Fujitsu America, Inc. "Lifebook Tablet PC. Stay in Touch", Fujitsu America, Inc.
Product information on Lifebook T900 Tablet PC, convertible with multitouch separate display
[Fujitsu10b] ( * )Fujitsu America, Inc. "CEATEC Fujitsu's dual-screen phone prototype: Video demonstration", Fujitsu
Video demonstration at CEATEC 2010 of prototype Fujitsu dualtouchscreen phone, screens can be oriented end-to-end or fold out side-toside (special hinge): compare with Reefalo?
[Fujitsu10c] ( * )Fujitsu America, Inc. "Fujitsu Shows Off Clamshell Handset With 2 Touch Panels", Fujitsu
Fujitsu dual-touchscreen phone, screens can be oriented end-to-end or fold out side-to-side (special hinge). May be combined to be one display, or separate apps (e.g. one keyboard, one application display) compare with Reefalo?
[Ganapati10] ( * )Ganapati, Priya "3-D Tabletop Display Gets Rid of the Glasses", Wired.com, March 25, 2010
Simulated 3-D display: each side of a cube has an LCD display showing a side/top view of something simulated to be inside
[GestureTek08a] ( * )GestureTek "GestPoint Gesture Recognition for Presentation Systems", www.gesturetek.com

Hand-gesture recognition using video input and motion tracking: commercial product. Described as touch-free gesture input utilizing computer vision and body tracking software to convert simple hand movements into direct mouse control.
[Gizmodo09a] ( * )Gizmodo.com "Que: Plastic Logic's Capacitive-Touch Ebook Reader", Gizmodo.com, November 2009: reporter Wilson Rothman
Wacom technology (?) capacitive/electrostatic digitizer in an e-book reader,
02.11.13
but says being marketed as a "document reader", not a "book reader". See also file on "Plastic Logic".
[Gizmodo10a] ( * )Gizmodo.com "First Hands On: Touch Book is PartNetbook, Part-Tablet", Gizmodo.com, Arpil 13, 2010
Touch Book web tablet / tablet computer: Linux, circular-icon gesture UI (pie gestures?)
[GoertzM09a] ( * )Goertz, Magnus; Eriksson, Thomas; and Shain, Joseph "Light-based Touch Screen", United States Patent Application 2009/0189878, July 30, 2009
Optical touchscreen using infra-red LED diodes and light detectors. Variations include having LEDs at four corners projecting light in a full plane to the two opposite sides of the LED, and all LEDs on a side being illuminated at once and the detectors on the opposite side read in paralle. States can detect hard and soft touches by detecting position while still above surface and determining vertical height (and velocity) from how much light is reflected from the object/finger above the surface. Prior art discussion mentions resistive and capacitive touchscreen etc. but not optical.
[GoertzM10a] ( * )Goertz, Magnus; Eriksson, Thomas; and Shain, Joseph "Optical Touch Systems using Reflected Light", United States Patent Application 2010/0238138, September 23, 2010
Optical touchscreen using infra-red LED diodes and light detectors. Various geometries for reflectors, such as having LEDs at or below surface of device and low-angled mirror on the full dide to direct the light across/over the touchscreen surface; LEDs projecting a plane or lines of light to detectors diagonally (rather than directly across); angled upward from points within touchscreen at an angle and detectors also at an angle to detect light reflected diagonally downward from finger or object. One figure showing light propogated across and within touchscreen glass by internal reflection. Assigned to NeoNode: see NeoNode file.
[GoldsteinN10a] ( * )Goldstein, Neal and Bove, Tony "iPad Application Development for Dummies", Wiley Publishing, 2010
Programming tutorial for the iPad/iPhone/iPod.
[Google08a] ( * )Google Code "iphone-haptics", code.google.com/p0/iphone-haptics, 2008

VibeTonz and vibrotactile haptic feedback project for Apple iPhone, Stephen Brewster Tacton project at U. Glasgow
02.11.13
[Google08b] ( * )Unknown "google chrome", drewp.quickwitretort.com/2008/09/22

Search hits highlighted in Google Chrome scrollbar UI/user-interface: references to work by David McClosy, and Raizlabs ABC and Heatmap
[GonsalvesA09] ( * )Gonsalves, Antone "Barnes and Nobel Sued over EReader", Information Week, November 3, 2009
E-Reader maker Spring Design (kindle-like product) sues Barnes and Nobel over using features of Alex e-reader from confidential product technical discussions
[Greene08a] ( * )Greene, Kate "What's Next for Computer Interfaces? Touch tricks for small and large displays could be the next big thing", Technology Review, December 11, 2008
Microsoft research Patrick Baudisch adding touch digitizer interaction to back of devices so that display is not obscured by finger or stylus
[Greene09a] ( * )Greene, Kate "A Better, Cheaper Multitouch Interface: A new pressure-sensistive pad could improve large and small touch schreens", Technology Review, March 30, 2009
Three-dimensional pressure sensitive touch digitizer: IMPAD Inexpensive Multi-touch Pressure Acquisition Device, using force sensitive resistor (IFSR) ink, Ilya Rosenberg, www.touchco.com
[Greene09b] ( * )Greene, Kate "Touching the Future: Next steps for touch screens", Technology Review, February, 2009 p. 13
Patrick Baudisch of Microsoft: touch pad on back of display, so that small screen remains unobstructed. Also mentions Perceptive Pixel
[Greene09c] ( * )Greene, Kate "Muscle-Bound Computer Interface: Forearm electrodes could enable new forms of hands-free computer interaction", Technology Review, October 28, 2009
electromyography sensors in arm used to recognize hand/arm gestures, such as Air Guitar, etc. Recognition by neural network.
[GreenemeierL10a] ( * )Greenemeier, Larry "Magic Fingers: Digging into Multi-touch Technology with Both Hands: Perceptive Pixel chief scientist Jefferson Han has big plans for changing how people use computers", Scientific American, March 5, 2010
Interview with Jeff Han on Multitouch technology by perceptive pixel: states that large screen manipulation is the interesting user-interface area, criticizes capacitive sensing multi-touch input as not scalable to large surfaces or use with gloves compared to frustrated internal reflection
02.11.13
[GroskyWI08a] ( * )Grosky, William I.; Westermann, Utz; Zeleznik, Robert; van Dam, Andries; Li, Chuanjun; Tenneson, Dana; Maloney, Christopher; and LaViola, Joseph J. jr. "Applications and Issues in PenCentric Computing", IEEE MultiMedia, October 2008, pp. 14-21
WIMP User interfaces predominate, but some applications better with tablet/pen computers: 2D mathematical notation MathPad), chemical structures (ChemPad), Diagraming/sketch input (Lineogrammer). Mentions Wang Freestyle, Pen Windows, GO PenPoint, Anoto photo pen, others.
[GunnHD10a] ( * )Gunn, Harold David and Chapman, John "Data entry for personal computing devices", United States Patent 7,681,124, March 16, 2010
Pop-up movable virtual keyboard in the form of a marking menu, using predictive work list and pause and lift (press-and-hold) to re-invoke search for text completion.
[HamppA08] ( * )Hampp, Andrew "Airports, Malls Get More 'Gesture' Ads: Interactive Video-Out-of-Home Ads let Consumers Play", Advertising Age, May 8, 2008
Press article on Reactrix, Monster Media, and GestureTek on gesture input on interactive advertizing: foot-pressture touch pad with foot input
[Hanselman08] ( * )Hanselman, ?? "Introducing RockScroll", Microsoft employee blog posting: www.hanselman.com/blog, October 2008
Scroll bar displays highlighted/small images of text/document to be scrolled: add-on to Microsoft Visual Studio by Rocky Down's
[Hardie-BickAR08a] ( * )Hardie-Bick, Anthony Richard "Touch Pad", United States Patent 7,411,581, August 12, 2008
Based on 2002 GB filing: Acoustic touchscreen using frequency profiles characteristic of different location (Lamb waves: higher frequencies disperse faster) rather than acoustic delay. Identifies touch events (start of touch), not contact. Requires profiling of construction first, to produce a table?
[HarrisonC08a] ( * )Harrison, Chris and Hudson, Scott E. "Pseudo-3D video Conferencing with a Generic Webcam", Proc. 10th IEEE Int'l Symposium on Multimedia, Berkeley, CA, Dec 15-17, 2008. pp. 236-241
Simulated 3-D video using flat display: perform trapezoidal scaling of image as viewer moves left and right (and up and down?) as detected by Webcam camera.
[HarrisonC08b]
( * )Harrison,
Chris and Hudson, Scott E. "Scratch Input:

23/74
02.11.13
Creating Large, Inexpensive, Unpowered and Mobile Finger Input Surfaces", Proc. UIST 08, October 19-22, 2008, Monterey, CA, pp 205208
Gesture recognition not using a digitizer, but the acoustic sound of scratching when a finger/fingernail moves on a surface. Cannot detect sptial location, but recognizes multi-part (multi-stroke) gestures such as X, O-with-slash, lowercase-I-with-dot, Y, double tap, single tap. Cites to earlier work on passive acoustic sensing (knocks) and frustrated-internalreflection digitizer tablets
[HarrisonC09a] ( * )Harrison, Chris and Hudson, Scott E. "Abracadabra: Wireless, High-Precision, and Unpowered Finger Input for Very Small Mobile Devices", UIST '09, October 4-7, 20009, Victoria BC, Canada
Proximity-sensing electromagnetic digitizer for finger input on small display, using small magnet mounted on fingertip. Compare with ferrite-rod digitizer technologies? Can detect clicking "below" a virtual surface by reversal of magnetic field, can detect distance/proximity by strength of magnetic field sensed. Describes polar gestures (circular motion around a very small display)
[HarrisonC10a] ( * )Harrison, Chris; Tan, Desney; and Morris, Dan "Skinput: Appropriating the Body as an Input Surface", CHI 2010, April 10-15, 2010, Atlanta, Georgia
Surface (?) acoustic wave design of touch input device comprising an arm band and propagating acoustic signals through human skin: a wearable SAW touch input digitizer. Also refers to distinctive sounds made when tapping on parts of body: arm, palm fingers and thumb. File contains additional materials
[HarrisonC10b] ( * )Harrison, Chris; Tan, Desney; and Morris, Dan "Search by Sketch", www.chrisharrison.net
Project description: Compare with earlier work on sketch recognition: use uses paint interface (not draw/sketch) to draw color patterns, system matches by dominant color and rough orientiation, providing results in real time while user is "sketching".
[HarrisonC10c] ( * )Harrison, Chris and Hudson, Scott E. "Minput: Enabling Interaction on Small Mobile Devices with High-Precision, LowCost, Multipoint Optical Tracking", CHI 2010, April 10-15, 2010, Atlanta GA
Optical-mouse type input built into portable device (basically on back of display). Thus display is not occuluded by finger or touching, no digitizer
02.11.13
on display. Gesture recognition for flick, twist, curly-cue gesture. Can also scan a larger surface, thus can do scroll-bar gestures.
[HarrisonP08a] ( * )Harrison, Phil "Hand-held Device with Touchscreen and Digital Tactile Pixels", United States Patent Application 2008/0150911, June 26, 2008
Haptic/tactile vibration pixels around edges of touchscreen PDA computer
[HartmannC08a] ( * )Hartmann, Christoph "Microsoft Visual Programming Language: End-User Perspektive", Mongraph, www.acidum.de, Aug 11, 2008 (in German)
Microsoft Robotics Studio 2006, Microsoft Visual Programming Language: Review of visual programming languages and environments: cites to Sketchpad 1963, GRAIL 1967, AMBIT/G 1968, ThingLab and other earliy systems.
[HaywardP08a] ( * )Hayward, Vincent; Alarcon, Ramon; Rosenberg, Louis B. "Haptic Pads for use with User-Interface Devices", United States Patent 7,336,266, February 26, 2008
Add a haptic output actuator to an existing input devices. Generic to type of input device, and to type of haptic actuator.
[Helet09] ( * )Helet, Miguel "For the Blind, Technology Does What a Guide Dog Can't", The New York Times, January 4, 2009
T.V. Raman, visually impaired researcher at Google, accessibility technology for low-vision on touchscreen cell phones (e.g. Apple IPhone) using Gestures
[HembrowD10a] ( * )Hembrow, David "EO Personal Communicators EO440 / EO880 running GO PenPoint", www.hembrow.eu, fetched 2010
Personal notes on EO/PenPoint in the UK, including examples of documentation and product.
[HewlettPackard08] ( * )Hewlett-Packard "HP Pavilion tx2z series", www.shopping.hp.com/series/category/notebooks/tx2z_series

TouchSmart 2x2z ulgraportable Tablet PC: multi-touch input, implies support for multi-touch gestures on laptop running Windows Vista
[HillisWD10a] ( * )Hillis, W. Daniel and Ferren, Bran "Touch driven method and apparatus to integrate and display multiple image layers forming alternate depictions of same subject matter", United States Patent 7,724,242, May 25, 2010
Tabletop computer system: slide/zoom/pinch gestures include inertia, may show additional areas of an image or of a second image when moved.
02.11.13
Long list of references: See also TouchTable (assignee), appliedminds.com (IP shop). Railing around table to keep users from resting hand on tabletop touchscreen.
[HinckleyK09a] ( * )Hinckley, Ken; Dixon, Morgan; Sarin; Raman; Guimbretiere, Francois; and Balakrishnan, Ravin "Codex: A Dual Screen Tablet Computer", Proc CHI 2009, April 4-9, 2009, Boston, MA
Dual-screen dual-display/dual-touchscreen tablet, 4x6 inch. Compare with Courier and Refalo. Software based on InkSeine note-taking with "floating tool ring" (marking-menu?). Multiple references to other current dual screen computers. Taxonomy of dual-screen "postures": landscape/portrit, book/lecturn/laptop, corner-to-corner/face-to-face, battleship (opposite directions). Dual displays can be detached. Collaborative use. Dual-display use includes webpage next to notebook page.
[HinckleyK10a] ( * )Hinckley, Ken; Pahud, Michel; and Buxton, Bill "Direct Display Interaction via Simultaneous Pen + Multi-Touch Input", Society for Information Display (SID) Symposium Digest of technical Papers, May 2010, Vol 41(1), Session 38, pp. 537-540
Using pen and touch gestures simultaneously, users perform different actions with the two hands -- dominant hand holds pen/stylus for writing. Cites to earlier work on two-handed/multi-touch user interfaces.
[HirschM09a] ( * )Hirsch, Matthew; Lanman, Douglass; Holtzman, Henry; and Raskar, Ramesh "BiDi Screen: A Thin, Depth-Sensing LCD for 3D Interaction using Light Fields", ACM Trans of Graphics, Vol 28 No 5, December 2009
Bidirectional LCD sensor/display: LCD display with 3D optical touchscreen and proximity (3D) sensing using synthetic apertures onto optical sensors behind each LCD pixel: no change to LCD. Permits 3D user input manipulation, proximity changes zoom.
[HolmanD08] ( * )Holman, David and Vertegaal, Roel "Organic User Interfaces: Designing Computers in Any Way, Shape, Or Form. Displays on real-world objects allow more realistic user interfaces", Communications of the ACM, June 2008, Vol 51 No 6; pp 48-ff.
Organic user interfaces / tangible user interfaces: deformable user-input devices, such as foldable paper which is also a display, and responds to folding. Shows multiple-touch, multiple-user actions on a globe model, cites to Wellner.
[HookJ09a] ( * )Hook, Jonathan; Taylor, Stuart; Butler, Alex; Villar, Nicolas; and Izadi, Shahram "A Reconfigurable Ferromagnetic Input
02.11.13
Device", Proc. UIST '09, October 4-7, 2009, Victoria, BC, Canada, pp. 51=54
X/Y grid matrix of electromagnetic sensing coils used to detect ferrous / ferromagnetic objects: objects need not be tagged, if ferrous. Placing flat ferrofluid bladder on array is touch/force/pressure touchpad surface, interpolated to get higher location resolution. One use is sensing of actual objects: e.g. physical slider with ferrous handle.
[HOPL08] ( * )HOPL History of Programing Languages "Maths input language", hopl.murdoch.edu.au

History of two-dimensional mathemathics input languages as programming languages: essentially a short bibliography of papers by Mort. I Bernstein, quotes as saying that real-time / online handwriting recognition is easier than static / OCR character recognition.
[HorneckerE09a] ( * )Hornecker, Eva "Tangible interaction", InteractionDesign.org: http://www.interactiondesign.org/encyclopedia/tangible_interaction.html, 2009

Essay defining tangible interaction as distinct from direct manipulation in user interfaces: physical objects interact with users under computer control: numerous references to background of the art. See also augmented reality.
[HorowitzBT08a] ( * )Horowitz, Brian T. "Synaptics touch pad tech gains momentum", blog.internetnews.com/bhorowitz, June 26, 2008
Scrolling momentum / dynamic scrolling by Synaptics in a touchpad digitizer, compared to trackball that keeps spining after initial push
[HotellingSP09a] ( * )Hotelling, Steve Porter; Zhong, John Z. "Singlelayer touch-sensitive display", United States Patent Application 2009/0091551, April 9, 2009
Single-layer multi-touch/Multipoint mutual capacitive touchscreen (not really a display). Compare with Cypress?
[HotellingSP09b] ( * )Hotelling, Steven P. "Method and Apparatus to Reject Accidental Contact on Touchpad", United States Patent 7,561,146, July 14, 2009
proximity-sensing hand/palm rest near keyboard: if detect user's palm/hand near keyboard, filter out touch input (palm rejection).
[HotellingS10a] ( * )Hotelling, Steve; Strickon, Joshua A.; and Huppi, Brian Q. "Multipoint Touchscreen", United States Patent 7,663,607, Feberuary 16, 2010
02.11.13
Multi-touch/Multipoint mutual capacitive touchscreen: compare to Fingerworks and Rekimoto?
[HotellingS10b] ( * )Hotelling, Steve; Ligtenberg, Chris; Kerr, Duncan; Andre, Bartley K.; Strickon, Joshua A.; Huppi, Brian Q.; Chaudhri, Imran; Christie, Greg; and Ording, Bas "Wide Touchpad on a Portable Computer ", United States Patent 7,834,855, November 16, 2010
Touchpad the full width of a laptop computer, instead of just a touchpad in the middle. Allows user to move hand less away (horizontally) from keyboard position to use touchpad. Palm discrimination by sensing fingers over keyboard, ignore touch input on touchpad (using separate proximity sensor, or visual sensor above keyboard on top edge of display screen).
[HP08a] ( * )Hewlett-Packard "HP TouchSmart IQ506/IQ504 PC", (various)

File of product information on HP TouchSmart PC, Windows PC with integrated multitouch touchscreen. Used for kiosk applications.
[HuppiB09a] ( * )Huppi, Brian; Fadell; Anthony M.; Barrentine, Derek; and Freeman, Daniel "Automated Response to and Sensing of User Activity in Portable Devices", United States Patent 7,633,076
Motion and/or position sensor in portable cell phone, PDA or hand-held unit to detect user activity: motion / orientation sensor on handheld tablet device? iPhone/iPad
[Immersion08] ( * )Immersion Corporation "MicroScribe Systems: Solutions fo Inspection, Reverse-engineering, and 3D Digitizing", www.immersion.com
Mechanical digitizers using multiple-link mechanical arms, articulated-arm digitizers and portable CMMs. Intended for three-dimensionsal / 3D digitizing of engineering objects. Applications also include medical and surgical simulators : digitizers with haptic feedback under the product name CyberForce. Several citations to studies of touchscreens with and without tactile/haptic feedback, and VibeTonz auditory/haptic components for hand-held devices (cell phones, PDAs, etc.)
[Immersion10b] ( * )Immersion Corporation "The Value of Haptics: A summary of published findings on the value of haptic feedback in humancomputer interaction", Immersion Corporation, San Jose, California, 2010
Haptic: Tactile Feedback, Multi-modal feedback, non-visual interaction. General explanation of haptic terms.
02.11.13
[InformationDisplay10a] ( * )SID Society for Information Display "The Best of Times For Touch: Touch Technology Issue", SID Information display, www.informationdisplay.org, March 2010, Vol 26 No 3
SID special issue on touch technology (rather than displays), especially multi-touch digitizers. Compare with 1990's article in Information Display by Ward/Tappert? Advertizement: IRTOUCH multi-touch is ready for Windows 7 Editorial: The Limitless Horizon for Touch Article: LCD In-Cell Touch Article: Projected-Capacitive Touch Technology Article: The State of the Touch-Screen Market in 2010 Article: Touch Screens and Touch Surfaces are Enriched by Haptic ForceFeedback: intertial actuation, piezo actuation, (electrostatic) surface actuation, lateral actuation, (constracting) electro-active polymer actuation, bending wave, capacitive electrosensor interface (CEI) in nerve endings Journal of the SID Article: Beneath the Surface (Microsoft Surface) Journal of the SID Article: Taking Touch to New Frontiers: Why It Makes Sense and How to Make It Happen News: FlatFrog Laboratories optics-based multi-touch kits; touchco flexible touchscreens
[IOGEAR08a]
( * )IOGEAR
"IOGEAR Digital Scribe", iogear.com
Acoustic/sonic digitizer, single acoustic receiver that mounts on corner or top of paper (or other surface) and transmitter stylus/pen with optional ink cartridge. GPEN100C, Applications include note taking (Microsoft OneNote, IRISnotes, etc.) and handwriting recognition (MyScript). Revice may also be used as stylus or in mouse-input mode with side button on stylue barrel. File contains additional references
[IOGEAR10a] iogear.com
( * )IOGEAR
"IRISPen executve 6 User's guide",
hand-held optical scanner, includes OCR software for text and for handwriting recogition (static/off-line character recogition), bar-code recognition. IRISPen translator 6 for translating text in other languages, including Chinese. Includes speech synthesis for recognized text -- useful as accessibility technology? File contains additional references. See also IRIS file.
[IRIS10a]
( * )I.R.I.S.
"Readiris 12 Pro", Irislink.com, fetched 2010
OCR software for IRISpen and other scanner devices. IRISnotes software for IOGEAR acoustic stylus digitizer tablet: compared with products requiring special paper (Anoto) and optical digitizer. See also IOGEAR file.
02.11.13
[Independent09a] ( * )The Independent, United Kingdom "Why touch screens push our buttons", The Independent, 9 September 2009
Mostly interview with Chris Harrison and Bill Buxton regarding multi-touch input and touchscreens: mentions Casio touch-screen AT-550 wristwatch in 1980, Lemur touch-surface music controller in 2003 (see reference) quotes Bill Buxton on touchscreens being unusable by blind/visually impaired (compare with iPhone VoiceOver?) Chris Harrison latex touchsurface covering.
[iPad10]
( * )iPad
"iPad file information", Misc
Miscellaneous iPad information
[IraniP10a] ( * )Irani, Pourang; Shi, Kang; Cechanowicz, Jare; and Subramian, Sriram "Pressure Agumented Mouse", United States Published Patent Application 20100127983, May 27, 2010
Mouse with additional pressure sensors: references contrast with WIMP interfaces
[iRexTechnologies09] ( * )iRex Technologies BV "iRex Technologies Turns the Page on eReaders with new 8.1-inch Consumer Device", iRex Technologies BV, Press Release Sep. 23, 2009
iRex Technologies e-book reader: marketed with additional applications (compare with PenPoint from GO): uses Wacom capacitive/electrostatic touch digitizer tablet component. Additional materials in file.
[IshiiH08a] ( * )Ishii, Hiroshi "The Tangible User Interface and Its Evolution", CACM, June 2008, Vol 51 No 6, pp. 32-36
Special issue on organic/graspable/haptic/tangible user interfaces. Deformable/rollable input devices, such as recognizing shadows of physical stick figures or clay models.
[IzadiS08a] ( * )Izadi, Shahram; Hodges, Steve; Taylor, Stuart; Rosdenfeld, Dan; Willar, Nicolas; Butler, Alex; and Westhues, Jonathan "Going Beyond the Display: A Surface Technology with an Electronically Switchable Diffuser", Proc. UIST '08, October 19-22, 2008, Monterey, California pp. 169-278
SecondLight: Combined two-image display and multi-touch sensor: surface has cells (like LCD) electronically switchable between diffusing and transparent state: in transparent state, image from display behind is visible, and an optical camera behind the display can see objects above the surface. In diffusing state, rear display not visible, but reflects second image projected from above. At the same time, can sense touching fingers
02.11.13
on surface from reflected light by FTIR frustrated total internal reflection. Mentions measuring area of contact of fingertip as indirect measure of pressure/force, and major and minor axis of oval to determine rotational orientation/angle of finger tip.
[IzadiS09a] ( * )Izadi, Shahram; Hodges, Steve; Butler, Alex; West, Darren; Rrustemi, Alban; Molloy, Mike; and Buxton, William "ThinSight: a Thing Form-factor Interactive Surface Technology", CACM, December 20009 Vol 52 NO 12, pp. 90..99
Version of 2007 and 2008 papers: Multi-touch optical touchscreen: mount array of infra-red transmitters and receivers (coarse) behind and LCD, detect reflection of infra-red reflective fingers and objects through LCD. Bicubic interpolation to interpolate to higher accuracy for "center" of a finger touchpoint. Cites to Rekimoto.
[Janam08a] ( * )Janam Technologgies LLC "Janam XP30 User Guide", Janam Technologies LLC, 2008
Janam XP30 touchscreen/digitizer smart phone: Uses Graffiti 2 gestures: backspace, shift, menu (diagonal) Shortcut (bottom curlique, cut (pig-tail), passted, copy (down-left), undo
[JarrettRJ09a] ( * )Jarrett, Robert J.; Duncan, Richard J.; RibasRibikauskas, Emily K. "Scrolling Web Pages using Direct Interaction", United States Patent 7,519,920, April 14, 2009
Scroll/drag a web page using a stylus on a touchscreen: when move stylus to perimiter, page will auto-scroll with simulated momentum.
[JazzMutant09a] ( * )JazzMutant.com "Lemur: Schliessen Sie Ihren Lemur an", www.jazzmutant.com

MIDI controller/GUI software toolkit for touch gestures specific to controlling music and audio systems. multi-touch.
[JazzMutant09b] ( * )JazzMutant.com "Lemur V2.0 User Guide", www.jazzmutant.com

MIDI controller/GUI software toolkit for touch gestures specific to controlling music and audio systems. multi-touch.
[JazzMutant09c] ( * )JazzMutant.com "Behind the Lemur", www.jazzmutant.com

multi-touch digitizer capable of handling an unlimited number of fingers at once: genesis of the device was that the developers designed a user interface assuming such a device was available. multi-touch.
[JobsSP09a]
( * )Jobs,
Steve P. et al "Touch Screen Device, Method,

31/74
02.11.13
and Graphical User Interface for Determining Commands by applying Heuristics", United States Patent 7,479,949 B2, Jan 20, 2009
Gesture (multi-touch gesture) recognition by heuristics, Numerous other iPad/iPhone gesture patents incorporated by reference. Specific to finger contacts / touchscreens, not other stylus digitizer input. Very large spec (362 pages), shows slide-to-unlock.
[JoguetP10a] ( * )Joguet, Pascal and Largillier, Guillaume "Multipoint touch sensor with active matrix", United States Patent Application 2010/0066686 A1, March 18, 2010
Includes description of JazzMutant/Stantum multi-touch touchscreen, overcomes masking/shadowing effect of simple switch matrix designs by using active matrix switching array (similar to active matrix LCD circuitry) to measure each coordinate in grid of perpendicular wires separately. Also refers to using conductive rubber or piezo switch elements at nodes. See also 2007 SID article by Largillier
[JonesRE08a] ( * )Jones, Randall Evan "Intimate Control for Physical Modeling Synthesis", Master's Thesis, Dept. of Comp. Sci, U. of Victoria, BC, Canada
Multi-dimensional force sensor: multi-touch sensor used to sense dynamic pressure image over the touchpad surface. Grid of X and Y conductors, forming capacitive-sensor nodes, separated by layer of rubber dielectric. Dynamic calibration to compensate for mechanical hystereis of rubber sheet (persistent pressure indication after touch has ended). Interpolation of values plus centroid detection, correlating to centroids detected in previous sample (tracking touches).
[JonesR09a] ( * )Jones, Randy; Driessen, Peter; Schloss, Andrew; and Tzanetakis, George "A Force-Sensitive Surface for Intimate Control", Proc. New Interfaces for Musical Expression NIME09, June 3-6, 2009, Pittsburgh, USA
Madronalabs.com Madrona Soundplane: force/pressure sensing X/Y touchsurface, intended as controller for electronic musical instruments. Multi-touch sensing. Cites to earlier devices. "Control intimacy" -- tightly-coupled haptic feedback? Capacitive grid forcesensitive touchscreen tablet: X and Y antennae separated by a rubber/elastomeric sheet, pressing brings wires closer together for stronger capacitive coupling. Cites to Radio Drum from 1980's. Used as musical instrument interface.
[KaneSK08a]
( * )Kane,
Shaun K.; Bigham, Jeffrey P. and Wobbrock,

32/74
02.11.13
Jacob O. "Slide rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques", Proc. ASSETS '08, October 13-15 2008, Halifax, Nova Scotia, pp. 73i80
Accesibility multitouch touchscreen gestures for visually impaired: inspiration for Apple VoiceOver gestures? Second-finger tap (see earlier touchscreen gestures w/o multi-touch), "L" gestures, one-finger scan/scroll, flicks
[KarlsonAK08a] ( * )Karlson, Amy K. and Bederson, Benjamin B. "OneHanded Touchscreen Input for Legacy Applications", Proc. CHI 2008 April 5-10, 2008, Florence Italy, pp. 1399-1408
For one-handed PDA use, user defines a ThumbSpace -- the area reachable by the thumb while holding the PDA in one hand. Show thumbnail (sic) image of whole screen in ThumbSpace for user to pick from on whole touchscreen. Refers to whole screen touching as DirectTouch.
[KlimovsV09a] ( * )Klimovs, Vjaceslavs and Pisarenko, Sergejs "Towards enhancing perceived performance through adoption of proposed benchmarking techniques", Report 2009-029, University of Gothenburg, Germany, 2009
Report on perceived versus actual performance in user interactions: mentions "kinetic scrolling" and "two-way scrolling". Compare with Apple slider/slide-to-unlock?
[KolokowskyS10a] ( * )Kolokowsky, Steve and Davis, Trevor "Understanding key specs in reliable capacitive touchscreens", EE Times-Asia / eetasia.com, 2011
Cypress Semiconductor white paper on specifications for capacitive touchscreen using XY grid for multi-touch digitizers. Accuracy, finger separation (minimum discernable distance), response time, refresh rate (a.k.a. report rate or data rate in samples/sec), power consumption. Compare with Ward paper on digitizer technology: paper does not mention stylus tilt, registration, noise, fixed or variable error, etc.
[KrempM08a] ( * )Kremp, Matthias "Microsoft bittet zu Tisch", Spiegel news magazine (in German), January 10, 2008. www.spiegel.de
Report from Consumer Electronics Show on Microsoft digital table / surface table touch digitizer, with direct manipulation of photographs. References to iPhone interface. Digitizer touch sensing limit is 52 touch points: four players, 10 fingers plus 3 playing figures each. Compare with Wang Freestyle for graphical manipulation?
[KrempM08b]
( * )Kremp,
Matthias "Windows 7 bekommt iPhone33/74
02.11.13
Interface", Spiegel news magazine (in German), May 28,2008. www.spiegel.de

Report on Microsoft Windows 7 touch-UI interface. Also mentions digital table / surface table touch digitizer, with direct manipulation of photographs. Points out awkward positioning of touch screens at a desk, compares with keyboardless one-laptop-per-child touch system.
[KrempM10a] ( * )Kremp, Matthias "Nokias letztes Aufgebot: Smartphone N8", Spiegel news magazine (in German), October 20, 2010 www.spiegel.de
Nokia N8 cellphone with touch-screen interface, runs videos (Linux OS?) and GPS Ovi Maps no charge.
[KroekerKL09] ( * )Kroeker, Kirk L. "Electronic Paper's Next Chapter", Communications of the ACM, Vol 52. No 11, November 2009, pp. 15-17
Overview report on E-Ink, Plastic Logic, and other vendors of electronic paper and flexible displays. E-Ink acquired by Prime View International of Taiwan, which manufactures the Kindle. Mentions color displays: no information on tablets or digitizers. Electrophoresis, electrophoretics, electrofluidic technologies.
[KruegerMW09] ( * )Krueger, Myron W. "Myron W. Krueger", en.wikipedia.org

Mentions computer input of two-arm gesture holding arms out to sides, recognized optically
[KurtenbachG09a] ( * )Kurtenbach, G. "Demo of Marking Menus Versus Linear Menus", Youtube.com, posted 2009
Demo of marking menus versus linear menus: date of video probably earlier than posting date.
[LapstunP09a] ( * )Lapstun, Paul; Bertok, Attila; King, Tobin Allen; Underwood, Matthew John; and Silverbrook, Kia "Collapsible force sensor coupling", United States Patent 7,523,672, April 28, 2009
Netpage pen/stylus: piezo-electric force sensor in stylus, with spring to absorb shock and protect sensor if hit hard. Netpage is an optical positionsensor stylus using camera and infra-red illuminator/LED and a dot-like encoding of position. Cites to Sekendur. Compare with Anoto?
[LeeJH10a] ( * )Lee, Jae-hoon "Audio/video Device Having a volume Control Function for an External Audio Reproduction Unit by Using Volume Control Buttons of a Remote Controller and Volume Control Method Therefor", United States patent 7,672,470 B2, March 2, 2010
02.11.13
Volume control on (on touchscreen) when an external amplifier/speakers (headset) are plugged in. Related to Labview?
[LeeJK10a] ( * )Lee, Jong-Kwon; Kim, Sang-Soo; Park, Yong-In; Kim, Chang-Dong; and Hwang, Yong-Kee "In-cell adaptive touch technology for a flexible e-paper display", Solid-State Electronics, Vol 56 (2011), pp. 159-162, available online 18 November 2010
Light-sensitive touch panel with display, photo-sensor arrays integrated into cells of electronic ink paper display. Capacitive coupling to finger to avoid shadowing of light.
[LiY08a] ( * )Li, Yang; Klemmer, Scott; and Landay, James A. "Tools for Rapidly Prototyping Mobile Interactions", Chapter XXI in Handbook of Research on User Interface Design and Evaluation for Mobile Technology, National Research Council of Canada, Joanna Lumsden Ed., 2008, pp. 330-345
Prototyping UI design using UIMS with storyboarding, either with paper or with software tools. Prototype with Toshiba Tablet PC (Microsoft) and HP iPAQ Pocket PC with interactive maps.
[LightBlueOptics10a] ( * )Light Blue Optics "Light Speed, Light Touch, Light work", www.lightblueoptics.com, fetched 2010
Holographic projector and infrared sensor for creating a "touch screen" on any surface on which an image can be projected.
[LinJC08a] ( * )Lin, Jao-Ching; Huang, Shyh-In; Chu, Lin-Abel; and Shen, Chung-Yi "Method of scrolling window screen by means of controlling electronic device", United States Patent 7,319,457, January 15, 2008
Scrolling using multiple taps in scrolling press zones: more taps, faster scrolling, also tap to stop scrolling.
[LindemannP10a] ( * )Lindemann, Patrick "A Short Report on Multi-touch User INterfaces", Dept. of Media Informatics, University of Munich, Germany: wiki.medien.ifi.lmu.de, Fetched 2010
Review of multi-touch gestures. Cites to 2003 for flick gestures (with hand or finger), but does not mention PenPoint/GO. Cites Buxton on multi-key/nkey rollover on a keyboard in 1970's being a form of multi-touch.
[LinuxForDevices10] ( * )LinuxForDevices.com "Multi-touch displays support all ten fingers at once", www.LinuxForDevices.com, 2010-02-18
multi-touch digitizer capable of ten fingers concurrent/simultaneous input. PMatrix from Stantum. Resistive touchscreen display. Quotes Jim Meador at Stantum regarding non-proprietary nature of Apple iPad pinch gesture.
02.11.13
Compare with JazzMutant.
[Livescribe08] ( * )LiveScribe, Inc. "Livescribe: Never Miss A Word (Smartpen)", www.livescribe.com

Voice/handwriting recording using Anoto digital pen and digitizing (tablet) paper. Includes syncronized voice recording built into pen. Touch previous mark, pen plans recorded audio recorded at that time of writing: example is write "define" followed by word, get definition. Uses Anoto technology, see also EchoPen.
[Livescribe08a] ( * )Science Daily "Smart Pens Help Blind See", www.sciencedaily.com, May 9, 2008
Voice/handwriting recording using Anoto digital pen and digitizing (tablet) paper. Includes syncronized voice recording. Article / press-release attempts to make accessibility connection to being annotation device for the visually impaired.
[Livescribe10a] ( * )Fahlberg, Tim "Livescribe Smartpen: How (and why) to Enlarge audio Dots (+How to Make them Findable for those with Vision Loss] ", www.edlivescribe.com, December 8, 2010
Use Anoto Pen (Livescribe Pulse or Echopen) and printed labels to make audio notes that can be played back by visually impaired/blind user or motor impaired by touching sensor to printed dot. File contains additional references, such as LiveScribe/Anoto Post-it notes. UI for creating notes still requires use of printed paper with control functions. Compare synchronized voice and handwriting of Freestyle with LiveScribe Anoto pen.
[LjLies10a] ( * )LjLies (Youtube) "Video demonstration: Casio PF-8000 Calulator, circa 1984", Youtube.com, uploaded 2010
Video demonstration of Casio PF-8000 calculator, using keys as digitizer input for recognizing handwritten numerics and math operator sysmbols.
[LucentMicrosoft08] announcement file
( * )Lucent
v. Microsoft "Lucent v. Microsoft", Press
Press articles on Lucent v. Microsoft patent case concerning United States Patent 5,544,295 on tablet PC and gesture-based user interface
[LucentMicrosoft08a] ( * )Associated Press: Jessica Mintz "Microsoft to Appeal $367M Patent Ruling", Associated Press, April 4, 2008
Microsoft found to infringe GO patent on using gestures on Tablet PC. Other patents in case concern video compression, forms input, and color management.
02.11.13
[LucentMicrosoft08b] Microsoft
( * )LucentMiccrosoft
"Exhibits", Lucent v.
Exhibits (technical references) in Lucent v. Microsoft in San Diego: long list.
[LuckieD10a] ( * )Luckie, D. "Newton Hall of Fame", www.msu.edu/~luckie/hallofame.htm

Bios of major personalities in Apple Newton development team: Steve Capps (Finder), Walter Smith (NewtonScript, a.k.a. WallyScript), John Sculley, Michael Tchao ("Apple had been working for years on slate computers that read handwriting"), Stepan Pachkov, Larry Yaeger (Cursive Recognizer)
[LuckieD10b] ( * )Luckie, D. "Newton Gallery", www.msu.edu/~luckie/newtgal.htm

Detailed specs on Apple Newton MessagePads, several models,: OS 2.0, 2.0 1.3, and 1.0 released 1993. Associated with Steve Capps.
[MaddalozzoJ10a] ( * )Maddalozzo, John Jr.; BcBrearty, Gerald Francis; and Shieh, Johnny Meng-Han "Method and system for touch screen keyboard and display space sharing", United States Patent 7,768,501, August 3, 2010
Virtual keyboard (transparent/translucent: or may display image of touchpad, or other image) comes up on touchscreen when proximity of user's hands is detected, removed when hands no longer near surface.
[Makowski08a] ( * )Makowski, Dirk "Windows fr Pen Computing 1.0", www.winhistory.de, fetched September 6, 2008
Screen shots of Windows for Pen Computing 1.0 on Windows 3.11 from 1992, German-language version. All applications (but not OS) were penenabled by means of pen tool "Stiftpalette". Notebook / Notizbook application allowed free-hand electronic ink note-taking. Gestures/Gesting include check-mark to edit text, similar to PenPoint OS. Comparison with Windows for Pen Computing 2.0 on Windows 95, which is described as more of an add-on and less integrated. Shows multiple gestures accepted in text editor: check mark to edit text, space, new line, cut (pigtail), undo (loop), backspace.
[Makowski08b] ( * )Makowski, Dirk "Windows XP Tablet PC Edition (Codename "Lonestar"); 2005 edition", www.winhistory.de, fetched September 6, 2008
Screen shots of Windows XP Tablet PC edition, German-language version.
02.11.13
Lonestar released in 2002.
[Makowski08c] ( * )Makowski, Dirk "Windows Vista", www.winhistory.de, fetched September 6, 2008

Screen shots of Windows Vista, German-language version, 2007. Includes Tablet PC functionality.
[MarriotG09] ( * )Marriot, Greg; Bar-Nahum, Guy; and Bollinger, Steve "Touch Pad for Handheld Device", United States Patent 7,495,659, February 24, 2009
Detection of events (gestures?) on a touch-pad and filtering the native coordinates based on those events. Compare with Microtouch, and with Pencept and CIC recognition Macros?
[McDermidWJ09a] ( * )McDermid, William J. "Touch Sensor Pad User Input Device", United States Patent Application 2009/0009482 A1, January 8, 2009
Touch typing on a multi-touch touchscreen keyboard: user first touches to establish home row position (e.g. eight fingers gesture), virtual on-screen keyboard displayed as visual feedback/confirmation at that position, user may then type at positions relative to established home row position: compare to Westerman?
[Measurand08a] ( * )Measurand Inc. "Measurand Sampling shapes with ShapeTape: Use enough sensors to do the job!", www.measurand.com, 2008
Flexible tape sensor using optical fibers to detect bend and twist configuration of the tape. Discussion of limits to resolution and detecting due to spacing of points of sensing along the tape: bending or dent between two sensing points not detected.
[Microsoft08a] ( * )Microsoft Corporation "Integrating Application Gestures", msdn.microsoft.com, ms704819

Windows Vista / Tablet PC: defines gesture as "a glyph that defines the shape traced by the gesture", plus a hotpoint
[Microsoft08b] ( * )Microsoft Corporation "Designing for Direct Manipulation", msdn.microsoft.com, ms698539

Tutorial for Tablet PC developers on basic physical differences between stylus/pen interaction with a digitizer, and operation with a mouse. Does not refer to details of mouse/stylus message differece in programming. Tablet resolution in Tablet PC is normalized in software to 0.01 mm. Size of targets, involuntary hand movements, hand/stylus obscuring view of
02.11.13
display, hover/proximity feedback with digitizer tablet.
[Microsoft08c] ( * )Microsoft Corporation "SystemGesture Enumeration", www.microsoft.com

List of System Gestures for Microsft Tablet PC/Vista. Lists Tap and DoubleTap as gestures that work for both system and application. Description for Tap refers to chosing a command from the menu or toolbar, take action if command is chosen.
[Microsoft08d] ( * )Microsoft Corporation "Microsoft Tablet PC Glossary", msdn.microsoft.com, ms840456

Definitions of Application Gesture, Gesture, Application Gesture, Glyph (as ink data). Refers to "Microsoft gesture recognizer" as engine that specifically recognizes ink iput as either system or application commands. "Object regonizer" for recognizing non-gesture, non-handwriting shapes such as musical notation, math notation (i.e. sketch recognition would fall into this). Stroke based on pen down/up. ISF Ink serialized format (similar to JOT?)
[Microsoft08e] ( * )Microsoft Corporation "Application Gestures and Semantic Behavior", msdn.microsoft.com, MSDN, fetched February 21 2008
Vista/Tablet PC SDK documentation from MSDN: defined gestures include scratch-out/erase, Triangle/insert, Check-off, Curlicue/fixed (compare with proofreader's marks), Double-Curlicue/copy, double-circle/paste, leftsemicircle/undo, right-semicircle/redo, Caret gesture/paste, Invertedcaret/insert, flick left / backspace, flick right / space (compare with GO flick gestures), left/right/up/down corners with directional gestures. See also 2003 version of same reference.
[Microsoft10a] ( * )Microsoft Corporation "Touch Gestures", Windows Mobile 6.5, Touch Gestures, dated 4/8/2010
Tap gesture of finger represents left click of a mouse. Mouse events WM_MOUSEMOVE and WM_LBUTTONDOWN events not coordinated with GID_SELECT message for gesture. Double tap for left double click of mouse, using GID_DOUBLESELECT gesture message. Hold (press-andhold/dwell) generates separate GID_HOLD message, used to represent right click of a mouse, GID_END messaged at end of hold time threshold. Flick gesture GID_SCROLL message to scroll, GID_PAN gesture to pan (can be after hold gesture)
[Microsoft10b] ( * )Microsoft Corporation "Microsoft Project 2010 Product Guide: Project Standard and Project Professional", Microsoft
02.11.13
Corp., 2010
Microsoft Project collaborative work system: includes CPM critial path method, Gantt charts, resource and schedule views. Agile project plans.
[MicroTouch08a] ( * )3M Touch Systems (Microtouch) "MicroTouch Capacitive TouchSensor System", 3m Touch Systems, 2008
Capacitive touchscreen/digitior with actuator for haptic feedback, can be mounted to frame/carrier/display for ClearTek II touch sensor touchscreen
[MicroTouch08b] ( * )3M Touch Systems (Microtouch) "MicroTouch TouchPen System for ClearTek II Touch Screens", 3m Touch Systems, 2008
Capacitive touchscreen/digitior that senses either a stylus or a finger touch -- but not both, stylus/pen takes precedence -- stated as palm-rejection. multi-touch.
[MicroTouch09a] ( * )3M Touch Systems (Microtouch) "MicroTouch Software MT7 Gesture Application Programming Interface API", 3m Touch Systems, 2009
Microtouch: Software toolkit MT7 for gesture recognition. Refers to "Slow Draw Anomalies" with jagged electronic ink (polling input of touch coordinates on tablet?) Stroke matches (elastic matching?), Strokes and Stroke data objects. Electronic file includes MicroTouch Capacitive TouchSense system with haptic transducer touch feedback for Gaming, 3M MicroTouch Software MT7 User Guide.
[MilekicS09a] ( * )Milekic, Slavoljub "Using gaze interactions to interact with a display", United States Patent 7,561,143, July 14, 2009
Using a gaze tracker / visual input to simulate mouse events: no specific reference to gestures, but to graphical user interface
[MilekicS10a] ( * )Milekic, Slavoljub "Curriculum Vitae: Slavko Melekic", www.uars.edu/faculty/smilekic/cv.html, Feb 27 2010
Educational uses of touch technology and human/computer design: Please Touch Museum (touch-screen user interface) at Phoenix Art Museum and Cleveland Museum of Art, Dallas Museum of Art: KiddyFace digital environment.
[MistryP08a] ( * )Mistry, Pranav and Maes, Pattie "Quickies: Intelligent Sticky Notes", Proc. 4th Int'l Conf. on Intelligent Environments, IE08, Seattle, 2008
Electronic ink application using small outboard (sonic?) digitizer with a PC, and paper with embedded RFID tag. Lets writing/ink be tied to the piece of
02.11.13
paper, similar capability to Anoto technology, however RFID can be used to locate the paper (which may be tucked into a book or folder) using RFID technology, retrieve specific notes. Demonstration includes used of deferred recognition to index/search notes.
[MistryP08b] ( * )Mistry, Pranav and Maes, Pattie "Intelligent Sticky Notes that can be Searched, Located and can Send Reminders and Messages", IUT08, January 13-16, 2008, Maspolomas, Gran Canaria, Spain
Electronic ink application using small outboard (sonic?) digitizer with a PC, and paper with embedded RFID tag. Lets writing/ink be tied to the piece of paper, similar capability to Anoto technology, however RFID can be used to locate the paper (which may be tucked into a book or folder) using RFID technology, retrieve specific notes. Demonstration includes used of deferred recognition to index/search notes.
[MistryP10a] ( * )Mistry, Pranav "SixthSense: Integrating Information with the Real World", www.pranavistry.com/projects/sixthsense, copyright 2010
Display image can be projected onto any surface, including a hand: tips of fingers (more than one) identified by colored bands on fingertips allow fingers to be detected optically with respect to image, forming an optical digitizer touch surface.
[MiyakiT09a] ( * )Miyaki, Takashi and Rekimoto, Jun "GraspZoom: zooming and scrolling control model for single-handed mobile interaction", Proc. MobileHCI09, September 1-18, 2009, Bonn Germany
thumb-gesture input combining motion and pressure/force sensing: light touch is move, push-touch is zoom: refers to apple Pinch and Flick gestures for zooming and scrolling, comments that Flick may require multiple flick gestures for long list. Suggests using contact area of fingertip as substitute for pressure/force sensitive digitizer touchscreen.
[MoscovichT09a] ( * )Moscovich, Tomer "Contact Area Interaction with Sliding Widgets", Proc. UIST '09, October 4-7, 2009, Victoria, B.C., Canada
Address accuracy on touchscreen by selecting all widgets/objects under area of touch (since finger touch contacts and area, not a single pixel), and user moving to activate a particular function: Sliding widget, multi-function widget. Gives example of moving down a scroll list for "History", then flicking a stroke left or right to move forward in history. Click sound on activiation (audible highlight) and also visual highlight. Compare with Apple
02.11.13
slide-to-unlock?
[MotionComputing08a] ( * )Motion Computing, Inc. "Use Shorthand to Create a Gesture", http://www.motioncomputing.com/resources/Shorthand_Gesture.pdf

Motioncomputing Tablet PC: Definition of single-letter "gestures" using side-button on stylus: appears functionally identical to "recognition macros" of Pencept PenPad 320 series product circa 1985, and similar feature from CIC HandWriter from about the same time. Press side barrel button on stylus, write one letter or symbol, release side button. Pre-defined keyboard input is invoked. LE 1700.
[MotionComputing08b] ( * )Motion Computing, Inc. "Motion moves in on other markets, unveils new product", Austin Business Journal, March 7, 2008 and other press reports
Motion Computing F5 Tablet PC, XFR D630 : Ruggedized Tablet PC. Also competing ruggedized tougher-tablet market from Samsung, Sony, Dell Latitude XT convertible tablet. Mentions patent infringement lawsuit from Typhoon Touch.
[MotionComputing08c] ( * )Motion Computing "Motion LE1700 Tablet PC User's Guide: Windows Vista", Motion Computing, 2007
Tablet PC User's guide: mostly hardware features including SIM/phone card slot. Press-and-hold / tap or touch and drag touchscreen, or use Function button and tap.
[MotionComputing09a] ( * )Motion Computing, Inc. "J3400 Tablet PC Benutzerhandbuch (J3400 Tablet PC User Guide)", Motion Computing, 2009
User guide for Tablet PC running Windows 7 (not Windows Tablet PC/XP). For Arbeiten mit dem Stift (Stylus) has long-hold and barrel button for emulating right-mouse-click. Schreibblock (input panel) has both handwriting are input and simulated/virtual on-screen keyboard. Option to set barrel button to be erase (compare with Freestyle pen) instead of rightmouse-button click simulation.
[Moto.com10a] ( * )labs.moto.com "Blog Archive: DIY Touchscreen Analysis: touchscreen stress test", http://labs.moto.com/diytouchscreen-analysis
Blog posting of testing of touchscreens and multi-touch surfaces: mentions erratic behavior at light touch, edge problems. Features bad behaviors/errors for which Moto touchscreens tend to do well. compare with other papers on digitizer effects and user Interface by Phillips and
02.11.13
Ward.
[Motorola10a] 2010
( * )Motorola
"Droid 2 Global User Guide", Motorola,
User guide for Droid 2 Android touchscreen cell phone / smart phone with stylus and finger gestures: touch (tap), touch & hold, hold followed by drag, scrolling. Slide out physical keyboard, no handwriting recognition.
[Motorola10b] ( * )Motorola "Webtop Application Overview", developer.motorola.com, 2010

Webtop: Desktop extension to Android PDAs and Smartphones: when using external keyboard and monitor (Lapdock station), displays Firefox 3 window executes Android applications within browser: use smartphone as portable PC with external display/keyboard. Filemanager for accessing internal files of smartphone. Electronic file contains additional materials.
[MotusGames08] ( * )Motus Games "Motus Darwin product information", http://www.motusgames.com

WII-like game controller using accelerometers and magnetic north, rather than infra-red optical digitizer for sensing hand gestures and position. Compare to accelerometer pen from Hew Crane at SRI.
[Mozilla08] ( * )mozilla.org "FireGestures 1.1.2 von Gomita", http://addons.mozilla.org/de/firefox/addon/6366

Mouse gestures for Mozilla / Firefox browser, Thunderbird Mail, and Chatzilla. Gesture recognition apparently based on changes in direction. Certain gestures involve right mouse button, mouse wheel.
[Mueller-TomfeldeC10a] ( * )Mueller-Tomfelde, Christian, (Ed.) "Tabletops - Horizontal Interactive Displays", Springer Verlag, ISBN 9781-84996-112-7, 2010
Anthology of tabletop/touchscreen displays, technologies, applications. Sections Under Tabletops, On and Above Tabletops, Around and Beyond Tabletops (3D)
[MultiTouchTechnology08] ( * )multitouchtechnology.com "Multi-Touch Technology", www.multitouchtechnology.com

CNN using multi-touch screens from 2006 TED conference. Apple MacBook with Multi-Touch touchpad using two-finger gestures similar to Apple iPod.
[MultiTouchTechnology08b] ( * )multitouchtechnology.com "Multi-Touch Technology: Firefox 3.1 Adds Multi-Touch Support", www.multitouchtechnology.com
02.11.13
Several announcements of multi-touch gestures in Apple computer products, touchpads, gestures supported in Firefox 3.1: pinch, two-finger scroll by page or window, swipe/flick, mentions fewer number of gestures in Safari web browser.
[MultiTouchVista08a] ( * )codeplex.com "Multi-Touch Vista: TouchablePanel code example", multitouchvista.codeplex.com, fetched Feb 2011, dated 2008
Example WPF code for multi-touch demo on Windows Vista using Multitouch.Framework.WPF.Controls.Windows from schema.multitouch.com
[MurpyC10a] ( * )Murphy, Chris "7 Tips for Using the iPad in Business", Information Week, November 1, 2010, page 26
Review of use of iPad touchscreen tablet at Mercedez-Benz Financial: customers sign agreements using iPad, states that development was less difficult than iPhone because display size allowed application to be built as more ordinary web/browser application.
[MurpyG10a] ( * )Murphy, Glenn "The Chromium Projects: Tablet", dev.chromium.org, fetched 2010
Proposed tablet/gesture UI user interface for a Chrome OS tablet UI: mentions dwell/hover gester for contextual actions
[MurraySmithR08a] ( * )Murray-Smith, Roderick; Williamson, John; Huges, Stephen; and Quaade, Torben "Stane: Synthesized Surfaces for Tactile Input", Proc. CHI 2008 - Multitouch and Surface Computing, April 2009, Florence Italy pp 1299-1302
Haptic/Tactile input device: Hand-held object with various ribbed textures on the surface and piezo macrophone inside: rubbing or stroking a finger across the surface causes vibrations characteristic of the ribbed texture. Control of zoom, volumn, position by stroking different seconds. Additional materials in file: "M" gesture, double-tap with finger gesture to turn UI on/off (for carrying pen computer so that cursor does not move)
[MyllymakiS10a] ( * )Myllymaki, S.; Huttunen, A.; Palakuru, V.; and Jantunen, H. "Capacitive Recognition of the Uer's Hand Grip Position in Mobile Handsets", Progress in Electromagnetics Research B, Vol 22, pp. 203..220, 2010
Capacitive method for measuring/detecting the position of the user's hand holding a mobile phone. Copmbines two sensors: one using the antenna, the other a dual-electrode (transcapacitance). The more of the user's hand is around the cel phone, the more the capacitance change. Purpose is to
02.11.13
transmit stronger signal when user is covering most of the antenna, but otherwise spare the battery.
[N-Trig09a] ( * )N-Trig Corporation "DuoSense Technology", www.ntrig.com July 2009

N-trig digitizer tablet, senses stylus and touch/multi-touch, electrostatic (capacitive) stylus, mentions unintentional touch / hand-rejection Additional materials in file: "M" gesture, double-tap with finger gesture to turn UI on/off (for carrying pen computer so that cursor does not move)
[NaoneE10a] ( * )Naone, Erica "New Computer Interface goes beyond Just Touch", Technology Review, April 12, 2010
Multi-modal (haptic?) interface by Ken Hinckley at Microsoft, using both pen and hand. One example is using hand to hold a virtual object stationary on an active surface, and a pen/stylus to tear of a virtual page.
[NaoneE10b] ( * )Naone, Erica "Redesigning the Web for Touch Screens", Technology Review, May 04, 2010
Re-designing of web pages for touch input, specifically for the iPad. Cites to Internation children's Digital Library re-design, multi-lingual (pictographic/iconic?) user interfaces was particularly amenable to touch input.
[NelsonF10a] ( * )Nelson, Fritz "Review: Dan Bricklin's Note Taker HD puts the "Pad" in iPad", Information Week, July 6, 2010
Notetaker application for apple iPad. Appears similar to Daytimer product by Slate in the early 1990s for PenPoint and for Pen Windows: follows paradigm of ink-as-datatype, editing of electronic ink, as in van Raamsdonk
[NelsonF10b] ( * )Nelson, Fritz "iPhone 4 Teardown Telegraphs Future iPad Gyro", Information Week, June 24, 2010
iPhone 4 cell phone / tablet contains gyroscope in addition to accelerometer, identifies as InvenSens ITG-3200 or STMicro L3G4200D three-axis MEMS gyro.
[NetworkSignatures10a] ( * )NetworkSignatures.com "Intermediate Network Authentication", www.networksignatures.com

Materials relating to two-factor authentication products (exchange of PK signatures) for iPhones, Java-enabled phones and Blackberry mobile devices, based on patent 5,511,122, licensed from Naval Research Laboratory. Folder contains additional materials.
[NetworkWorld09a] ( * )NetworkWorld.com "Researchers develop 3-D squeezable input device", www.networkworld.com, Dec. 01, 2009
02.11.13
Suma, by Cambridge Consultants, squeezable mouse-like input device for three-dimensional input. Article states light-sensitive sensors for pressure/touch, ability to control two points of view simultaneously with one hand.
[NetworkWorld09b] ( * )NetworkWorld.com "Nanotouch technology shrinks touchscreen displays", www.networkworld.com, April 7, 2009
Pseudeo-transparency: on small screen, touch screen is on rear of display so that finger does not occlude view of display -- show simulated finger on display when user touches back of display for input. Earlier technology was called Lucid Touch.
[NeuroScript09] ( * )NeuroScript "Testing Digitizer / Tablet Linearity", http://www..neuroscript.net

software package for measuring performance of tablet digitizers: manual procedures for testing lineary by using diagonal lines, but does not mention velocity-induced errors (compare with Carau)
[NeuroScript10] ( * )NeuroScript "MoveAlyzeR Tutorial", http://www..neuroscript.net

software package for measuring performance of tablet digitizers: missing coordinates, missing points, non-linearity. Part of offering to for measurements for neuromotor analysis of handwriting motion.
[NextWindow09] ( * )NextWindow Inc. "NetWindow Optical Touch Screens", www.nextwindow.com, July 2009
Infrared optical digitizer multi-touch flat-panel displays: notes that no optical coating is required on display. Sensors mount at corners of front surface of rectangular glass assembly.
[NewScientist08] ( * )NewScientist.com news service "Phones with feeling are more useful", www.newscientist.com, 24 March 2008
VibeTonz vibrotactile haptic/vibration feedback for touch interfaces and touchscreens: VibeTonz is a hardware actuator component for PDAs and devices similar to Apple IPhone
[NewScientist08b] ( * )NewScientist.com news service "Fat fingers no problem with 'see-through' touchscreen", www.newscientist.com, 18 December 2008
Fat fingers / touchscreen accuracty: Place touch pad on back side of handheld touch-screen device, so that finger tip does not obstruct/obscure view of display and where user is touching
[NewScientist09a]
( * )NewScientist.com
news service "'Fat fingers' can

46/74
02.11.13
become dainty for touch screens", www.newscientist.com, 24 November 2009

Improve accuracy of touch-screen input by sensing orientation of finger: experimental system to demonstrate used fingerprint scanner to determine orientation of finger
[NewScientist10a] ( * )NewScientist.com news service "Putting the touch into touchscreens", www.newscientist.com, 26 April 2010
Review of haptics technologies for touchscreens: vibration to give the illusion that a button protrudes from thes ervice, lateral vibration to simulate the haptic sensation of a sharp edge, high frequency vibrations to simulate a slippery surface, force-feedback systems
[NewScientist10b] ( * )NewScientist.com news service "World's first ice touschscreen virtually burns", www.newscientist.com, November 18 2010
Nokia demonstration system of turning blocks of ice into translucent optical touch screen (based on reflected light where hands come into contact), displaying virtual flames where touched.
[Nokia08a] ( * )Nokia "Nokia N810 Internet Tablet", www.nokia.com product information

Dedicated pen computer with MP3 and auto map software, open-source (Linux). Touchscreen digitizer.
[Nokia08b] ( * )Nokia "First glimpse inside Nokia S60 Touch. Going beyond Multi-touch", www.unwiredview.com, January 8, 2008
Review of S60 No-touch / touchless electrostatic touch UI device from Nokia. Allows in-air three-dimensional 3D gestures. Compared to "Minority Report" film. Due to patent conflicts with Apple Multi-Touch (see Fingerworks), based on Active Matrix LCD with integrated optical touch screen. Gestures include clockwise and counter-clockwise circles, X mark for delete, check mark, lasso / enclosed curve, two finger pinch and expand for zoom.
[Nokia08c] ( * )Nokia "Nokia creates a real Minority Report", phonenews.blogs.sapo.pt, January 9, 2008
Review of Nokia publication on in-air gestures, compared with film "Minority Report": clockwise and counter-clockwise circular rotations, pinch and zoom, stationary pointing, X, check mark, enclosed curve / lasso to select.
[Nokia10c] Dec 2010
( * )Nokia
"Nokia N8-00 User Guide", Nokia.com, fetched
47/74
02.11.13
Nokia N8 touchscreen cellphone with network applications. Physical slide switch to unlock.
[Nokia10d] [Nokia10e]
( * )Nokia ( * )Nokia
"Nokia, Microsoft", (various) "Nokia N8-00 User Guide", Nokia, 2010
Folder with information on Nokia and Microsoft Windows 7 phone OS User guide for cellphone with touchscreen interface. Device includes haptic (vibration) feedback as confirmation on some touch inputs
[nortd.com09a] ( * )nortd.com "TouchKit: open source multitouch development kit", labs.nortd.com, fetched 2009
Open source development system (hardware and software) for multi-touch technology, includes projection of images on reflective surface. Also mentions CUBIT multitouch system for rapid implementation of multitouch projects: ofxTouch API for C++ OpenFrameworks on various platforms. File contains additional materials: Zaagtech multi-touch kit
[NovaMobility08] ( * )Nova Mobility Systems "Nova Mobility Rugged Tablet PC and Handheld Computer Systems", www.novamobility.com
NMS-5000, NMS-SUNPAD, Tablet PC, Windows Mobile, Windows CD, Windows XP Embedded. touch-screen based pen computers and PDA's. Licensee of Typhoon Technologies. Market is industrial uses, data collection. Integrated bar code, camera, mag stripe reader. Touch screen with palm rejection -- digitizer technology not stated, says resistive touch. Keyboard usable while user wearing heavy gloves. Compare with products by Leo Shpiz for military market.
[NUIGroup09a] ( * )NUI Group Authors "Multi-Touch Technologies: Community Book, 1st ed", available at nuigroup.com, May 2009
Textbook/tutorial from open-source hardware project for multi-touch (optical: rear diffusion) hardware. Discusses open-source Gesture widget and software libraries, such as X12, GDML Gesture Definition Markup Language, NUIFrame, Grafiti (not the Palm unistroke library), AME Arts, Media and Engineering Patterns Library, other gesture frameworks.
[ObradovichML08a] ( * )Obradovich, Michael L. "GPS Publication Application Server", United States Patent 7,343,165, March 11, 2008
Server receives GPS and other data from a personal device, displays location on a web homepage accessible to selected users.
[ObradovichML09a] ( * )Obradovich, Michael L.; Pirtle, John D.; Schebesch, Steven W. "Technique for Effective Navigation based on User Preferences", United States Patent 7,522,992, April 21, 2009
Server responds to GPS/routing request from a cellphone with GPS and
02.11.13
touchscreen, sends back map with points of interest, based on preferences in a user profile.
[ObradovichML09b] ( * )Obradovich, Michael L.; Pirtle, John D.; Schebesch, Steven W. "Technique for Effective Navigation based on User Preferences", United States Patent 7,593,812, September 22, 2009
Server responds to GPS/routing request from a cellphone with GPS and touchscreen, sends back map with points of interest, receives a user touch input, on a point of interest, establishes communications to it.
[ObradovichML10a] ( * )Obradovich, Michael L.; Pirtle, John D.; Schebesch, Steven W. "Technique for Effective Navigation based on User Preferences", United States Patent 7,650,234 January 19, 2010
Server responds to GPS/routing request from a cellphone with GPS and touchscreen, sends back map with points of interest, computs a route based on traffic and/or weather.
[ObradovichML10b] ( * )Obradovich, Michael L.; Pirtle, John D.; Schebesch, Steven W. "Personal Communication System to Send and Receive Voice Data Positioning Information", United States Patent 7,702,455, April 20, 2010
for a hand-held device with a touchscreen, server requests traffic data, and computes a route to avoid traffic problems.
[ObradovichML10c] ( * )Obradovich, Michael L.; Pirtle, John D.; Schebesch, Steven W. "Technique for Effective Navigation based on User Preferences", United States Patent 7,739,039, June 15, 2010
Server responds to GPS/routing request from a cellphone with GPS and touchscreen, sends back route with areas to avoid and points of interest.
[OdomG08] ( * )Odom, Gary "Tool Group Manipulations", United States Patent 7,363,592 B1, April 22, 2008
Tool bar re-configures automatically, changing/re-arranging toolbar menu items depending on what tool user has selected and is using most frequently: file contains press reports on patent assertion against Microsoft. See also www.patenthawk.com (filed under Odom): patenthawk.com
[OrdingB08a] ( * )Ording, Bas "List Scrolling and Document Translation, Scaling, and Rotation on a touch-screen display", United States Patent 7,469,381, December 23, 2008
User-interface on touchscreen (or near-touch) for document dragging: when part of document is dragged, expose another part of the document:
02.11.13
also describes "bounce" at end of scroll: Compare with Alternate Reality Kit? Twist gesture to rotate an object or screen. Re-exam document also in file. Bounce-list at end of scrolling on Apple iPod/iPad
[OrdingB10a] ( * )Ording, Bas; Forstall, Scott; Christie, Greg; Lemay, Stephen O. and Chaudhri, Imran "Continuous Scrolling List with Acceleration", United States Patent 7,786,975, August 31, 2010
Scrolling/flick gesture: faster gesture results in faster scrolling: flick-toscroll.
[OrdingB10b] ( * )Ording, Bas; Forstall, Scott; Christie, Greg; Lemay, Stephen O. and Chaudhri, Imran "Portable Electronic Devices with MultiTouch Input", United States Patent 7,812,826, October 12, 2010
multi-touch user interfaces: multi-touch gestures used to adjust parameters e.g. rotate a virtual knob.
[OrdingB10c] ( * )Ording, Bas; Forstall, Scott; Christie, Greg "Methods for Determining a Cursor Position from a Finger Contact with a Touch Screen Display", United States Patent 7,843,427, November 30, 2010
On touch-screen user interface, target a touch to the nearest valid UI object based on position of centroid of touch: example is small keyboard. Compare with Ink targeting, gravity? Compare with Penpoint and W4PC targeting on ink.
[Orgacon09a] ( * )Agfa/Orgacon "Indium Tin Oxide and Transparent Conductor Products", Orgacon.com, 2009
ITO and organic transparent conductive inks for screenprinting: intended for touchscreen electrode market
[OuyangTY09a] ( * )Ouyang, Tom Y. and Davis, Randall "A Visual Approach to Sketched Symbol Recognition", Proc 2009 IJCAI, pp 14631468, Pasadena CA
On-line/dynamic character recognition, but using visual features (OCRlike?) rather than dynamic or time-sequence recognition. Mentions problems of overlapping/touching sketch symbols and gestures. States that recognizer is rotationally invariant (so what about M and N, E and 3, S and Z, etc.?) Does not describe recognizing handwriting: electrical symbols, powerpoint symbols, etc. File constains additional references for sketch recognition for mechanicalengineering, to 2003
[OuyangTY09b] ( * )Ouyang, Tom Y. and Davis, Randall "Visual Recognition of Sketched Symbols", IUI 2009 Workshop on Sketch
02.11.13
Recognition, Feb. 8 2009, Sanibel Island, FL

OCR-type recognition, mentions doun-sampling of images prior to classifier. See other Ouyang papers. States superior to Graffiti, which requires constrained writing. (Unistroke)
[OuyangTY09c] ( * )Ouyang, Tom Y. and Davis, Randall "Learning from Neihboring Strokes: Combining Appearance and Context for MultiDomain Sketch Recognition", Advances in Neural Information Processing, 2009, pp. 1401-1405
Recognition of clusters of squiggles and angles in a sketch as an indication that the strokes should be parsed together in one object
[OxfordEnglishDictionary10a] ( * )Oxford English Dictionary "Oxford English Dictionary", www.oed.com, fetched 2010
Definitions of select terms. gesture (with motion), pointer (computer address; screen symbol), stylus (pointer or finger)
[Palm08a] ( * )Unknown "Die Palm Pilot History", Posted on scribd.com and handheld.vn, 2008
Compendium of over 100 handheld devices up to 2008 running Palm OS 5.0 on PalmPilot type models, with hardware specifications
[Palm09a]
( * )Palm
"Palm Pre Benutzerhandbuch", Palm Inc, 2009
User guide (in German) for Palm PRE hand-held touchscreen PDA
[ParkesA08] ( * )Parkes, Amanda; Poupyrev, Ivan; and Isshi, Hiroshi "Designing Kinetic Interactions for Organic User Interfaces", Communications of the ACM, June 2008, Vol 51 No 6; pp 58-ff.
Organic user interfaces / tangible user interfaces: combination of physical input and haptic/physical feedback, not specific to gesture input. Reference to three-dimensional mechanical digitizers.
[PatelN08] ( * )Patel, Nilay "MIT reinvents the Post-It note ... with Post-It notes", www.engadget.com, May 1, 2008
press reports on Quickie handwriting notes using what appears to be the Anoto pen, with an RFID tag (?) embedded in the paper. Also Girton Labs Ixp-Note, post-it note sized small digitizer, form factor like a postit note. Prototype of DPF711K, touch-screen small size with a post-it note sized display from Audiovox, along with Audiovox Digital Message Center. Sony E- Series display/touchscreen digitizer for taking notes.
[PatelPredd09] ( * )Patel-Predd, Rachel "The Trouble With Touch Screens", IEEE Spectrum, January 2009, pp 11-12
touchscreens and digitizers using indium tin oxide ITO: indium is scarce
02.11.13
resource, alternatives are antimony tin oxide, carbon nanotube, flexible polymer PEDOT
[PeltonenP08a] ( * )Peltonen, Peter; Kurvinen, Esko; Salovaara, Antti; Jacucci, Giulio; Ilmonen, Tommi; Evans, John; Oulasvirta, Antti; and Saarikko, Petri ""It's Mine, Don't Touch!": Interactions at a Large MultiTouch Display in a City Centre", Proc. CHI 2008, April 5-10, 2008, Florence, Italy, pp. 1285-1294
CityWall public multi-touch display in Helsinki: social behaviors among users coordinate use.
[Peregrine10a] ( * )ThePeregrine.com "The Peregrine gaming data glove", ThePeregrine.com, fetched 2010
Electronic gesture data glove, approximately 30 gestures, indented for gaming market. File contains additional materials
[Perttula08] ( * )Pertulla, Drew and McClosky, David "skim text file reader", bigasterisk.com/projects/skim
Text file document read with scrollbar highlighting parts of text in the scrollbar
[Physorg08] ( * )PhysOrg.com "Smart desks make sci-fi a reality in the classroom", www.physorg.com
Durham University in UK, Dr. Liz Burd, Director of Active Learning in Computing: experimental program using multi-touch desk surfaces in education: SynergyNet project of the Technology-enhanced Learning Research Group
[Piquepaille08] ( * )Piquepaille, Roland "Multi-touch smart desks in the classroom", zdnet.com, Sept. 17, 2008
Durham University UK experimental SynergyNet project using multi-touch tablet desks for gradeschool education
[PlasticLogic09a] ( * )PlasticLogic.com "Plastic Logic Reader", Plastic Logic.com, 2009 ff

File on Plastic Logic Reader, electronic ink display with touch-sensitive touchscreen interface: swipe gesture to turn pages.
[PlatzerA10a] ( * )Platzer, Andrew and Herz, Scott "Application Programming Interface for Scrolling Operations", United States Patent 7,844,915, November 30, 2010
API to set parameters for scroll bounce
[Plawa10a] ( * )Plava Feinwerktechnik GmbH "Scrivo.1 product information", Plawa.com, fetched 2008, 2010
02.11.13
Optical mouse in a pen-shapped barrel. Newer model includes audio recording: compare with LiveScribe and FingerSystem.
[PluchinoA09a] ( * )Pluchino, A; Rapisarda, A.; Garofalo, C; "The Peter Principle revisited: a computational study", Presentation: Econophysics Colloquirum 2009, Centro Ettore Maiorana Erice, Italy, Oct. 25-31, 2009
Game-theory Mathematical model of overcoming Peter Principle (individuals are promoted until they reach a position they are not competent at, and then stay there: thus organizations tend to have managers who are not competent at their job) by promoting people at random. Cites also to 2010 paper with same title, Physica A 389 (2010) 467
[PocketCalculatorShow10a] ( * )PocketCalculatorShow "Seiki Computer Watch Fun", PocketCalculatorShow.com, fetched 2010

Variety of Seiko computer/calculator watches. RC-20, circa 1985, buttonless touchscreen input with 42x32 pixel display, graphical icons
[PolssonK09] ( * )Polsson, Ken "Chronology of Personal Computers", Posting at www.islandnet.com

Timelines of history of personal computers, back to 1947. Windows for Pen Computing and GO/PenPoint both accounced January 1991.
[PositiveSystems10a] ( * )Positive Systems Inc. "POSey POS Point Of Sale product information", www.pos-ey.com fetched 2010
POS system for DOS/Windows95 and later using modified MicroTouch unMouse touch screen to replace mouse. File contains additional information.
[ProbertML10a] ( * )Probert, Matt and Probert, Leela "Research Results for 'SideKick'", www.probertencyclopaedia.com, fetched 2010
Borland SideKick phone dialer dials a phone number found anywhere on the DOS screen: it didn't need to be in SideKick mode
[Qomo09] ( * )Qomo HiteVision LLC "Qomo HiteVision QIT 30 product literature", Qomo HiteVision LLC, www.qomo.com
Untethered electromagnetic digitizer, multiple tablets may be used wirelessly to annotate on a common shared whiteboard display
[QuinnM08] ( * )Quinn, Michelle "Women put a finger on an iPhone problems", Los Angeles Times, June 16, 2008
Apple iPhone touch-sensitive digitizer does not work for women with long fingernails, or with gloves. Described tongue-in-check as accessibility problem.
[Radivojevic08]
( * )Radivojevic,
Zoran; Zou, Yanming; Wang, Kong

53/74
02.11.13
Qiao; Takala, Roope Tapio; Lantz, Vuokko Tuulikki; Lehtiniemi, Reijo; Rantala, Jukka Ilmari; and Vatanparast, Ramin "Apparatus, Methods and Computer Program Products Providing Finger-Based and Hand-Based Gesture Commands for Portable Electronic Device Applications", United States Patent Application US 2008/0005703 A1, Junary 3, 2008
Nokia: In-air finger and hand gestures in front of a PDA or cell phone: describes a sonic/sonar digitizer for detecting hand gestures close to the device, but also mentions electrostatic/capacitive and optical hardware, generally relates to use of in-air hand and finger gestures, not the hardware. Mentioned in other references as multi-touch.
[RantalaJ09] ( * )Rantala, Jussi; Raisamo, Roope; Lylykangas, Jani; Surakka, Veikko; Raisamo, Jukka; Salminen, Katri; Pakkanen, Toni; and Hippula, Arto "Method for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback", IEEE Trans. on Haptics, Vol 2 No 1, Jan 2009, pp 28-39
Abstract only, additional materials in file: Vibrating touch screen puts Braille at the fingertips: rhythmic haptic encoding of braille characters similar to Morse code; haptic/tactile display of braille on a touchscreen/multi-touch surface
[RapidRepair10a] ( * )RapidRepair.com "iPad Repair Guide: Stay tuned for a shocking tear down of the new Apple iPad", www.rapidrepair.com, fetched 2010
Disassembly of Apple iPad: shows separate front-mounted digitizer with transparent screen.
[RayJ10a] ( * )Ray, Jim "SAGE: Cold-War Forerunner to the Information Age", Available on eskimo.com
SAGE system: information on light gun
[RekimotoJ08a] ( * )Rekimoto, Jun "Organic Interaction Technologies: From Stone to Skin", CACM, June 2008, Vol 51 No 6, pp. 38-44
Special issue on organic/graspable/haptic/tangible user interfaces. Deformable/rollable input devices, as SmartSkin, PreSense (pressuresensing touchscreen surface -- see elastomeric touchscreens?). Examples include HoloWall -- compare with Wellner?
[RekimotoJ09a] ( * )Rekimoto, Jun "SenseableRays: Opto-Haptic Substitution for Touch-Enhanced Interactive Spaces", Proc. CHI '09, April 4-9, 2009, Boston, MA, pp. 2519-2528
"passive" 3D/2D tactile feedback, without direct position sensing. Instead, just an optical receiver on a finger-mounted sensor/vibrator that picks up
02.11.13
time-modulated light (or infrared) projected by rays on a location on a surface, and vibrates in response to the light beam projected to that particular spot. 3D by using two light sources.
[ReynaA09] ( * )Reyna, April S. "Multi-touch Technology", www.wiziq.com, June 6 2009

Internet posting of review of multi-touch technology: Perceptive Pixel, Apple, Microsoft Surface (infrared), Apple iPhone
[RichterH10a] ( * )Richter, Hendrik; Ecker, Ronald; Deisler, Christopher; and Butz, Andreas "HapTouch and the 2+1 State Model: Potentials of Haptic Feedback on Touch Based In-Vehicle Information Systems", Proc. 2nd Int'l Conf. on Automotive User Interfaces and Interactive Vehicular Application, AutomotiveUI 2010, Nove 11-12 2010, Pittsburgh, PA. pp 72-79
Tactile/Haptic feedback on a touchscreen in an Automotive map userinterface: also tracks finger in proximity, or when not touching firmly. Application of Buxton 3-state model: Out-Of-Range on proximity, active tracking (a.k.a. passive tracking, and pressed.
[RichterPJ08a] ( * )Richter, Paul J.; Cairnes, Darran R.; and Bottari, Frank J. "Antiglare Coating and Particles", United States Patent Application 2008/0014340 A1, January 17, 2008
Antiglare coating for touchscreens: silica particles in inorganic polymer matrix.
[RicksTK10a] ( * )Ricks, Theodore K; Burberry, Mitchell S.; and Johnson, David M. "Touch Input Device with Display Front", United States Patent Application 2010/0020039 A1, January 28, 2010
Using flexible display (polymer-dispersed imaging layer), put display in front of pressure-sensitive touchscreen (spacing dots, resistive), so that touchscreen does not reduce visibility of display. Says resistive-film touchscreens with spacer dots have 75% transparency, ITO capacitive typically 90%. Touchscreen may be opaque.
[RobbinsDC08a] ( * )Robbins, Daniel C; Sarin, Raman K;, Horviz, Eric J.; and Cutrell, Edward B. "Advanced Navigation Techniques for Portable Devices", United States Patent 7,327,349, February 5, 2008
Browsing or scrolling a document (such as a map) using a virtual semitransparent overlay over the image of the document: like moving a magnifying lens?
[RohrabaughGB08a]
( * )Rohrabaugh,
Gary B. and Sherman, Scott A.

55/74
02.11.13
"Scalable Display of Internet Content on Mobile Devices", United States Patent 7,461,353, December 2, 2008
Convert HTML layout to resolution-independent vector display-list form, for better rendering on small (handheld/smartphone) displays.
[RosenbergI09a] ( * )Rosenberg, Ilya; Grau, Alexander; Hendee, Charles; Awad, Nadim; and Perlin, Ken "IMPAD - An Inexpensive MultiTouch Pressure Acquisition Device", Proc. CHI 2009, April 4-9, 2009, Boston, Mass. pp. 3217-3222
Force/pressure sensitive touchpad/tablet using elastomeric material (conductive rubber: force decreases resistance) between perpendicular matrix layers of conductor lines. Effect is grid of force/pressure FSR forcesensitive-resister points whose sensing areas overlap and fall off with distance. Interpolation to get higher resolution of single points, or detect multi-touch points.
[RosenbergI09b] ( * )Rosenberg, Ilya; Perlin, Ken; Hendee, Charles; Grau, Alex; and Awad, Nadim "The UnMousePad - The Future of Touch Sensing", Proc. SigGraph '09, August 3..7, 2009, New Orleans
Multi-touch touchpad using force variable resistors with interpolation (IFSR) to get position resolution finger than minimum discrimination distance for multiple touches (like human skin). Described as touch imaging technology.
[RosenbergLB09a] ( * )Rosenberg, Louis B. and Riegel, James R. "Haptic Feedback For Touchpads and Other Touch Controls", United States Patent 7,592,999, September 22, 2009 (See also 8,031,181, 8,059,105)
Haptic force feedback transducer/actuator mounted on back surface of touch surface or tablet, which is mounted on springs to allow motion.
[RoudautA09a] ( * )Roudaut, Anne; Lecolinet, Eric; and Guiard, Yves "MicroRolls: Expanding Touch-Screen Input Vocabulary by Distinguishing Rolls vs. Slides of the Thumb", Proc. CHI 2009, April 4-9 2009, Boston, Massachusetts, pp. 927-936
Gesture based on rolling of thumb instead of sliding of thumb. Six microroll gestures (four directions, two circular) four slide gestures (direction) four swipe gestures (direction) two diagonal rubbing (rubout) gestures. Instead of marking menus, etc.
[RoudautA10a] ( * )Roudaut, A.; Baudisch, P.; Holz, C.; and Becker T. "The 15 Euro designer multitouch pad: ", Hasso Plattner Institut: Seminar at ITS '10, materials available at www.anneroudaut.fr/fun/acrylicpad.html
02.11.13
How to construct a multitouch FTIR optical digitizer using easily-available parts at home in your spare time. Acrylick sheets with webcam camera underneath. Recommends spraying surface with silicone lubricant to get better detection (better optical contact and reflection). Includes video showing both operation and construction.
[RutschmannD09a] ( * )Rutschmann, Dirk and Josten, Marcus "Method and System for Detecting the Three-Dimensional Shape of an Object", United States Patent 7,489,813, February 10, 2009
Single camera, determine shape of an an object form multiple views. Object has photogrammetrically evaluable marks (targets). Uses marks on floor (surface) at known locations, object at known position, so that no scale reference object needed. Example is special pants/trowsers/clothing with marks on human body. Compare to Chen 2009 and structure-throughmotion.
[SafferD08] ( * )Saffer, Dan "Interactive Gestures: Designing Gestural Interfaces", O'Reily Press, 2008
General tutorial book on gestural interfaces including motion gestures such as Wii, hand-gestures, eye-winks, body motions, multi-touch from Fingerworks and iPhone. Mentions "the Clapper" as a gestural interface with indirect manipulation. First multi-touch device in 1982. Refers to gestures as motions of the human body.
[Samsung10a] ( * )Samsung "Galaxy Tab Tablet Mobile Product Information", www.samsungmobile.com, Dec 2010
Samsung Galaxy Tab mobile tlabet device, includes Flash, android operating system. File contains additional material.
[SchmidtD10a] ( * )Schmidt, Dominik; Chehimi, Fadi; Rukzio, Enrico; and Gellersen, Hans "PhoneTouch: A Technique for Direct Phone Interaction on Surfaces", Proc UIST '10, October 3-6, New York City, USA, pp. 1316
Use input of smart phone such as iPhone (inertial input, keys, etc.) long with input from touch surface (simulated with video detection) as user input.
[SchoeningJ09a] ( * )Schoening, Johannes; Krueger, Antonio; and Olivier, Patrick "Multi-touch is dead; Long live multi-touch", Proc. CHI 2009, April 2009, Boston
Opinion piece on multi-touch having a 25 years history before Jeff Han and the iPhone from Apple, many designs not taking into account 25 years of HCI lessons learned (esp. Buxton)
02.11.13
[Schweibenz09] ( * )Schweibenz, Eric. W. "eInstruction Corporation Files New 337 Complaint Regarding Certain Collaborative System Products", Press Release, LexisNexis, July 13, 2009
eInstruction whiteboard system using wireless tablets, versus importer Qomo Hitevision of wireless tablets, contributory infringement
[SchweitzerB10a] ( * )Schweizer, Bobby "How You Should Guage the Quality of a Touchscreen", www.tested.com, November 12, 2010
overview article on touchscreen products with short notes on multi-touch history, apparently taken from www.buxton.com. States taht "flick" gesture first implemented in 1999: compare with PenPoint flick gestures in 1991?
[SchwesigC08] ( * )Schwesig, Carsten "What makes an Interface feel Organic?", Communications of the ACM, June 2008, Vol 51 No 6; pp 67ff.
Organic user interfaces / tangible user interfaces: Gummi flexible display, can be bent as a form of gesture input (for zoom) combined with touchpad / touchscreen sensing. Bending force determines how fast it zooms.
[ScottJ10a] ( * )Scott, James; Izadi, Shahram; Rezai, Leila Sadat; Ruszkowski, Dominika; Bi, Xiaojun; Balakrishnan, Ravin "RearType: Text Entry Using Keys on the Back of a Device", Proc. MobileHCI 2010, September 7-10, 2010, Lisbon.
User interface with physical keyboard on rear of hand-held (two hands) display: compare with LucidTouch
[SensAble09] ( * )Sensable Technologies "Haptic Devices and Toolkits for Haptic Application Development", www.sensable.com
Product information on hand input devices with haptic force feedback: mechanical linkages. Force/touch effects include constant/gravity, viscosity, 3D friction, spring, friction, siffness, damping, front/back faces of virtual objects.
[ShannonMM08] ( * )Shannon, Meg McGinity "This Menu has changed: Innovative interfaces will give wireless the golden touch", Communications of the ACM, May 2008, Vol 51 No 5, pp 19-21
Essay on multi-touch interfaces, gesture with iPhone. Jeff Han cited as multi-touch. GestureTek video gesture recognition -- GestureTek in business since late 1980s.
[ShenE09a] ( * )Shen, Ehr-li (Early); Tsai, Sung-sheng (Daniel); Chu, Hao-Hua "Double-side Multi-touch Input for Mobile Devices", CHI 2009, April 2009, Boston MA, pp. 4339-4344
02.11.13
Multitouch touchpanel on back/rear of PDA/iphone so that display is not obscured. Multi-touch gestures (e.g. two-finger "grab"), fingertip positions displayed with small cursors on front display. Also double-side input multitouch gestures on both sides at same time.
[ShermanE09] ( * )Sherman, Erik "Can Apple's MultiTouch Patent Withstand Scrutiny - or Challenge?", BNET Technology Insights, Feb 6th 2009: www.bnet.com
Review of published patent application relating to iPhone/Fingerworks touch gestures
[Shneiderman10a] ( * )Shneiderman, Ben and Plaisant, Catherine "Designing the User Interface: Strategies for Effective Human-Computer Interaction, 5th Edition", Addison-Wesley, publishers 2010
University textbook on computer-human interaction - Earlier editions 1987, 1998. Discussion of direct manipulation, with Microsoft Office as an example -- direct manipulation because you have WYSIWYG behavior in the document, not because it is a tangible user interface. One chapter on input devices talks about pointing/digitizer input, Graffiti, some use of gestures. Earlier editions go back to 1986.
[SimaSystems08a] ( * )SiMa Systems, Inc. "SiMa Systems Product Development Platform (PDP) for multi-touch/dual force (MT/DF) touchscreen sensor.", SiMa Systems, Inc., March 2008
pressure/force-sensitive (?) resistive multi-touch touch sensor: Multiple Simultaneous Touch Activation, user presses harder to activate, stylus recognized by smaller contact area. microTILE electronics for reference design. Electronic file contains additional information.
[Smart10a] ( * )SMART Technologies "SMART Technologies Inc. PROSPECTUS", www.smarttech.com

SMART board interactive whiteboard digitizers, with digital ink: Prospectus for public offering
[Spiegel09a] ( * )Der Spiegel "Apples neue Maus hat keine Tasten", Der Spiegel, Germany: October 20, 2009
multi-touch mouse has no wheels or buttons: uses a touch surface.
[Spiegel10a] ( * )Der Spiegel "Warum viele Blinde das iPhone lieben", Der Spiegel, Germany: October 17, 2010
Review of VoiceOver for iPhone: refers to gesture input on touchscreens has being the solution for visually-impaired/blind computer access
[Spiegel10b]
( * )Der
Spiegel "Cebit vor zehn Jahren: Ipad-Opa und

59/74
02.11.13
Bluetooth-Waschmaschinen", Der Spiegel, Germany: Feb 28, 2010

Mentions skeye.pad webpad tablet computer at Cebit 2000 about the time of the Tablet PC introduction by Microsoft: Wireless connection, Webpanel, touchscreen interface with browser.
[Stantum09a] ( * )Stantum.com "PMatrix: The unparalleled Multi-Touch detection firmware", www.stantum.com

Formerly known as JazzMutant / Lemur. Resistive-grid multi-touch detection using X/Y addressable nodes in a grid pattern, notes that it works with any touch stylus, unlike capacitive digitizer. Includes gesturerecognition software for pinch, twist, rotate, close, zoom gestures. Mentions bounce on scroll action, similar to iPhone/iPad?
[Stantum09b] ( * )Stantum.com "Unlimited multi-touch", www.stantum.com

Resistive-grid multi-touch detection using X/Y addressable nodes in a grid pattern, notes that it works with any touch stylus, unlike capacitive digitizer.
[Stantum09c] ( * )Stantum.com "Stantum adds Finger-Pressure Detection to Its Patented PMatrix Multi-Touch Detection Platform", www.stantum.com
pressure/force-sensing multi-touch resistive touchscreen digitizer.
[Stantum10a] ( * )Stantum.com "Stantum Unlimited Multitouch: How it Works", www.stantum.com

Capacitive multi-touch that can detect both fingers and stylus (passive) at same time: apparently by size of contact/detection area?
[StewartWM09a] ( * )Stewart, Walter Mason; Carrera, Marcelo; and Hook, Robert G. "E-Mail Virus Protection System and Method", United States Patent 7,506,155, Marcy 17, 2009
Filter Email for virus detection by executing program on another computer to check before sending to email recipient: send recipient converted file (e.g. PDF) instead. Virus is assumed to be executable code.
[StuerzlingerW08a] ( * )Stuerzlinger, Wolfgang and Wingrave, Chadwick A. "The Value of Constraints for 3D User Interfaces", Proc. Virtual Realities: Dagstuhl Seminar 2008, Uni. Trier, Germany, pp. 203..224
Review of 3D input and 3D display in consumer-level systems: Perspective and occlusion more important than stereoscopic display. 2D touchscreens better than existing 3D input devices, mostly because of accuracy and precision of the device. Additional references on 3D input with similar devices.
02.11.13
[Sobell08a] ( * )Sobell, Mark G. "A Practical Guide to Red Hat Linux, Fourth Edition.", www.sobell.com/RH4 (author publication)
Definition Input Focus. The input focus specifies the window that receives keyboard input.
[SuehleR10a] ( * )Suehle, Ruth "Five open source alternatives to the iPad", opensource.com, 4 Apr 2010
web tablets, open source: Neofonie WePad with Android OS, TouchBook, iFreeTablet, MSI Taiwanese tablet with Android, Asus / Asusteck Eee Pad, rumored Google Tablet.
[SutantoH10a] ( * )Sutanto, Herry; Spencer, Richard L; Landstad, Todd M.; Bhattacharyay, Subha; Wang, Haiyong; and Jones, F. David "Controlling Multiple Map application Operations with a Single Gesture", United States Patent 7,752,555, July 6, 2010
Using feature points/characteristics of a gesture in carrying out the operation of the gesture: characterizes this as performing multiple operations. Examples include endpoints and apex point of a checkmark. Compare with using single or multiple hotpoints of a gesture?
[Synaptics08a] ( * )Synaptics Inc. "Synaptics RMI3 Interfacing Guide", Synaptics Inc. 2007/2008
Synaptics capacitive-grid touchpad hardware controllers: Devices support MultiFinger (multi-touch) detection (report count of fingers), Enhanced gestures (multi-finger pinch and zoom).
[Synaptics10a] ( * )Synaptics Inc. "Synaptics RMI4 Interfacing Guide", Synaptics Inc. 2010
Synaptics capacitive-grid touchpad hardware controllers: Devices support NumberOfFingers detection (report count of fingers) with additional position registers for each finger position, TouchShapes contoured special areas on tablet.
[Tabletized09] ( * )www.tabletized.com "Journey to the beginning of Tablets. The Apple Newton.", www.tabletized.com, fetched 2010
History of Newton development: Walter Smith developer of NewtonScript object-oriented programming language. Original price for Newton Toolkit was $1000. Developers of Newton Toolkit: Norberto Menendez, Ben Sharpe, Peter Potrebic. Appears to be copy of Wikipedia article on Newton (platform).
[TappertCC10a] ( * )Tappert, Charles C. "Example of Historical Research: Palm v. Xerox Patent Infringement Lawsuit", Course
02.11.13
presentation, Seidenberg School of CSIS, Pace University, NY, January 1, 2010

Personal record of expert-witness analysis concerning Xerox Unistroke handwriting recognition patent in Palm. v Vexor patent suit. Prior-art research lead to limiting of claims, and thus to a settlement. Interesting record of how prior-art research is done.
[TaubDM09a] ( * )Taub, Daniel Matthew "The BoPen: A Tangible Pointer tracked in Six Degrees of Freedom", Master's Thesis, EECS/MIT, August 21, 2009
Light-pen-like device using projected barcode pattern, projector uses switchable diffuse/clear surface that can project onto the surface and also see objects above the surface. Credits Doug Englebart with first GUI graphical user interface. Cites to this bibliography and to this collection by name "which made my related works section both more interesting and immensely more timeconsuming", with thanks to Jean Renard Ward
[TechHotSpot10a] ( * )Unknown "Pen Computing", www.iturls.com/English/TechHotspot/TH_pen.asp

Compendium of URL links to pen computing, lists this reference. Terminology: uses Diagram Recognition for Sketch Recognition, includes several Chinese commercial handwriting recognition / pen-computing links.
[TechNet10a] ( * )TechNetYes.blogspot.com "The Windows PC ClickPad finally improved? Synaptics ClickPad IS Series 3 preview", technetyes.blogspot.com/2010/11/engadget-news_19.html, November 2010
Synaptics ClickPad 3 touchpad with ACM accidental contact mitigation. Shows configuration for optional multifinger (multi-touch) gesture: twofinger scrolling, pinch zoom, rotating, three-finger press / flick, four=-finger flick, scrolling (at edge?), tapping, clicking (separate?), etc.
[TechnologyReview08a] ( * )Technology Review "Mouse for 3-D Navigation; Do-It-Yourself Multitouch Display", TechnologyRview, July/August 2008, page 30
SpaceNavigator 3-D mouse, www.3dconnexion.com -- six-degrees-offreedom joystick-like input device. nortd.com TouchKit -- open-source multitouch table input tablet, apparently optical
[TheEngineer08a] ( * )The Engineer "Magic touch", www.theengineer.co.uk, July 28, 2008

02.11.13
Review of some touch-screen and haptic technologies (seems to confuse "haptic" with "touch-input"). Roope Takala, Haptikos project at Nokia. Christophe Ramstein, Immersion corporation. Gary Todd, Virtual Veins. Mark Williams, Warwick Manufacturing Group (WMG), UK. iPhone.
[ThreeDconnexion08] ( * )3dConnextion "Perfekter Begleiter fr Globe Strotter: 3Dconnexion stellt SpaceNavigator fr Notebooks vor", www.3dconnexion.de
Press release for SpaceNavigator, three-dimensional mouse pointing device, using force/pressure for up and down, also rotation.
[TIPB10a] ( * )TIPB.com "New Gesture in iPhone SDK 3.2 for iPad", tipb.com, March 10, 2010
Additional gestures for iPhone: Pinch-in/out/mix, Rotate-(anti)clockwise, 3Tap, etc.
[ToepkeMG08a] ( * )Topeke, Michael G.; Blum, Jeffrey R.; and Parker, Kathryn L. "Soft Input Panel System and Method", United States Paten 7,411,582, August 12, 2008
Virtual Keyboard and other devices simulating actual devices by generating system messages same as drivers (e.g. keyboard driver) for physical input devices. SIP Soft Input Panel. Compare with PenCept, The Guide (Wang), PenWindows, other systems with simulated keyboards, including Ken from Wang, Freestyle, Doster/Oed
[Touchco09a] ( * )TouchCo "Touchco IFSR Multi-touch Resistive Sensors", www.touchco.com

Commercial company with touch/pressure sensitive digitizer using IFSR Force-sensitive resistor ink. Electronic file contains additional information on multi-touch resistive technology.
[Touchco10a] ( * )TouchCo "Touch User Interface - Touch Screen and Multi Touch", www.touchco.com
Detailed description of IFSR (ink force-sensing resistor) multi-touch touchscreen: Stantum / Touchco
[TouchInternational09a] ( * )Touch International "Touch International 57B-5-12 Surface Capacitive Controller Specification Guide", Touch International Document 6500292 Rev 1.1, 2009
Five-wire surface capacitive touchscreen: shows wire connection diagram for five-wire interface. For Tablet PCs (Microsoft)
[TouchUserInterface09a] ( * )TouchUserInterface.com "How the Stantum's Resistive Multi-Touch Screen Works",

02.11.13
TouchUserInterface.com, July 18, 2009

Stantum multi-touch resistive grid touchscreen, description from 2007 patent application. Resistive grid with spacer dots, other rows and columns are set to high-impedance state.
[TouchUserInterface10a] ( * )TouchUserInterface.com "Yet Another Thing and Flexible Resistive Multi Touch - SiMa Systems", TouchUserInterface.com, February 11, 2010
SiMa Systems multi-touch resistive grid touchscreen, MT/MF multi-touch multi-fource. Includes "Dynamic home row" virtual keyboard/typing. Comparison with Stantum PMatrix, Peratech QTC quantum tunnelling composite and FSR force sensing resistor.
[Touchtisch08] ( * )Touchtisch Projekt "Touchtisch Ausgabe 01: Erste Erfolge", (in German) Touchtisch Projekt, Brauneggerstrasse 55, Konstanz, Germany, touchtisch.wordpress.com
Student project on touch-sensitive interface, using in part a Wii hardware digitizer and Flash (software) on a MAC.
[TyphoonTouch09] ( * )Typhoon Touch Technologies "Typhoon Touch Technologies, press information", www.typhoontouchtechn.com
Licensing company for two patents (see CloughWA) relating to application generators for tablet/pen computers. Company originally formed to distribute MP3 files. Press reports on settlements with Electrovaya, Motion Computing. See also Nova Mobility (product partner). EDGAR report states that original purpose of company was to sell MP3s on-line, acquired patents from Nova Mobility Systems. See file folder for patent information.
[UyM09a] ( * )Uy, Michael "Integrated Sensing Display", United States Patent 7,535,468, May 19, 2009
Optical sensors (e.g. CCD imaging) integrated into display panel (e.g. LED). Applications include two-way video with user eye contact directed in same direction as camera, versus separate webcam camera mounted on top. Compare to in-cell optical technologies for touchscreens.
[vanMensvoortK09a] ( * )van Mensvoort, Koert Martinus "What You See is What You Feel", Eindhoven University of Technology, 2009, ISBN: 978-90-386-1672-8
PH.D. Thesis on haptic touch user interfaces. Force-feedback, mechanically simulated or optically simulated (via cursor displacements) or via animation of stickiness. Changing cursor cited to 1988 for WIMP interfaces. Dynamic cursor invented 1968 by Engelbart. References to force-feedback back to 1990.
02.11.13
[ValePO08a] ( * )Vale, Peter O. "Browser Navigation for Devices with a Limited Input System", United States Patent 7,454,718, November 18, 2008
Automatic user interface behavior of scroll, move to next field/element, or enter data using cursor keys (forward,down, etc.) for small display with small keyboard (smartphone)
[VertegaalR08a] ( * )Vertegaal, Roel and Poupyrev, Ivan "Organic User Interfaces", CACM, June 2008, Vol 51 No 6, pp. 26-30
Introduction to special articles on organic/graspable/haptic user interfaces. Credits Alan Kaye (indirectly) for inspiring the Tablet PC. Deformable/rollable input devices, such as paper that can be bend or folded.
[VilppulaM09] ( * )Vilppula, Matti; Mattila, Arto; and Niemi, Markku "Method and Device for Position Determination", United States Patent 7,558,696
Handheld mobile (cellphone) device using GPS and other means for determining geographic position, API picks available means/method that meets accuracy requirements specificed via the API
[VogelD10a] ( * )Vogel, Daniel "Direct Hand Input and Hand Occlusion", Ph.D. Dissertation, U. Toronto Dept. of Computer Science, 2010
Hand occlusion for pen input: points out problems of that pen / handwriting / gesture recognition is used with legacy/existing software. Pen input faster than pointing with a mouse -- compare with observations on Windows for Pen Computing and GO/PenPoint in early 1990's.
[VogelD10b] ( * )Vogel, Daniel and Balakrishnan, Ravin "Direct Pen Interaction With a Conventional Graphical User Interface", Human Computing Interation, 2010, Vol 25, pp. 324-388,
Test of Tablet PC user interface (Microsoft Windows) with conventional mouse UI. Problems are poor precision with tapping and dragging, hand occulsion, hand instability, gorilla-arm fatigue, hand fatigue, difficulty moving to keyboard, difficulty with small targets/menus/icons, and lack of additional mouse buttons or roller. Based on Vogel Ph.D. Thesis. Various citations to Ward/Philipps 1987 paper.
[Walkenbach08a] ( * )Walkenbach, John "Lotus 1-2-3 Release History", j-walk.com/ss/123/index.htm

History of Lotus 123 Release dates: First Windows (non-DOS) version in 1991, Lotus 1.0 for Windows. Via Voice speech voice recognition added in
02.11.13
1998.
[Walkenbach08b] ( * )Walkenbach, John "Excel 2007: Where It Came From", "Excel 2007 Power Programming with VBA", Wilely.com: jwalk.com, Chapter 1 Excerpt
Release and development history of Excel spreadsheet program: cites provenance from VisiCalc available at www.bricklin.com; Lotus 1-2-3
[WalkerG09a] ( * )Walker, Geoff "LCD In-Cell Touch", Tutorial Session, NextWindow Optical Touch, SID November 17, 2009
Tutorial on integrated in-cell LCD display/touchscreen technologies: Lightsengins, capacitive-sensing, switch-sensing (resistive/voltage). Optical: problems if black display / no ambient light. States Multi-touch from 1982, pinching gestures from 1983. Asserts capacitive cannot sense stylus (?).
[WalkerG09b] ( * )Walker, Geoff "touch Technologies tutorial", Tutorial Session, NextWindow Optical Touch, SID October, 2009
Tutorial on touchscreen technologies: covers multi-touch, force sensing (Vissumo). Vissumo force sensors at edges of display, not at corners. Software solution to "occlusion" problem for multi-touch.
[WalkerG10a] ( * )Walker, Geoff "Touch Technologies Tutorial", walkermobile.com, last update of April, 2010
Tutorial on touchscreen techologies. Haptic feedback. Distinguishes Touch Screens (passive) from Active Digitizers. Flexible displays. Non-multi-touch: analog resistive, Surface Acoustic Wave (SAW) Surface Capacitive (electrostatic), Traditional infrared (IR), EMR Electromagnetic Resonance, APR Acoustic Pulse Recognition, DST Dispersive Signal Technology, Force sensing (Vissumo). Multi-touch: Projected capacitive, LCD In-Cell (Optical, Switch, Capacitive), Optical, digital resistive, Waveguide infrared (RPO), Vision-base optical (e.g. includes FIR/FTIR). Figures on major vendors, market share. Alternative materials to ITO. No treatment of electromagnetic, acoustic/sonar, or Anoto pattern, as in Feb 2010 version? Covers Wacom EMR, RPO Waveguide infrared optical: waveguide layer on top of display. Circular polarizers to reduce visual reflections. Formulae for anti-glare non-smooth hardcoat surface coatings, anti-smudge hydrophobic coating, contrast ratio, anti-Newton's-rings,
[WalkerG10b] ( * )Walker, Geoff and Gregg, Abbie "Fundamentals of Touch Technologies and Applications", Tutorial session, SemiCon West, July 14, 2010
Excerpt of Tutorial on touchscreen techologies. Continuous ITO film/sheet: analog resistive, surface capacitive. Multi-Touch. Touch technologies with patterned ITO: analog multi-touch
02.11.13
resistive, projected capacitive, embedded on-cell and in-cell. Manufacturing processes e.g. photolithography Without ITO: Acoustic Pulse Recognition / APR; Dispersive Signal Technology / DST; Materials and Process 5: Etch; Surface Acoustic Wave / SAW; Waveguide Infrare / RPO; Optical; Force Sensing; Vision-Based; Electromagnetic resonance (EMR) multitouch tablets; ITO replacement materials (redacted): sub-micron metal mesh, silver (Ag) nanowires, carbon nanotubes, magnesium hydroxide, conductive polymer No treatment of electrostatic stylus, acoustic/sonar, or Anoto pattern?
[WalkerG10c] ( * )Walker, Geoff and Fihn, Mark "Frontline Technology: LCD In-Cell Touch", Information Display Vol 3 No 10, March 2010, pp. 814
Touchscreens with touch sensor physically integrated into display: Cites to 2007 SIGGRAPH publication. In-Cell generally projected capacitive (X/Y grid matrix), analog resistive, or digital resistive: light/optical sensors in display. One use is touchpad on laptop (not touch display) with displayable icons in touchpad.
[WangF09a] ( * )Wang, Feng and Ren, Xiangshi "Empirical Evaluation for Finger Input Properties In Multi-Touch Interaction", Proc. CHI '09, April 7, 2009, Boston MA 1063-1072, Session "Tabletop Gestures"
Determine shape of contact of fingertips on tablettop digitizer (FTIR optical). Vertical contact and horizontal contact touch gestures, determine direction of finger from oval shape, gestures using intersection of two pointing fingers to get active point, rocking gestures. Use of pointing to reduce occlusion problem, directional sector (radial) menus.
[WardM10a] ( * )Ward, Mark "Skin becomes gadget control pad", BBC News, March 26, 2010
Skinput: acoustic digitizer mounted on arm: must learn/be trained to recognized characteristic sound of tapping on different parts of the skin surface.
[WareWH08a] ( * )Ware, Willis H. "RAND and the Information Evolution: A History in Essays and Vignettes", RAND Corporation corporate publication series, 2008
Personal history of RAND Corporation. States that RAND tablet was first operational digitizing tablet, 10-inch flat surface with free-pen stylus. Later printed-circuit version was 36 inces by 36 inches. Supported by JOHNNIAC project, also Videographic System to integrate characters and graphics (video) in same display, used for (electronic ink / gesture) annotation of maps with text. Saved user actions to reconstruct image
02.11.13
rather than saving bitmap. Dictionary (stroke order) look-up to recognize handwritten Chinese characters. BIOMOD graphical user interface to construct biological models. First version of RAND tablet was electromechanical (reversed flatbed plotter), then woven grid of Formex wires with distinct signal on each wire: 0.1" resolution. Final version used (new at the time) PCD with 0.01" resolution, still unique signal on every conductor. Notes that users quickly adjusted to separate tablet and display. 100 data points/second, with filtering, stroke identified (handwriting recognition) of features relative positions of strokes, stroke directions, corners, end-point location, and context (1 vs I? 0 vs O?) History of GRAIL project (later BIOMOD and CLINFO). GRAIL was automatic recognition of gestures and characters for system flowcharts. BIOMOD graphical language for construction system models.
[WeisbergDE08a] ( * )Weisberg, David E. "The Engineering Design Revolution: The People, Companies and Computer Systems That Changed Forever the Practice of Engineering", David E. Weisberg, 2008. Available at www.cadhistory.com
History of CAD/CAM history. Chapter 7: Applicon. Gesture UI of Applicon CAD/CAM system known as pattern recognition command entry/ Tablet Symbol Recognition / sketching a pattern with a stylus. User could define new patterns/gestures. Circle/lasso gesture to select and zoom, dothoriztonal and dot-vertical for dimension lines. Gestures more clumsy with a mouse when implemented on Macintosh as MacBRAVO!. Ken Ledeen (Ledeen Recognizer) at ComputerVision in 1985.
[WestermanWC08] ( * )Westerman, Wayne Carl; Lamireaux, Henri; and Dreisbach, Matthew Evan "Swipe Gestures for Touch Screen Keyboards", United States Patent Application Publication 2008/0316183 A1, December 25, 2008
Swipe gestures by moving finger across keys on (simulated) keyboard touch-screen: compare with 1980's Japanese calculator in collection?
[WestlyE10a] ( * )Westly, Erica "A Layman's Guide to the Tablet PCs of 2010", www.fastcompany.com, January 14, 2010
Review of "slab-form" tablet PCs, including Android and rumored apple iSlate. Lenovo IdeaPad U1 running Linux with multitouch tablet as display portion of Windows PC, Plastic Logic e-reader with multi-touch capacitive digitizer and annotation, dual-screen courier tablet (Microsoft?)
[WhiteJ09a]
( * )White,
Jeremy "Multi-touch Interfaces and Map

68/74
02.11.13
Navigation", Master's Thesis, (Catography and GIS), U. Wisconson/Madison, 2009

Physical design of large rear-projection multi-touch interactive surface (FTIR Frustrated Total Internal Reflection: see Han). Contains review of usability of multi-touch gestures over mouse/keyboard. Describes algorithm for finding "center" of finger-touch blob for pointing.
[WigdorD09a] ( * )Wigdor, Daniel; Leigh, Darren; Forlines, Clifton; Shipman, Samuel; Barnwell, John; Balakrishnan, Ravin; Shen, Cia "Under the Table Interaction", Proc. UIST '06, October 15-18, 2006, Montreux, Switzerland, pp. 256-268
Tabletop touchpad with multi-touch sensors on both top and bottom side of table. Under-the-table can use first-contact selection rather than lift-off, since cursor fully visible, not obscured by finger/hand. Bi-manual/two hands: Under-the-table can also be used at same physical position as hand on top table, but for second display, or on same display. Also useful for simultaneous-input two-person games (e.g. Diplomacy), since hands/moves not visible under table.
[Wikipedia08a] ( * )en.wikipedia.org "Mouse gesture", en.wikipedia.org/wiki/Gesture-based_interface

General reference on mouse gestures: history first mouse gesture (not using a pre-defined shape) was "drag" by Apple to replace a dedicated "move" button on the mouse. Cites lack of feedback to show that the gesture was recognized correctly (showing actual gesture: compare with GO/Agulnick), and visibility to make gestures easy to learn. Cites to Buxton for awkwardness of mouse as a gesture device compared to stylus and tablet digitizer.
[Wikipedia08b] ( * )en.wikipedia.org "Post-WIMP", en.wikipedia.org/wiki/Post-WIMP

Post-WIMP: defines as paper sheet user interface, contrasted to WIMP Windows Icons, Menus, Pointing device user interfacse. See Andries van Dam
[Wikipedia08c] ( * )en.wikipedia.org "Scrollbar", en.wikipedia.org/wiki/Scrollbar

Mentions google chrome browser scroll bar which places highlights/marks in trough of vertical scroll bar to indicate places where term was found that user was looking for in a web page
[Wikipedia08d] ( * )en.wikipedia.org "Wang Laboratories", en.wikipedia.org/wiki/Wang_Laboratories, fetched 2008

02.11.13
Wang Laboratories Freestyle electronic ink/voice whiteboarding and communication desktop system using Hitachi digitizer: has link to Freestyle demonstration video
[Wikipedia08e] ( * )en.wikipedia.org "WIMP (Computing)", en.wikipedia.org, fetched 2008

WIMP user interface: window, icon, menu, pointing device: mentions postWIMP (Andries van Dam)
[Wikipedia10a] ( * )en.wikipedia.org "Handwriting movement analysis", en.wikipedia.org/wiki/Handwriting_movement_analysis

Cites to Teulings and Jean Renard Ward. Mentions early history of peninput devices and handwriting tablets: Scripture 1895 devices for storage of pen positions, McAllister 1900
[Wikipedia10b] 2010 [Wikipedia10c] fetched 2010
( * )en.wikipedia.org
"Xcode", en.wikipedia.org, fetched
Xcode IDE and development tools superceded Project Builder IDE, which was derived from NeXT IDE and tools.
"SideKick", en.wikipedia.org,
Borland SideKick PIM / Personal Information Manager for DOS: included calendar, text editor, calculator, and address book / phone dialer. Over one million copies sold in first three years (starting 1983). Later development done by Starfish Internet Sidekick.
[Wikipedia10d] fetched 2010
"Ken Knowlton", en.wikipedia.org,
Biography on Ken Knowlton: cites to patent 3,879,722 on automatically relabeled keys/button (soft button lables) by projection, graphical flip book from Freestyle at Wan, character/handwriting recognition with Jourjine
[Wikipedia10e] fetched 2010
"Multi-Touch", en.wikipedia.org,
Review article on Muli-Touch: states that 1982 movie "Tron" shows MuliTouch -- compare with Tog's movie?
[Wikipedia10f] ( * )de.wikipedia.org "Gestenerkennung", de.wikipedia.org, fetched 2010

Wikipedia: Gesture recognition. Describes gesture as motion of human body, does not mention pen or tablet gestures. Also on www.spiegel.de
[Wikipedia10g] fetched 2010
"Gesture", en.wikipedia.org,
70/74
02.11.13
Wikipedia: Gesture. Describes gesture as visible body actions communicate particular messages.
[Wikipedia10h] ( * )en.wikipedia.org "Gesture Recognition", en.wikipedia.org, fetched 2010

Wikipedia: Defines gesture recognition as recognizing human (body motion) gestures, not PenPoint-type gestures.
[Wikipedia10i] ( * )en.wikipedia.org "Pointing Device Gesture", en.wikipedia.org, fetched 2010

Wikipedia: Gesture for pen computing. States that "drag" was first gesture on apple Macintosh, involving motion while holding down mouse button.
[Wikipedia10j] fetched 2010
"Pen computing", en.wikipedia.org,
Wikipedia: Pen computing -- contains (lengthy) historical notes going back to 19th century. direct manipulation/ handwriting recognition / gesture recognition. Absolute/relative pointing/locator input.
[Wikipedia10k] fetched 2010
"Pie menu", en.wikipedia.org,
Wikipedia: Pie menu. Cites early references to pie meus to 1970s, as a gesture gestural user interface (similar to "drag" gesture?), makes assumptions about heirarchical menus and ability to chain multiple levels of menus.
[Wikipedia10l] ( * )en.wikipedia.org "History of Microsoft Windows", en.wikipedia.org, fetched 2010

Wikipedia: Historical timeline of Microsoft Windows operating system. DOS addressing modes replaced with Windows 95. No mention of Windows for Pen Computing, or of Tablet PC. Comparison with OS/2.
[Wikipedia10m] ( * )en.wikipedia.org "Windows CE 3.0", en.wikipedia.org, fetched 2010

Wikipedia: Windows CE 3.0 operating system ca. 2000 for palm-top pen computers, touchscreen digitizer. Reference has no information on gesture input. See also Windows
[WingfieldN09] ( * )Wingfield, Nick "Notes for Tablet Aware Application Developers", Wall Street Journal, January 12, 2009
Mentions touch gestures on Windows 7 not working well, HP implementing alternatives
[WithanaA10a] ( * )Withana, Anusha; Kondo, Makoto; Makino, Yasutoshi; Kakehi, Gota; Sugimoto, Maki; and Inami, Masahiko "ImpAct:
02.11.13
Immersive Haptic Stylus to Enable Direct Touch and Manipulation for Surface Computing", ACM Computers in Entertainment, Vol 8 NO 2, Article 9, December 2010, 16 pages
Haptic stylus to give illusion of touching objects inside a flat tablet display: when pressed on screen, stylus shortens (collapsible moving shaft) and projected tip of virtual stylus elongates in displayed image. Described as "direct touch". Note: what type of touchscreen/tablet technology -- proximity sensing?
[WitternH09a] ( * )Wittern, Hauke "Sketch Recognition", Colloquium of the Hochschule fr Angewandte Wisstenschaften Hamburg, May 28, 2009
Review of Sketch Recognition, cites to ASSIST system (and video) from M.I.T. and to Sutherland Sketchpad. Research focus is multi-touch input for sketch recognition in programming tools. Additional materials in electronic file
[WiViK09a] ( * )Prentke Romich Company, prentrom.com "WiViK Onscreen Keybord Version 3 / Microsoft Windows", Prentke Romich Company / Bloorview Kids Rehab, 2009
On-screen visual/virtual keyboard for accessibility: abbreviation expansion, word prediction from adapable dictionary, expanding quadrant selection (compare with Marking menus). Click selection, dwell selection (using both a time and a distance threshold), scanning selection (hit switch when desired item is highlighted in a sequential scan of items).
[WobbrockJO09a] ( * )Wobbrock, Jacob O.; Morris, Meredith Ringel; and Wilson, Andrew D. "User-Defined Gestures for Surface Computing", Proc. CHI 2009, Boston MA, April 4-9, 2009
Design hand/finger gestures on touchscreen touch table by showing use the effect, and then letting user make what they think is an appropriate gesture: i.e. for pan or drag, user placed hand on surface and moved across as direct manipulation. Not so much intended for user-defined gestures, as helping designers pick gesture sets informed by user natural behavior. Refers to surface computing (two authors from Microsoft). Elicited gestures included single select: tap or lasso gesture. Group select: hold and tap (two hand), move: drag or jump gesture (one hand to the other); cut/paste: two separate taps with same hand; rubout gesture. Drags to/from off-screen. Cites to Wellner.
[WobbrockJO10a] ( * )Wobbrock, Jacob O. and Myers, Brad A. "Using Edges and Corners for Character Input", United Statest Patent
02.11.13
7,729,542, June 1, 2010

EdgeWrite unistroke/graffiti gesture/character recognition using joystick input, similar to approach for Tackball EdgeWrite. User moves to edge limits when making character, somewhat similar to zone-based recognition. Chart of input alphabet, similar to presentation of Grafitti.
[WooYoung09] ( * )Woo-Young, Kwak; Seung-Jun, Lee; and So-Young, Park "Scrolling method of mobile terminal", United States Patent Application 20090070711
Scrolling in mobile terminal, with feedback when the scrolling hits the last item of a menu list. Refers to flick gesture input, and to a graphical effect being displayed at the end of scrolling.
[WordNetWeb10a] ( * )WordNetWeb "Stroke; Stylus", wordnetweb.princeton.edu, fetched Feb 2011

Definition of stroke Definition of stylus
[YangM08a] ( * )Yang, Ma; Leedham, Graham; Higgins, Colin; Htwe, Swe Myo "Segmentation and Recognition of Phonetic Features In Handwritten Pitman shorthand", Pattern Recognition, 2008
Paper file may have 2004 version: See also paper file for Higgins
[YiK10a] .Yi, Kwonju; Choi, Changkyu; Suh, Sungjoo; Yoo, ByungIn; Han, Jae-Joon; Park, Dusik; Kim, Changyeong "Novel LCD with a Sensible Backlight", SID Digests of Technical Papers, 2010
A novel multi-touch LCD architecture with hover-sensing capability based on an infrared sensor array will be described. It has an advantage over existing multi-touch LCD displays in that it maintains a slim form factor for LCDs without loss in display quality while it is possible to sense multiple touches and hovers simultaneously.
[Zeleznik08a] ( * )Zeleznik, Robert; Bragdon, Andrew; Liu, Chu-Chi; and Forsberg, Andrew "Lineogrammer: Creating Diagrams by Drawing", Proc. UIST 08, pp. 161..170
Prettyfying graphical editor for line drawings: limited use of snap-to grid, heuristics to recognize drawings or text or gestures; double-circle / lasso gesture to select, pigtal lasso to delete (compare Scriboli), a GestureBar, scribble/scratch out, undo gestures similar to W4PC, zig-zag for zoom in / out, polilines, press-and-hold/dwell for panning. Uses timeout for distinguishing characters versus drawing. Supports overdrawing to connect disjoint lines. Vertex dragging.
[ZeleznikR10a]
( * )Zeleznik,
Robert; Bragdon, Andrew; Adeputra, Ferdi;

73/74
02.11.13
and Ko, Hsu-Sheng "Hands-On Math: A page-based multi touch and pen desktop for technical work and problem solving", Proc. UIST '10, October 3-6, 2010, New York. pp. 17-26
Multi-touch electronic ink / mathematical text editing user interface using both pen and fingers: primarily for students applying algebraic manipulation. Users learn gestures by dynamic example much more readily than by text or verbal description (duh!). Ink/text adjusts for cut/paste/move (Compare with van Raamsdonck?). Two-finger gestures for open space, swap positions, move, select. Gestures include shape of hand/palm on surface, vertical angle orientation of finger (see Rekimoto?). Instead of shape/path gestures, menu under fingertips of non-dominant hand to select tools (see Buxton bi-manual).
[Zibreg09] ( * )Zibreg, Christian "Apple's A-bomb against Palm: A 358 page iPhone patent", www.tgdaily.com, January 27, 2009
Reference to Palm Pre and Apple iPhone and unspecified patent claims concerning separate gesture area from display touchscreen in hand-held device
Main Reference Page
74/74

Biblio 10

Hochgeladen von

Dokumentinformationen

Originalbeschreibung:

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Biblio 10

Hochgeladen von

Copyright:

Verfügbare Formate

02.11.

(2008..2010) History of Pen and Gesture Computing

(2008..2010) History of Pen and Gesture Computing

[Acer10a] ( * )Acer "Acer Iconia: Dual-Display-Notebook", www.computerbild.de, 24 November 2010

[Adapx08a] ( * )Adapx.com "Adapx Digital Paper", www.adapx.com, fetched 2008

(2008..2010) History of Pen and Gesture Computing

[Apple10c] ( * )Apple.com "Apple - Accessibility - iPhone - Vision", www.apple.com, fetched 2010

(2008..2010) History of Pen and Gesture Computing

[Apple10d] ( * )Apple.com "Apple - Accessibility - VoiceOver - In Depth", www.apple.com, fetched 2010

(2008..2010) History of Pen and Gesture Computing

[Atmel09a] ( * )Atmel Inc. "Atmel QMatrix Touch Technology", www.atmel.com

(2008..2010) History of Pen and Gesture Computing

construction of multi-touch surface.

(2008..2010) History of Pen and Gesture Computing

2009: File also contains 2002 Draft

(2008..2010) History of Pen and Gesture Computing

[BricklinD09a] ( * )Bricklin, Dan "Bricklin On Technology", Wiley Publishing, 2009

(2008..2010) History of Pen and Gesture Computing

(2008..2010) History of Pen and Gesture Computing

(2008..2010) History of Pen and Gesture Computing

June 21, 2012

(2008..2010) History of Pen and Gesture Computing

(2008..2010) History of Pen and Gesture Computing

(2008..2010) History of Pen and Gesture Computing

Later version of 2006 technical report, U. Maryland, same authors

[CSAIL08a] ( * )CSAIL "MIT CSAIL: Design Rational", rationale.csail.mit.edu, 2008

(2008..2010) History of Pen and Gesture Computing

(2008..2010) History of Pen and Gesture Computing

gesturestart, not finger-lift/mouse-up/gestureend

Inc. "DiamondTouch", (various)

(2008..2010) History of Pen and Gesture Computing

[eInstruction09] ( * )eInstruction.com "eInstruction Interwrite DualBoard", eInstruction.com product literature

(2008..2010) History of Pen and Gesture Computing

[emsps.com10a] ( * )emsps.com "Old, Used and Out-of-Print SideKick(R) Software", www.emsps.com/olktools/borsk.htm

[EMSSoftware08] ( * )EMS Software "Lotus 1-2-3 Version Information", www.oldsoftwareinfo.com

(2008..2010) History of Pen and Gesture Computing

in an iPhone or portable device

Ina "Microsoft hopes 'Milan' table PC has magic

(2008..2010) History of Pen and Gesture Computing

touch", news.cnet.com, May 29, 2008

[GestureTek08a] ( * )GestureTek "GestPoint Gesture Recognition for Presentation Systems", www.gesturetek.com

(2008..2010) History of Pen and Gesture Computing

[Google08a] ( * )Google Code "iphone-haptics", code.google.com/p0/iphone-haptics, 2008

(2008..2010) History of Pen and Gesture Computing

[Google08b] ( * )Unknown "google chrome", drewp.quickwitretort.com/2008/09/22

(2008..2010) History of Pen and Gesture Computing

Chris and Hudson, Scott E. "Scratch Input:

(2008..2010) History of Pen and Gesture Computing

(2008..2010) History of Pen and Gesture Computing

[HewlettPackard08] ( * )Hewlett-Packard "HP Pavilion tx2z series", www.shopping.hp.com/series/category/notebooks/tx2z_series

(2008..2010) History of Pen and Gesture Computing

(2008..2010) History of Pen and Gesture Computing

[HOPL08] ( * )HOPL History of Programing Languages "Maths input language", hopl.murdoch.edu.au

[HorneckerE09a] ( * )Hornecker, Eva "Tangible interaction", InteractionDesign.org: http://www.interactiondesign.org/encyclopedia/tangible_interaction.html, 2009

(2008..2010) History of Pen and Gesture Computing

Multi-touch/Multipoint mutual capacitive touchscreen: compare to Fingerworks and Rekimoto?

[HP08a] ( * )Hewlett-Packard "HP TouchSmart IQ506/IQ504 PC", (various)

(2008..2010) History of Pen and Gesture Computing

"IOGEAR Digital Scribe", iogear.com

"IRISPen executve 6 User's guide",

"Readiris 12 Pro", Irislink.com, fetched 2010

(2008..2010) History of Pen and Gesture Computing

"iPad file information", Misc