New Interaction

Techniques
Screen Space &
Spatial
manipulation
Grigori Evreinov

Department of Computer
Sciences
University of Tampere, Finland
www.cs.uta.fi/~grse/
September – December, 2003
 Spatial
Manipulation

http://www.fossil.com
Samsung GPRS wristwatch phone

TAUCHI MMIG G. Evreinov 01_21 14.11.2003

 Spatial
Manipulation

[1, 2] TiltType: Accelerometer-Supported Text Entry for Very Small

Devices (UIST2002), http://portolano.cs.washington.edu/projects/tilttype/
TAUCHI MMIG G. Evreinov 02_21 14.11.2003
 Spatial
Manipulation

[3] TiltText: Using Tilt for Text Input to Mobile Phones (UIST2003)

TAUCHI MMIG G. Evreinov 03_21 14.11.2003

 Spatial
Manipulation

if cursor is moving into the “t”, rectangles corresponding to ‘ta’, ‘tb’,‘tc’, ...,‘tz’
appear in a vertical line like the first line
the heights of the rectangles correspond to the probabilities of these strings
according to the language model

[4] Dasher, http://www.inference.phy.cam.ac.uk/djw30/dasher/p0.html demo1

TAUCHI MMIG G. Evreinov 04_21 14.11.2003

 Spatial
Manipulation

the left picture shows the

EdgeWrite recognition
algorithm before the
stylus is detected inside
one of the corners
onscreen keyboards are small and require the user to fix
attention on the keyboard rather than on the output once the stylus enters a
corner area, the corners
text entry (recognition) on a handheld device is difficult for
deflate for the duration of
people with motor impairments (tremor, Cerebral Palsy
the stroke (the right pict.)
and fatigue)

[5] EdgeWrite: A Stylus-Based Text Entry Method Designed

for High Accuracy and Stability of Motion
TAUCHI MMIG G. Evreinov 05_21 14.11.2003
 Spatial
marking Manipulation
menus and other formsof
gesture input are being used in
commercial desktop systems and in
mobile devices
by analyzing mouse and pen flick
gestures (5200 gestures), the high
levels of angular error were revealed
when using a pen-based input device to
generate rightwards and leftwards
gestures
the relatively long time taken to
generate downwards gestures using
the mouse
[9] Analysing Mouse and Pen Flick
Gestures

TAUCHI MMIG G. Evreinov 06_21 14.11.2003

 Spatial
Keuning-Van Manipulation
Oirschot [10] investigated
cursor movements with an amplitude of 250
pixels, in eight different directions and with
three control devices: a mechanical mouse,
an optical mouse and an optical trackball,
to find characteristics of the cursor path
which could be used to create a prediction
algorithm on direction
the focus was on the mean curvature of
and the variability between the paths in
each direction
it can be concluded that on average cursor
paths are rather straight in all eight
directions and with all three devices
the variability of the paths depends on
direction, friction of the control device and
user

TAUCHI MMIG G. Evreinov 07_21 14.11.2003

 Spatial
Manipulation

the method for rapid evaluation of new graphic templates for text input
the method does not require learning of the new graphics, any layout or rules
before testing, and is intended to evaluate the user’s capabilities regarding to
the pen-based text entry technique
testing takes no more than two minutes per graphic template
TAUCHI MMIG G. Evreinov 08_21 14.11.2003
 Spatial
Manipulation
the average performance (left scale),
standard deviation and the amount of
copied images per second (right
scale)

the total times of the drawing (s),

the total length of tracks (mm) and
the number of copied images

TAUCHI MMIG G. Evreinov 09_21 14.11.2003

 Spatial
7 Manipulation
segments

TAUCHI MMIG G. Evreinov 10_21 14.11.2003

 Spatial
7 Manipulation
segments
txtText1 Form_KeyDown(…)

Ctrl+K=>move SetSegments
segments
lblCodec SymbDec
Ctrl+G=>color
imaging
Form_MouseUp(…)

SegmActivate
Segm1 - 7

Form_MouseMove(…)

Clear

TAUCHI MMIG G. Evreinov 11_21 14.11.2003

 Spatial
Stylus flicks on Manipulation
touchscreen MouseT

TAUCHI MMIG G. Evreinov 12_21 14.11.2003

 Spatial
MouseT Manipulation
Clear J abs. position J
Cl N BackSp
D H R D H Bs N R
L L
abs. position
K J
J
K
D H K N R
H L N
D R
speed vectors
abs. position L
J
D H Sp N R
K
Space L

TAUCHI MMIG G. Evreinov 13_21 14.11.2003

 Spatial
MouseT Manipulation
SetSymbol BackSpace
txtText1
ChgSymbol SetHelp

K
Form_MouseMove(…)
Timer1.Enabled = True
Timer1.Interval = Rtime
XtmpE = XtmpS: YtmpE = YtmpS
XtmpS = Xtmp: YtmpS = Ytmp
Timer1
Timer1.Enabled = False
Timer1.Interval = 0
XtmpE = Xtmp: YtmpE = Ytmp
ChgSymbol
TAUCHI MMIG
ChgSymbol
(YtmpE - YtmpS) > M1x tChar + 1
(XtmpE - XtmpS) > M2x tChar + 7
(XtmpE - XtmpS) > M1x And
(XtmpE - XtmpS) < M2x tChar + 3
ChgSymbol
(YtmpE - YtmpS) < -M1x tChar - 1
(XtmpE - XtmpS) < -M2x tChar - 7
(XtmpE - XtmpS) < -M1x And
(XtmpE - XtmpS) > -M2x tChar - 3
G. Evreinov 14_21 14.11.2003
 Spatial
MouseT Manipulation
VPerformance
150 Instruction
DurationSlow
t2 = GetTickCount
t1=GetTickCount DurationMiddle1
If t1 > 0 Then DurationMiddle2
k = CInt(t2 - t1)
DurationFast
1
2 2
1
Form_MouseMove(…)

Finish
lblSave
Timer1
Error

“Calibration”: to find the path length of cursor in 150 ms

TAUCHI MMIG G. Evreinov 15_21 14.11.2003

 Spatial
Drag & Manipulation
Drop

TAUCHI MMIG G. Evreinov 16_21 14.11.2003

 Spatial
Drag & Manipulation
Drop
txtText1 lblNKey
fraData

GridData1: lblClrSpot
order No (1-100) lblCapt
entered number lblError
Form_MouseMove(…)
time per symbol, ms lblTestTime
GridData1_Click() lblTimeR
to save column
SpotPointer lblTimeS
Pointer
KeyPos(0) – (10) EditKeys
Shadow(0) – (10) EditTools
Statistics
Timer1 Clear
Error

TAUCHI MMIG G. Evreinov 17_21 14.11.2003

 Spatial
txtEntry_3Btn Manipulation

TAUCHI MMIG G. Evreinov 18_21 14.11.2003

 Spatial
Manipulation
txtText1

Form_DblClick(…) ‘Cancel

lblString1 lblString2 lblString3 BackSpace

String1 - 3
ChangeString

lbl1 - 3 EditCaption

Form_MouseDown(…) SelButton1
Form_KeyDown(…)
Form_MouseMove(…) SelButton2
Form_KeyUp(…)
Form_MouseUp(…) SelButton3
TAUCHI MMIG G. Evreinov 19_21 14.11.2003
 Spatial
References Manipulation
[1] Partridge, K., Chatterjee, S., Sazawal, V., Borriello, G. and Want, R. TiltType: Accelerometer-Supported
Text Entry for Very Small Devices. http://www.cs.washington.edu/homes/kepart/papers/uist2002.pdf
[2] Sazawal, V., Want, R. and Borriello, G. The Unigesture Approach One-Handed Text Entry for Small
Devices. http://www.speakeasy.org/~roywant/papers/lncs_unigesture.pdf
[3] Wigdor, D., Balakrishnan, R. TiltText: Using Tilt for Text Input to Mobile Phones. http://www.dgp.toronto
.edu/papers/dwigdor_UIST2003.pdf
[4] Ward, D.J. Adaptive Computer Interafces. Ph.D. Thesis, University of Cambridge, 2001. Available at:
http://www.inference.phy.cam.ac.uk/djw30/papers/thesis.pdf
[5] Wobbrock, J.O., Myers, B.A., Kembel, J.A. EdgeWrite: A Stylus-Based Text Entry Method Designed for
High Accuracy and Stability of Motion. http://www.cs.cmu.edu/~jrock/pubs/uist-03.pdf
[6] J. Himberg, J. Häkkilä, P. Kangas, and J. Mäntyjärvi. On-line personalization of a touch screen based
keyboard. In Proceedings of the 2003 International Conference on Intelligent User Interfaces (IUI 2003),
pp. 77-84, Miami, Florida, USA, 2003. ACM Press.
[7] G. W. Lesher, B. J. Moulton and D. J. Higginbotham, Optimal Character Arrangements for Ambiguous
Keyboards. IEEE Transactions on Rehabilitation Engineering, pp. 415–423, 1998.
http://www.enkidu.net/downloads/papers/LeMoHi98b.pdf
[8] Lyons, K., Patel, N.J. and Starner, T. KeyMenu: A Keyboard Based Hierarchical Menu
http://www.gvu.gatech.edu/ccg/publications/keymenu/

TAUCHI MMIG G. Evreinov p 20_21 14.11.2003

 Spatial
[9] Moyle, M., Cockburn, A. Analysing Mouse and Pen Flick Gestures. Manipulation
http://www.cosc.canterbury.ac.nz/~andy/papers/sigchinz.pdf
[10] Keuning-Van Oirschot, H., Houtsma, A.J.M. Cursor Trajectory Analysis. IPO Annual Progress Report
No 35, 2000, pp. 128-139.
[11] Kamba, T, Elson, S A, Harpold, T, Stamper, T & Sukariya, P (1996) "Using Small Screen space more
efficiently," Proc. ACMCHI96, 383-390.
[12] Hinckley, K. Design Issues in Spatial Input. Ch. 4.,
http://research.microsoft.com/Users/kenh/thesis/design_issues.htm
http://research.microsoft.com/users/kenh/papers/Survey.pdf
[13] Albinsson, P-A, Zhai, S.,  High Precision Touch Screen Interaction, in Proceedings of CHI 2003, ACM
Conference on Human Factors in Computing Systems, Fort Lauderdale, Florida, April 5-10, 2003. pp
105-112, http://www.almaden.ibm.com/u/zhai/papers/TouchScreen.pdf
[14] Zhai, S., Kristensson, P-O., Shorthand Writing on Stylus Keyboard, in Proceedings of CHI 2003, ACM
Conference on Human Factors in Computing Systems, Fort Lauderdale, Florida, April 5-10, 2003. pp
97-104, http://www.almaden.ibm.com/u/zhai/papers/SharkFinal.pdf

WAAA
write always, anything, anywhere

TAUCHI MMIG G. Evreinov p 21_21 14.11.2003