Title Page
Abstract
Contents
List of Abbreviations 13
1. Introduction 14
1.1. Motivation 14
1.2. Approaches 15
1.3. Outline 16
2. Related Work 18
2.1. Detect 3D Movement of a Hand in the Input Device 18
2.2. Naturalness of Input Device 20
2.3. Difference between Virtual and Physical Pointing 21
2.4. Human Reaching Movement 22
3. User Study 24
3.1. Purpose 24
3.2. Method 24
3.2.1. Participants 24
3.2.2. Apparatus 24
3.2.3. Design and Procedure 25
3.3. Results and Discussion 26
3.3.1. Movement Time 26
3.3.2. Difference in Time-Distance Graph 27
3.3.3. Extension for Profile of Pointing Movement 31
3.3.4. Questionnaire 33
3.4. Conclusion 34
4. Design 36
4.1. Identify the Reasons 36
4.2. Concept 37
4.2.1. Support the Reach-and-push Skill in a Remote-control Environment 37
4.2.2. Complement Split Space between Control and Display 38
4.3. Additional User Study 41
4.3.1. Purpose 41
4.3.2. Method 41
4.3.3. Results and Discussion 42
4.3.4. Conclusion 43
5. Implementation 44
5.1. Prototype I 44
5.1.1. Structure of Prototype I 44
5.1.2. Problem of the Prototype I 45
5.2. Prototype II 46
5.2.1. Structure of Prototype II 46
5.2.2. Problem of the Prototype II 47
5.3. Prototype III (ReachPad) 48
5.3.1. Structure and Usage of the Prototype III 48
5.3.2. Cursor Design for the Prototype III 50
5.3.3. State Transition of the Prototype III 51
5.3.4. Limitation of the Prototype III 53
6. Evaluation I & II 55
6.1. Purpose 55
6.2. Method 55
6.2.1. Participants 55
6.2.2. Apparatus 56
6.2.3. Design and Procedure 57
6.3. Results and Discussion 60
6.3.1. Results for Features 60
6.3.2. Results for Performance 70
6.3.3. Questionnaire Results 75
6.4. Conclusion 77
7. Evaluation III 79
7.1. Purpose 79
7.2. Method 79
7.2.1. Participants 79
7.2.2. Apparatus 79
7.2.3. Design & Procedure 80
7.3. Results and Discussion 81
7.3.1. Words for Minute 81
7.3.2. Error Rate 82
7.4. Conclusion 84
8. Additional Experiment 85
8.1. Motivation 85
8.2. Outcome 85
9. Conclusion and Future Work 89
국문요약 92
References 93
Acknowledgements 98
Curriculum Vitae 100
Table 1. Questionnaire results about user's opinion 33
Table 2. Height from keypad to finger for each subject (mm) 42
Table 3. Summary of restuls for all experiments 91
Figure 1. Tilting action of the Rockin'Mouse 18
Figure 2. Device that incorporates a plurality of ultrasonic trasducers as user pointing device (from [35]) 19
Figure 3. Z-Cam™ 20
Figure 4. Left: Logitech optical mouse, Right: keypad 25
Figure 5. Test application for this user study 26
Figure 6. Average movement time of the two device 27
Figure 7. Time-Distance graph for two devices (X-axis: Time flow based on the sound time, Y-axis : Distance from start position to target position) . 28
Figure 8. Average ETSM for each device 29
Figure 9. Time-Distance graph for two devices (X-axis: Time flow based on the click time, Y-axis: Distance from start position to target position) 30
Figure 10. Average ETRS for each device 31
Figure 11. %TAPD of four different method (* result from [15]) 32
Figure 12. Workload of two devices 34
Figure 13. Sketch for design concept 40
Figure 14. Captured frame by left side of mobile phone 41
Figure 15. Structure (a) and appearance (b) of prototype I 45
Figure 16. Stucture and appearance of prototype II 47
Figure 17. Second layer (a) and the whole appearance (b) of prototype III 49
Figure 18. Side of prototype III 50
Figure 19. Cursor design for the prototype III 50
Figure 20. State transition of the prototype III 52
Figure 21. State transition of (a) the mouse and (b) the touchpad [7] 52
Figure 22. State transition of the touchscreen [7] 53
Figure 23. Detect the finger point (red circle: reflected light of four LEDs) 54
Figure 24. The user's thumb with color marker 57
Figure 25. Mouse (a), Gyropoint (b), and renovated touchpad (c) 57
Figure 26. Test application for evaluation process (actual size) 59
Figure 27. Averaged trial time for each session and device 61
Figure 28. Modified trial time for each session and device 62
Figure 29. ETSM for each session 63
Figure 30. Time-Distance graph at session 6. (X-axis: Time flow based on the time to target appeared, Y-axis : Distance from start position to target position) 64
Figure 31. ETRS for each session 66
Figure 32. Time-Distance graph at session 6. (X-axis: Time flow based on the click time, Y-axis: Distance from start position to target position) 67
Figure 33. %TAPD for each devices at last session (* from [15]) 69
Figure 34. Workload for each device 70
Figure 35. Averaged error rate for each session 71
Figure 36. The number of missed target for each session 72
Figure 37. TP for each session 74
Figure 38. Modified TP for each session 75
Figure 39. Absolute touchpad in experimental group 80
Figure 40. Test aplication for text entry using 3x3 numerical keypad 81
Figure 41. Average WPM for each device 82
Figure 42. Average error rate for each device 83
Figure 43. Extended state transition of ReachPad (Pink dotted line and asterisc(*) denotes that a picking state was remained as ever) 86
Figure 44. Demonstration for state transition of ReachPad 87