Thumbnail
Access Restriction
Open

Author Elmqvist, Niklas ♦ Ramani, Karthik
Source CiteSeerX
Content type Text
File Format PDF
Subject Domain (in DDC) Computer science, information & general works ♦ Data processing & computer science
Subject Keyword Depth Camera ♦ Touch Posture ♦ Hand Posture ♦ Horizontal Surface ♦ Single Commodity Depth Camera ♦ Multitouch Interaction ♦ Tabletop Display ♦ Existing Technology ♦ Pen Touch Sketch Tool ♦ Practical Solution ♦ Extracting Finger ♦ Scratchpad Tool ♦ Input Modality ♦ Actual Point ♦ Kinect Depth Camera ♦ User Exact Finger ♦ Multitouch Surface ♦ Acm Classification Keywords ♦ Pen Touch Sketch Interface ♦ User Study ♦ Different User
Abstract Figure 1. Extracting finger and hand posture from a Kinect depth camera (left) and integrating with a pen+touch sketch interface (right). Multitouch surfaces are becoming prevalent, but most existing technologies are only capable of detecting the user’s actual points of contact on the surface and not the identity, posture, and handedness of the user. In this paper, we define the concept of extended multitouch interaction as a richer input modality that includes all of this information. We further present a practical solution to achieve this on tabletop displays based on mounting a single commodity depth camera above a horizontal surface. This will enable us to not only detect when the surface is being touched, but also recover the user’s exact finger and hand posture, as well as distinguish between different users and their handedness. We validate our approach using two user studies, and deploy the technique in a scratchpad tool and in a pen + touch sketch tool. ACM Classification Keywords
Educational Role Student ♦ Teacher
Age Range above 22 year
Educational Use Research
Education Level UG and PG ♦ Career/Technical Study