Proceedings: GI 2007

BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking

Andrew Wilson, Raman Sarin

Proceedings of Graphics Interface 2007: Montréal, Québec, Canada, 28 - 30 May 2007, 119-125

DOI 10.1145/1268517.1268539

  • BibTex

    author = {Wilson, Andrew and Sarin, Raman},
    title = {BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking},
    booktitle = {Proceedings of Graphics Interface 2007},
    series = {GI 2007},
    year = {2007},
    issn = {0713-5424},
    isbn = {978-1-56881-337-0},
    location = {Montr{\'e}al, Qu{\'e}bec, Canada},
    pages = {119--125},
    numpages = {7},
    doi = {10.1145/1268517.1268539},
    acmdoi = {10.1145/1268517.1268539},
    publisher = {Canadian Human-Computer Communications Society},
    address = {University of Waterloo, Waterloo, Ontario, Canada},


Associating and connecting mobile devices for the wireless transfer of data is often a cumbersome process. We present a technique of associating a mobile device to an interactive surface using a combination of computer vision and Bluetooth technologies. Users establish the connection of a mobile device to the system by simply placing the device on a table surface. When the computer vision process detects a phone-like object on the surface, the system follows a handshaking procedure using Bluetooth and vision techniques to establish that the phone on the surface and the wirelessly connected phone are the same device. The connection is broken simply by removing the device. Furthermore, the vision-based handshaking procedure determines the precise position of the device on the interactive surface, thus permitting a variety of interactive scenarios which rely on the presentation of graphics co-located with the device. As an example, we present a prototype interactive system which allows the exchange of automatically downloaded photos by selecting and dragging photos from one cameraphone device to another.