TiPoint – Mid-air interaction for Smart Glasses

TiPoint is a freehand mid-air interaction technique.TiPoint utilizes the camera mounted on the smart glass to detect the user’s hand without relying on gloves, markers, or sensors, enabling intuitive and non intrusive interaction.
We introduce a computationally fast and light-weight algorithm for fingertip detection, which is especially suited for the limited hardware specification and short battery life time of smart glasses.
TiPoint processes pictures at a rate of 20 frames per second with a high detection accuracy — no more than 6 pixel deviation.
Our evaluation and user study show that TiPoint as a mid-air non-intrusive interface delivers a better experience for interaction between users and smart glasses, with users completing typical tasks 1.82 times faster than when using the original hardware.

Grants

TiPoint was awarded 100k HKD in the professional stream of Cyberport Creative Micro Fund (CCMF) 2017 

Videos

News & Media

Hong Kong government:  http://www.news.gov.hk/en/categories/finance/html/2017/01/20170126_160048.shtml?pickList=ticker

SCMP: https://www.scmp.com/news/hong-kong/education-community/article/2021018/hong-kong-researchers-laud-bright-future

Patents

US Provisional Application No. 62/496,854, Farshid HASSANI BIJARBOONEH, LEE Lik Hang, HUI Pan

@Copyright Farshid Hassani Bijarbooneh, All right reserved 2017