TiPoint – Mid-air interaction for Smart Glasses

TiPoint is a freehand mid-air interaction technique.TiPoint utilizes the camera mounted on the smart glass to detect the user’s hand without relying on gloves, markers, or sensors, enabling intuitive and non intrusive interaction.
We introduce a computationally fast and light-weight algorithm for fingertip detection, which is especially suited for the limited hardware specification and short battery life time of smart glasses.
TiPoint processes pictures at a rate of 20 frames per second with a high detection accuracy — no more than 6 pixel deviation.
Our evaluation and user study show that TiPoint as a mid-air non-intrusive interface delivers a better experience for interaction between users and smart glasses, with users completing typical tasks 1.82 times faster than when using the original hardware.

Grants

TiPoint was awarded 100k HKD in the professional stream of Cyberport Creative Micro Fund (CCMF) 2017 

Videos

News & Media

Hong Kong government:  http://www.news.gov.hk/en/categories/finance/html/2017/01/20170126_160048.shtml?pickList=ticker

SCMP: https://www.scmp.com/news/hong-kong/education-community/article/2021018/hong-kong-researchers-laud-bright-future

Patents

US Provisional Application No. 62/496,854, Farshid HASSANI BIJARBOONEH, LEE Lik Hang, HUI Pan

@Copyright Farshid Hassani Bijarbooneh, All right reserved 2017

Leave a Reply

Your email address will not be published. Required fields are marked *

If you are a bot please fail this test: * Time limit is exhausted. Please reload the CAPTCHA.

This site uses Akismet to reduce spam. Learn how your comment data is processed.