Mixed Reality (MR) has shifted from being used only by experts to being accessible by anyone. MR content can be visualised and interacted with via different devices such as smart glasses, HoloLens and smartphones. Immersive and intuitive interactions with virtual objects using only bare hands is still a challenge, as it requires user’s hands and fingers to be accurately localised and segmented in 3D space to account for occlusions during scene rendering.
In this project, the candidate student will research how to enable seamless bare-hand Mixed Reality interactions using images captured from a smartphone. The candidate will work with Convolutional Neural Networks and deploy algorithms on smartphones to achieve real-time hand tracking performance. Evaluation of algorithms will be carried out on publicly available datasets taken from real-world scenarios and testing real user experiences. If you are interested in this internship send a direct email to the contact below.
Required knowledge and skills:
Computer Vision, Machine Learning, Convolutional Neural Networks
Python, C#, C++.
This FBK Internship opportunity is for Masters’ students.
Minimum 3 months.
From october 2018.