Enabling smooth hand and finger movements depiction in AR for VTuber etc.Software development kit "ToF AR" utilizing depth technology
<Overview>
Software development kit "ToF AR" utilizing depth information
ToF (Time of Flight) is a technology that acquires depth information to an object by emitting light and measuring the time that it takes for light to reflect and bounce back.
The software development kit "ToF AR" is provided to application developers so that they can easily use this ToF technology on familiar smartphones.
By utilizing depth information, the smoothness of hands and fingers is realized, and it is expected to be used in applications such as virtual YouTubers and games.
Learn more about ToF AR：https://developer.sony.com/develop/tof-ar/
<Development manager>
-
Doi Hiromasa
System Solutions Business Division
Sony Semiconductor Solutions Corporation
<Business manager>
-
Michimata Hiroyuki
Mobile System Business Division
Sony Semiconductor Solutions Corporation
-
Koyama Akihiro
Mobile System Business Division
Sony Semiconductor Solutions Corporation
<Main features>
- Smoothness of the hands and fingers is achieved by utilizing depth information to capture the characteristics of the hands and estimating 3D movements such as position and finger orientation.
- By utilizing depth information, the amount of information to be acquired is less than that of a normal image sensor, and highly accurate recognition is possible with relatively simple AI processing.
Realization of smooth movement of hands and fingers utilizing depth information
<The Sony Group internal and external collaboration>
R&D Center, Sony Group Corporation
<Future direction>
By utilizing the depth information obtained from ToF AR, we believe that we can improve the accuracy and processing speed of various types of recognition. In addition to recognizing people's movements, we aim to apply it to space recognition technology, so that it can be used in AR, games, Vtuber distribution, metaverse applications, etc. In addition, as more ToF image sensors are installed in smartphones and depth information becomes more familiar to people, we believe we can use it in new communication, medical, and educational fields, and helping to deliver unprecedented new emotional experiences.
