Turn high-efficiency, high-reliability and low-power consumption system platforms into reality
With the dramatic improvements in sensor technology, there is a growing need to capture real space with high accuracy and apply it to infrastructure projects such as construction and civil engineering, as well as entertainment technologies such as AR and VR. To satisfy these demands, Sony is aiming to build a digital twin platform that aggregates the 3D data acquired from edge devices with open geospatial data to virtually reproduce real space. The data collected on this platform will be accumulated with metadata tagged by spatio-temporal AI analysis so that future simulations and predictions can be conducted. Furthermore, by sharing and visualizing data in real time through the virtual space, it will be possible to grasp and interact with real space from anywhere in a variety of scenarios, including DX in the infrastructure field.
In 2001, Sony attained a world-first by developing and implementing embedded Linux as a common operating system for various AV equipments. This enabled us to improve the efficiency of our software development and enhance the functionality of our devices. We are currently developing system software that will allow us to realize new categories of products and services through the use of robotics technology and other technologies. Our goal is to develop system reliability, system security and real-time technologies, and to combine open-source Linux kernel, middleware and the proprietary technologies. These technologies will be integrated into embedded Linux systems. We are also developing technologies to enable seamless integration between embedded Linux and the cloud, which is central to IoT devices. We are also actively contributing to OSS communities including ROS.
We are developing a system that remotely delivers reality and a real-time experience to contribute to Sony’s diverse business portfolio. The Remote System consist of (1) a Wireless System that controls not only radio access technology but also codecs and transport according to fluctuations in the network quality, (2) a Network System that improves the quality of the connection from the client to the cloud via cellular networks and the Internet, and (3) a Cloud system that enables advanced data processing such as 3D rendering, and behavior planning in the cloud while optimally orchestrating Edge/Cloud computing resources for each scenario. We are closely collaborating with the related business units in order to resolve practical challenges.
The XR System technology produces 3D images and sounds as if they actually existed in the physical world, by using information sensed from real-world space and human postures in real time. It enables mixed-reality experiences that seamlessly connect the virtual and physical worlds. We are developing high-accuracy, low-latency 3D rendering technologies to attain realism, low-latency and low-power-consumption technologies for application to highly portable systems, and an SDK technology that provides a high-performance application development environment that is tightly integrated into game engines. Through the development of these technologies, we will provide new KANDO experiences that fuse the virtual and physical worlds in entertainment and professional applications.