SONY

close
JP EN

CEATEC 2024

HELLO, SENSING WORLD! CEATEC 2024

The World of Imaging and Sensing Technology: Driving Innovation
and Kando, and Building a Safe and Secure Society

Exhibition Overview

At the Sony booth at Makuhari Messe, writing boards will be available and staff with qualifications such as skills in assisting people with disabilities will be on hand. If you require any such special assistance or accommodations, please do not hesitate to ask at the Sony booth reception desk.

How does imaging and sensing technology support society?

Semiconductor image sensors, often referred to as "electronic eyes," have revolutionized the way people capture and share Kando (emotion) using smartphones and cameras. Imaging technology has evolved beyond human capabilities, enabling the detection of invisible phenomena and fleeting moments, thus uncovering new discoveries.

Furthermore, the integration of image sensors with various other technologies to create sensing capabilities that recognize people and spaces now supports many aspect of daily life, while providing new forms of entertainment and solutions.

What is an image sensor?

All smartphones and all cameras are equipped with a semiconductor called an image sensor, sometimes referred to as the electronic eye. Image sensors have continued to evolve, allowing people to capture Kando and share it with family and friends. Thanks to the combination of various technologies, image sensors can now detect people and spaces and have become a core technology that supports all of society. From smartphones and digital cameras to automotive, industrial, and robotic applications, image sensors are everywhere, contributing to a prosperous and secure future.

POINTS

  • Sony makes a wide range of image sensors for all manner of camera applications.
  • Examples of cameras equipped with image sensors within the Sony Group include the VENICE 2 digital cinema camera,
    the Alpha 9 III mirrorless interchangeable-lens camera, and the Xperia™ smartphone.
Images of Xperia smartphone, the Alpha 9 III mirrorless interchangeable-lens camera and the VENICE 2 digital cinema camera.
Back to Exhibit list

Short-wave infrared (SWIR) image sensors:
Capturing the invisible

Light varies in the reflection and absorption properties of materials depending on its wavelength. Harnessing the capabilities of cutting-edge image sensor technology, it is now possible to detect specific wavelengths of light, enabling people to see through objects or identify substances that are invisible to the human eye. For instance, water, which appears transparent to us, absorbs certain wavelengths of light, allowing its presence to be visualized. This technology is revolutionizing industries such as food inspection, material sorting, contaminant detection, and semiconductor inspection, where visual inspection alone is insufficient. By enabling the detection of subtle differences that are imperceptible to the human eye, these image sensors significantly enhance productivity.

POINTS

  • SWIR image sensors can capture images from visible light, to light in the short-wavelength infrared region.
  • Water, which normally appears transparent, absorbs light when viewed at certain wavelengths in the SWIR range, making the water appear black.
  • These sensors are capable of determining where moisture is present, making it is useful for inspecting foreign objects and food that are difficult to identify with the naked eye.
Image showing that the SWIR image sensor makes the particularly watery parts of the apple appear black.
Image of Semiconductor silicon wafer that is seen through the use of SWIR image sensors.
Back to Exhibit list

Global shutter technology:
Capturing even the fastest movements with certainty

When capturing fast-moving subjects, distortion can occur in the image. This is a phenomenon caused by the characteristics of the image sensor. Global shutter technology enables high-speed image capture eliminating this distortion by exposing and reading all pixels simultaneously. It is primarily used in industrial machine vision cameras and is very useful in fields that require high speed and high image quality, such as manufacturing line inspection, semiconductor manufacturing equipment, and barcode recognition of goods in logistics warehouses.

POINTS

  • Because all pixels are exposed and read simultaneously, it is possible to capture fast-moving subjects without distortion, allowing for true-to-life imaging.
  • Replaces human visual inspection by accurately capturing information from barcodes and QR codes on packages.
Image showing the flow of packages with barcodes and QR codes on the production line. Image of a subject on a manufacturing line moving at high speed.
Back to Exhibit list

ToF image sensors:
Recognizing fingers and actions using depth information

Technology that recognizes people and spaces is also being used in the world of entertainment. Time of Flight (ToF) image sensors are image sensors that can measure the distance or depth to an object in three dimensions. By utilizing depth information, it is possible to visualize a person's posture and even the very fine movements of their fingers. This allows for real-time replication of avatars in virtual spaces and supports new user interfaces employing intuitive gesture control.

POINTS

  • Body movements recognized using depth information to the subject are reflected in a 3D avatar.
  • These sensors can smoothly depict the movements of the hands and fingers.
Image of an animated female avatar projected on screen by a ToF image sensor and manipulated in real time.
Back to Exhibit list

Sensing technology:
Useful in rehabilitation games

Sony Financial Group is conducting a trial of rehabilitation games at nursing homes operated by Sony Lifecare Group, in collaboration with Sony Group's in-house design organization, Creative Center, and Sony Interactive Entertainment. Sony's ToF image sensor and other sensing technologies recognize the hand movements of the person playing the game, making it possible for the hands of the users to act as the game controller, thereby doing away with the need to have a dedicated game controller to enjoy such games. The goal is to connect playing such games to facilitate moving the hands and body for rehabilitation purposes. This is just one example of how new sensing technology can help realize the concept of making rehabilitation more accessible and fun for all kinds of people.

POINTS

  • Using depth information to the user's hands sitting in front of a monitor, ToF image sensor and other sensing technologies display a virtual hand on the screen in real time.
  • Developed with the concept of "Nothing to wear, nothing to hold, nothing to set-up," these sensors expand the possibilities for enjoyment for a diverse range of users.
Image of a resident experiencing a rehabilitation game using sensing technology in a nursing home.
Back to Exhibit list

Leveraging AI and sensing technology to create high-efficiency, sustainable spatial recognition solutions

By combining image sensors and AI, it is possible to utilize various information contained in captured images to address social issues. In this demonstration, AI embedded in the image sensor analyzes and processes images captured by the sensor in real time, displaying only the necessary information to be used.

By using edge computing and carrying out AI processing on the sensor device itself, the device can output and transmit only the necessary information. This reduces network data load as well as power consumption, and contributes to the safe and sustainable utilization of data while also addressing privacy concerns.

POINTS

  • Utilizes the IMX500 intelligent vision sensor, which has AI processing capabilities built into the image sensor logic chip.
  • In the demo, the sensor detects people in the space and outputs only the number of people present.
  • This makes it possible to use data in a variety of situations, such as analyzing consumer behavior in stores and assessing the occupancy rates of building conference rooms in real time.
Image of an image sensor chip on a finger. Images of the store being photographed by camera for analysis of consumer behavior in the store.
Back to Exhibit list

Deciphering marine environments
with underwater 3D sensing

Sony is conducting joint research to expand advanced sensing technology from the land to the sea and use it to visualize marine environments.* This exhibit introduces the results of an experiment in which an underwater drone equipped with Sony image sensors and 3D spatial sensing technology was used to ascertain the distribution of coral and seaweed habitats and generate 3D models using sensing data.

  • * Joint research with Hokkaido University and FullDepth Co., Ltd. The underwater drone used is a product of FullDepth Co., Ltd.

POINTS

  • Global shutter image sensors and 3D spatial mapping sensing technology support the autonomous movement and photography of the underwater drone.
  • Even in seas with obstacles such as waves and floating objects, the drone can move accurately without losing its position and capture high-definition images of ecosystems such as moving seaweed.
  • While streamlining environmental surveys and underwater inspections that previously required a great deal of human effort, this technology can also contribute to the conservation of blue carbon ecosystems to help address climate change.
Image of an underwater drone equipped with an underwater 3D sensing system. Image of underwater coral being photographed by an underwater 3D sensing system.
Back to Exhibit list

Enhance mobility safety and cabin experience
with sensing technology

Recently, advanced driver assistance systems have been increasingly installed in automobiles, leading to advancements in functions such as autonomous driving and parking assistance. "Safety Cocoon" is a safety concept that aims to enhance vehicle safety in various everyday driving scenes by detecting the 360-degree surroundings of a vehicle and supporting early evasive actions. Here, visitors can experience how Sony's diverse sensing technologies support this concept.

POINTS

  • In-vehicle image sensors for front detection, boasting an industry-leading* 17.42 megapixels, significantly extend the recognition range of road conditions, vehicles, and pedestrians.
  • SPAD ToF image sensors for in-vehicle LiDAR systems accurately detect and recognize the position and shape of surrounding objects, such as vehicles and pedestrians, contributing to enhanced vehicle safety.
  • For in-cabin sensing, ToF image sensors precisely track facial orientation, posture, and even the movements of the driver's head and limbs, enabling accurate recognition of the in-cabin environment.
  • * Among CMOS image sensors for in-vehicle cameras (as of the corresponding press release on September 12, 2023).
Image of a car driving on a bridge sensing its surroundings using in-vehicle sensing technology. Image of an in-cabin sensing, where the ToF image sensor recognizes the situation inside the vehicle with high accuracy.
Back to Exhibit list
return to top of this page.