Protecting the value of "as it is" captured by creators - Taking on Fake Images with Real-time Technology -
With the remarkable evolution of AI (Artificial Intelligence), while new possibilities for creative expression are expanding, the proliferation of fake images and false information has also become a global social issue. At this year's Corporate Strategy Meeting, Chairman and CEO, Kenichiro Yoshida stated that it is great of significance for creators to capture the real world "as it is", and introduced Sony's Camera Authenticity Solution, which utilizes real-time technology, an area Sony's focusing on, to verify the authenticity of captured data. We spoke with Sony employees involved in developing the Camera Authenticity Solution to learn about the background to developing the technology and hear about their passion for the project.
Real vs. Fake - The Value of Photography That Captures Reality -
In recent years, the evolution and proliferation of photo editing application software utilizing AI make it possible for anyone to easily apply advanced editing to images using a PC or smartphone. While this is expanding new possibilities for creative expression, the proliferation of fake images has also led to growing concern about the impact of fake images as a social issue.
Yosuke Hiratsuka, who has been involved in developing camera shooting, editing and encryption functions, came to think about the importance of verifying authenticity.
"What would happen if we couldn't distinguish real and fake images?" The first thing that came to Hiratsuka's mind was the faces of photographers he had built relationships with over many years through camera development.
"Their photographs contain all the time and effort they have invested into capturing that moment with their passion to convey the truth. However, if real and fake images become indistinguishable, the value of their hard work could vanish in an instant. We must protect the true value, or authenticity, embodied in their photographs," says Hiratsuka, who feels a strong sense of mission to work on the authenticity of photos.
Ryoko Shimokawa, who oversees Sony's camera cloud business, sees significance in verifying authenticity says "As a camera manufacturer, using Sony's technology to contribute to creators is an important mission. It also leads to safer utilization of AI that brings new possibilities for creative expression."
The Key to Authenticity is "Real-time"
The Camera Authenticity Solution was developed in response to these circumstances, and is currently being offered to select news agencies*.
During shooting, the Alpha 1, Alpha 9 III, Alpha 7S III, and Alpha 7 IV, the full-frame mirrorless interchangeable lens cameras equipped with this technology provide the in-camera digital signature to the image file indicating that the image was actually captured with the camera.
According to Hiratsuka, what sets this signature technology apart is that it is applied in real-time at the time of shooting, which is crucial for verify authenticity.
"For example, if you add a signature after importing the image to a PC, there is a possibility it could be edited or altered in the meantime. Applying the signature instantly in the camera at the time of shooting eliminates that concern."
On the value of real-time processing, Shimokawa says, "The more time passes after shooting, the more chances there are for fakes to be generated. To leave no room for such chances, we can leverage our strength of real-time processing the instant the subject is captured by the image sensor."
Moreover, to verify that a photo is authentic, there is one more indispensable element in addition to the signature technology, which is the ability to judge whether the captured subject itself is "real" or not. Without this, there is a pitfall that even if you are capturing a fake image or video with the camera, it would recognize it as "real."
This potential problem was solved by 3D-depth information identification processing realized with the proprietary technology in the image sensor developed by Sony, demonstrating the advantages of the CMOS image sensors being produced by Sony Semiconductor Solutions. As Hiratsuka recalls, "The missing piece we were exploring in addition to the signature technology fell into place."
This technology can verify whether a real, 3D object is being captured or if it is a photograph of an image or video.
Shimokawa says, "Sony has an environment where engineers from each business segment can discuss what can be achieved with each other's technologies. This real-time technology was something we were able to make possible thanks to our connections across the Sony Group."
* As of June 28, 2024
Desire to Continue Engaging Sincerely with Creators
Sony is working closely with creators and press photographers who are tackling the urgent issue of fake news and is utilizing their feedback on the Camera Authenticity Solution for further improvement. Shimokawa looks ahead, saying "We want to protect the value of truth. And we will continue discussions with them to make this technology available to more people."
In addition, the Camera Authenticity Solution now supports the C2PA format, a standards-setting body that will develop technical specifications on content provenance and authentication by certifying the source and history of media content. With this update, the authenticity information embedded on the image can be maintained from capture through publication when an image is repeatedly edited in C2PA-compliant software. This accomplishment is a result of Sony's participation on the C2PA steering committee and contribution to developing industry standards.
By offering comprehensive support, Sony aims to protect the transparency of content all the way until the last moment the content reaches to the customer, and this commitment is backed up by Sony's culture of a "creator-first". "We are increasing opportunities to engage in direct dialogue with users of our products to understand them better. Because we see creators who are seriously engaged in their creative activities up close, we naturally feel a desire to contribute to their work," says Shimokawa.
The Camera Authenticity Solution has been made possible by the passion and desire of the employees to support photographers and the real-time technologies achieved by integrating Sony Group's technologies. Sony will continue to support solutions that pursue reality and contribute to creators and society.