Sony to Release World's First Intelligent Vision Sensors with AI Processing Functionality

Mike A.

Known around here
Joined
May 6, 2017
Messages
3,825
Reaction score
6,377
Thought this was interesting...

Sony to Release World's First Intelligent Vision Sensors with AI Processing Functionality
Enabling High-Speed Edge AI Processing and Contributing to Building of Optimal Systems Linked with the Cloud

Tokyo, Japan — Sony Corporation today announced the upcoming release of two models of intelligent vision sensors, the first image sensors in the world to be equipped with AI processing functionality.*1 Including AI processing functionality on the image sensor itself enables high-speed edge AI processing and extraction of only the necessary data, which, when using cloud services, reduces data transmission latency, addresses privacy concerns, and reduces power consumption and communication costs.

These products expand the opportunities to develop AI-equipped cameras, enabling a diverse range of applications in the retail and industrial equipment industries and contributing to building optimal systems that link with the cloud.



Intelligent vision sensors
Left: IMX500 Right: IMX501

Model nameSample shipment dateSample price (excluding tax)
IMX500 1/2.3-type (7.857 mm diagonal) approx.
12.3 effective megapixel intelligent vision sensor (bare chip product)
April 202010,000 JPY
IMX501 1/2.3-type (7.857 mm diagonal) approx.
12.3 effective megapixel intelligent vision sensor (package product)
June 2020 (planned)20,000 JPY

The spread of IoT has resulted in all types of devices being connected to the cloud, making commonplace the use of information processing systems where information obtained from such devices is processed via AI on the cloud. On the other hand, the increasing volume of information handled in the cloud poses various problems: increased data transmission latency hindering real-time information processing; security concerns from users associated with storing personally identifiable data in the cloud; and other issues such as the increased power consumption and communication costs cloud services entail.

The new sensor products feature a stacked configuration consisting of a pixel chip and logic chip. They are the world's first image sensor to be equipped with AI image analysis and processing functionality on the logic chip. The signal acquired by the pixel chip is processed via AI on the sensor, eliminating the need for high-performance processors or external memory, enabling the development of edge AI systems. The sensor outputs metadata (semantic information belonging to image data) instead of image information, making for reduced data volume and addressing privacy concerns. Moreover, the AI capability makes it possible to deliver diverse functionality for versatile applications, such as real-time object tracking with high-speed AI processing. Different AI models can also be chosen by rewriting internal memory in accordance with user requirements or the conditions of the location where the system is being used.

(continues...)

 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
Wow thank you for sharing this seems interesting. Will be great to see once this sesnor is out and they start implementing this for security cameras.. :D I was also reading a while back about lidar being used


Hope in near future Lidar can become cheaper..
 
Top