eYs3D Microelectronics, a subsidiary of Etron, has launched a multi-sensor image controller for autonomous systems, writes Nick Flaherty.

The eSP936 supports the synchronous processing of data from up to seven visual sensors to provide high image-recognition accuracy.

The eSP936 can be integrated with multi-modal visual language models in automated guided vehicles, autonomous mobile robots and UAVs. The eSP936 can process multiple 2D images at high speeds and generate 3D depth maps, enhancing precise environmental recognition.

The eSP936 has a built-in DRAM chip and wide-angle image de-warping technology, enabling high-precision environmental perception and multi-view, 3D-depth map generation.

It also features high-performance data-compression to reduce latency. The MIPI+USB simultaneous processing technology ensures high-quality 2D image and 3D depth map output, improving image recognition accuracy. 

The eSP936 and XINK-ll edge spatial computing platform is used in the YX9170 sensor-fusion system. This integrates dual-depth sensors, supporting high-definition images up to 1280 x 720 resolution, and synchronises four RGB cameras for enhanced perception range and recognition accuracy.

A highlight of the YX9170 is intelligent sensing. The embedded AI algorithms enable real-time, multi-object recognition from synchronised images, achieving a 30% reduction in system computational load and latency.

The eSP936 is used in the YX9670 navigation system for autonomous vehicles. As well as dual-depth sensors and quad RGB cameras giving a 278o panoramic field of view, a monochrome camera provides a 145o overhead view alongside a thermal imaging sensor. An attitude and heading reference system (AHRS) is used for vehicle coordination.

The YX9670’s embedded AI algorithms enable real-time panoramic object recognition, navigation direction analysis and multi-target tracking.