For the ZXZC Awards 2022, the patented multi-sensor fusion technology from Whale Dynamic has applied for the Top 100 Players of China's New Automotive Supply Chain.

Photo credit: Whale Dynamic

Description:

The hardware of the early-stage fusion has extremely demanding requirements for the “time and space synchronization of lidar, camera, millimeter-wave radar, and integrated navigation." Whale Dynamic independently developed an early-stage fusion computing unit based on the ARM architecture, matching the time of no less than fifteen sensors to the millisecond level. Advanced industrial design processes ensure that the external parameter design tolerance of the sensor is at the millimeter level.

Photo credit: Whale Dynamic

Unique advantages:

The advantages of early-stage MSF algorithm are as follows: The fusion of visual perception and lidar point cloud is a single neural network for easy deployment. There are fewer conner cases to deal with conflicts between vision and lidar and other perceptions, and the long-term investment is far greater than the back-stage fusion/separate target matching scheme. Fusion accuracy is far superior to peers. The advanced electrical architecture also solves a series of specific engineering problems such as data compression and transmission of a large number of sensors, dynamic IP address allocation of each sensor, dynamic power distribution of each sensor, integrated heat dissipation, etc.,

Application:

The application scenario of this technology is highway-level autonomous driving, which can cope with different road conditions, such as urban public roads, congested road conditions, complex road conditions etc.

Prospect:

This technology makes L4 autonomy kit more integrated and more affordable and can also be installed onto Whale Dynamic’s multi-purpose autonomous vehicles.