Vayyar’s Single-Chip Platform Performs Gesture Detection

Vayyar’s Single-Chip Platform Performs Gesture Detection


4D Imaging using radar technology provides good resolution and field of view for scanning applications. Vayyar’s single-chip platform is a good example, as it integrates multiple antennas using RoC for improved 4D Imaging.

The multifunctional single-sensor platform fulfills the Euro NCAP safety requirements using its 4D Imaging feature. The chip comes with 48 transceiving antennas on a single package, hence reducing the complexity and cost of the device. The 4D Imaging chip is compatible with various software for creating in-cabin safety applications. This includes child presence detection, seat belt reminders, and gesture detection.

Backside of 4D Imaging chip

The gesture detection by using the 4D Imaging chip follows the conventional method of radar imaging, with some additional techniques. The radiowaves cover a certain volume of space by transmission through multiple antennas for calculating direction and distances. The usage of multiple antennas can create a 3D structure. Additionally, the chip also enables analysis of the neighboring pixels by receiving the data on all receiving antennas. This creates real-time imaging of continuous 3D frames, hence allowing 4D Imaging.

Talking more about gesture detection, the real-time 3D frames are in motion if the person moves from the original position to a different position. The 4D Imaging chip is capable of scanning the data using 5 cm large pixels in the space. The system then matches the pattern of these pixels with the general gesture patterns. As, the device supports real-time imaging, so it can detect the change in gestures on a real-time basis as well. This is how gesture detection happens using the 4D Imaging technique.

Deployed 4D Imaging Single-Chip Platform

Deployed single chip platform

The device supports an

“end-to-end software-hardware platform that enables OEMs and Tier 1s to develop multiple advanced applications independently over its point cloud layer. Hence, these include Occupant Status (OS), optimized airbag deployment and dynamic disabling, seat belt pre-tensioning, eCall, vital signs, gesture recognition, out-of-position detection, intruder detection and more.”

The 4D Imaging chip supports the software compatible with 3D point cloud API, which allows multiple platforms to interface with the device. This opens up the option of creating customized applications, depending upon the requirements. The real-time generated data in the form of pixel patterns can operate for multiple functionalities and allows continuous development of the overall system.

As discussed above, the 3D and the real-time 4D data collected can be stored and processed for multiple use cases. This can include image processing and deep learning applications, as the data is available in huge amounts. Hence, the ML models trained on neural networks with the 3D data can be a novel approach. Hence, Vayyar’s single-chip platform featuring in-cabin safety features and gesture detection can initiate the integration of AI with Radar Imaging techniques.

For more information about the in-cabin platform, visit the announcement of the company. To know more about the 4D Imaging chip, one can visit the company website.

Saumitra Jagdale is a Backend Developer, Freelance Technical Author, Global AI Ambassador (SwissCognitive), Open-source Contributor in Python projects, Leader of Tensorflow Community India, and Passionate AI/ML Enthusiast

view all posts by saumitra
Notify of
1 Comment
Inline Feedbacks
View all comments