DSP, Micros & Memory


New hybrid sensor for in-car safety and comfort monitoring

26 October 2022 DSP, Micros & Memory

As leading automotive markets start to mandate driver-monitoring systems (DMS), STMicroelectronics is already equipping carmakers with the required technologies. While DMS promises greater road safety by assessing driver alertness, the next-generation dual image sensor from ST monitors the full vehicle interior, covering both the driver and all passengers. New applications enabled by ST’s new image sensor include passenger safety-belt checks, vital-sign monitoring, child-left detection, gesture recognition, and high-quality video/picture recording.

“The DMS market is growing at a double-digit pace and ST’s new image sensor is set to push that forward by enabling brands to create new services and deliver even greater value for vehicle users, leveraging complete in-cabin monitoring that covers multiple occupants,” said Eric Aussedat, executive vice president, imaging sub-group general manager, STMicroelectronics. “Our market-leading DMS sensor provided the perfect launchpad to take the technology further and empower new innovations.”

The new sensor, the VD/VB1940, delivers a cost-effective solution that combines the sensitivity and high resolution of infrared sensing with high dynamic range (HDR) colour imaging in a single component. It can capture frames in rolling-shutter or global-shutter modes. With 5,1-megapixels, it captures the high-dynamic-range (HDR) colour images needed for an occupant monitoring system (OMS) in addition to the high-quality near-infrared (NIR) images typically captured by standard DMS sensors. DMS uses NIR imaging to analyse driver head and eye movements in all lighting conditions.

The new automotive image sensor uses ST’s second-generation 3D-stacked back-side illuminated (BSI) wafer technology, which maximises the optical area and on-chip processing in relation to die size. This lets the sensor perform sophisticated algorithms locally for optimal performance in both colour and NIR imaging, saving power and relieving demand for an external co-processor.

Algorithms performed on-chip include Bayer conversion and HDR merging for optimal image-quality and frame rate. On-chip Bayerisation processing enables the user to reshuffle the colour pixels of the RGB NIR 4X4 pattern into the RGGB format compatible with a wide range of SoCs. In addition, local processing also handles independent colour and NIR pixel-exposure optimisation for optimum image quality in both modes, as well as smart upscaling to maximise NIR image resolution by capturing extra NIR information from RGB pixels.

ST has planned to meet demand for 2024 model vehicles that are currently in design.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Arduino platform with Analog Devices technology for flexible industrial control
Altron Arrow Editor's Choice DSP, Micros & Memory
Software-configurable systems enable industrial OEMs to deliver unprecedented flexibility to the factory floor, while simplifying product complexity.

Read more...
Advanced eMMC storage solutions
Future Electronics DSP, Micros & Memory
Alliance Memory provides advanced NAND flash memory storage solutions that follow the JEDEC eMMC v5.1 standard to meet the growing demand for efficient, high-capacity storage solutions in today’s digital era.

Read more...
PMIC extends life of BLE products
Avnet Silica Power Electronics / Power Management
Nordic Semiconductor’s nPM2100 PMIC incorporates an ultra-efficient boost regulator and a wide range of energy-saving features to significantly extend operating time in non-rechargeable battery applications.

Read more...
NPU in the most powerful STM32 processor
Future Electronics DSP, Micros & Memory
The STM32N6 is STMicroelectronics’ newest and most powerful STM32 and the first to come with the company’s Neural-ART Accelerator, a custom NPU capable of 600 GOPS.

Read more...
Low-noise chip-scale atomic clock
Avnet Silica DSP, Micros & Memory
Microchip Technology has announced its second generation Low-Noise Chip-Scale Atomic Clock, model SA65-LN, in a lower profile height and designed to operate in a wider temperature range.

Read more...
ESP32-C6 achieves Thread 1.4 certification
iCorp Technologies DSP, Micros & Memory
The ESP32-C6 has achieved Thread 1.4 Interoperability Certification, offering secure commissioning, advanced diagnostics, enhanced internet connectivity with Thread over Infrastructure, and optimised energy-efficient device roles.

Read more...
PCIe Gen 4 16-lane switch
RS South Africa DSP, Micros & Memory
Microchip’s PCI100x devices deliver high performance and cost efficiency for any application where accelerated or specialised computing is used.

Read more...
Ultra-low-power MCX L microcontroller
Avnet Silica DSP, Micros & Memory
The MCX L series features an Arm Cortex-M33 core, running at up to 96 MHz and a Cortex-M0+ core operating as an ultra-low-power always-on sense domain.

Read more...
Webinar: AMD Vitus Unified Software Platform
DSP, Micros & Memory
By mastering this bi-directional workflow to efficiently transition between AMD Vitis and AMD Vivado environments, design engineers will be able to maximise their productivity.

Read more...
Low-cost i.MX development board
Altron Arrow DSP, Micros & Memory
The FRDM i.MX 93 development board from NXP is a low-cost and compact development board featuring the i.MX93 applications processor.

Read more...