A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration

摘要

This paper presents the design and implementation of a <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$128\times 128$ </tex-math></inline-formula> electronically foveated dynamic vision sensor (EF-DVS) fabricated using 350 nm CMOS technology. The EF-DVS integrates a novel pixel grouping approach that permits real-time dynamic resolution adjustments via external digital signals. Previous approaches rely on physically crafting high- and low-resolution regions, which require a mechanical setup for tracking moving objects within the fovea. Here, our innovation supports flexible and fast operation modes, acting on amplified photocurrents, allowing the sensor to operate in both high-resolution and low-resolution settings, and to configure multiple high-resolution regions of interest (ROIs) with arbitrary shapes and sizes within the pixel array in real-time. Although the pixel circuitry is more complex than its un-foveated predecessor, we have kept the same pixel area, sacrificing slightly fixed pattern noise (FPN). The sensor achieves a latency of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$3.66~{\mu \text {s}}$ </tex-math></inline-formula> and demonstrates a contrast sensitivity down to 1.03%. It maintains a dynamic range exceeding 120 dB and an intra-scene dynamic range above 60 dB. Notably, the power consumption is reduced with respect to its predecessor, down to 0.7 mW at 100 Keps when configured in low-resolution mode with a <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$2\times 2$ </tex-math></inline-formula> pixel grouping. The ability to dynamically adjust spatial resolution reduces noise event rates, enhances sensitivity, and lowers both data bandwidth and processing requirements. These features make the EF-DVS a suitable candidate for applications in robotics, surveillance, and real-time monitoring systems where efficient data processing and low latency are critical.