Efficient Uncertainty Estimation for a Hybrid Wide-Area Human Action Analysis System

摘要

Nowadays, wide-area action analysis systems are widely used in security and robotics communities, where multiobject simultaneous searching and action recognition play critical roles. However, these systems face challenges in balancing imaging resolution, searching efficiency, and localization precision. To tackle these problems, this research introduces a hybrid system that combines a wide-angle camera, a high-speed camera, and vibrating mirrors. Specifically, a high-probability region (HPR) generation method based on a wide-angle camera is introduced to estimate potential regions where target objects will appear, which enhances search efficiency by avoiding random searching. Then, based on the generated prior information, an uncertainty estimation module is introduced to approximate the best location and size of the object using tailored localization and size uncertainty estimation methods. Uncertainty measurement will narrow the searching range and increase the localization accuracy. Finally, by integrating the HPR generation and uncertainty estimation modules, an efficient hybrid vision system is implemented, which can search multiobject in wide areas and conduct action analysis on the detected objects. Comprehensive indoor and outdoor experiments demonstrate that the detection framework with HPRs can achieve a 12.5% improvement in recall, and with uncertainty estimation, there is at least 67.12% localization precision improvement. These results verify the efficiency and robustness of the system. Source code is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/longxianlei/Hybrid-Wide-Area-Human-Action-Analysis-System</uri>.