Feature Fusing of Feature Pyramid Network for Multi-Scale Pedestrian Detection

Abstract

Pedestrian detection is a fundamental component in many real-world applications such as automatic driving, intelligent surveillance, person re-identification and robotics. Therefore, it has attracted massive attention in the last decades. However, pedestrians in an images always exhibit different scales, which constitutes a significant mode of intra-class variability and affect the performance of pedestrian detection algorithm. To address this problem, we apply FPN (Feature Pyramid Network)for pedestrian detection. FPN exploits the inherent multi-scale structure of a deep convolutional network to construct a feature pyramid that has rich semantics at all levels and facilitates the detection of objects at different scales. To leverage the information from different levels of the feature pyramid, we extend the FPN-based pedestrian detection by fusing the feature of each level with adaptive feature pooling. Furthermore, we also integrate a Squeeze and Excitation module to the ROI pooled features from each level before the feature fusion. The experiment result on Caltech dataset shows that our approach outperforms the basic FPN-based pedestrian detection and robust towards to various scale of pedestrian.