Optimized Object Detection Technique in Video Surveillance System Using Depth Images

Abstract

In real-time surveillance and intrusion detection, it is difficult to rely only on RGB image-based videos as the accuracy of detected object is low in the low light condition and if the video surveillance area is completely dark then the object will not be detected. Hence, in this paper, we propose a method which can increase the accuracy of object detection even in low light conditions. This paper also shows how the light intensity affects the probability of object detection in RGB, depth, and infrared images. The depth information is obtained from Kinect sensor and YOLO architecture is used to detect the object in real-time. We experimented the proposed method using real-time surveillance system which gave very promising results when applied on depth images which were taken in low light conditions. Further, in real-time object detection, we cannot apply object detection technique before applying any image preprocessing. So we investigated the depth image by which the accuracy of object detection can be improved without applying any image preprocessing. Experimental results demonstrated that depth image (96%) outperforms RGB image (48%) and infrared image (54%) in extreme low light conditions. © 2020, Springer Nature Singapore Pte Ltd.