Pedestrian equipment anomaly detection with computer vision in warehouses

Abstract

The rapid growth of the logistics sector in recent years caused the expansion of warehouse areas and the increase in the number of equipment used. With the increase in these activities, the possibility of work accidents in warehouses also increases. In defiance of this situation, it has been determined that a real-time prediction system of pedestrian and equipment interaction is needed to ensure in-warehouse reliability. This system should address the urgent need to reduce the risk of work accidents and focus on the overall goal of reducing the possibility of work accidents in warehouse environments. To overcome this challenge, we propose a comprehensive Warehouse Anomaly Detection and Control System consisting of object detection, object tracking, action detection, and alarm classification components which will play an important role in increasing work safety in warehouse environments. YOLOv7 (You Only Look Once version 7) is a deep learning model that detects objects quickly and accurately in a single network pass. The deep learning-based Deep SORT algorithm used for object tracking provides a dynamic understanding of the warehouse environment by continuously storing these identified problems in real-time. The action detection part of this system is designed to identify and analyze actions and movements, recognizing anomalies and potential risks. In this part, the speed of pedestrians and equipment are detected utilization of 3D bounding boxes of objects and perspective transformation. The possible accident risks are measured using the intersection percentage of these areas, the magnitude of speed, the direction of the motion vector of pedestrian and equipment, and the distances between objects. Alert levels can be considered as encounter, near-miss, and emergency. Using this system in warehouses will reduce the risk of possible work accidents that may even result in death. © 2024, Avestia Publishing. All rights reserved.