A Smart Semi-Automated Multifarious Surveillance Bot for Outdoor Security Using Thermal Image Processing

摘要

Unauthorized entry in restricted areas represents an obvious security issue. Therefore, strict monitoring is highly required in order to ensure security. This research presents a smart surveillance bot for highly restricted areas with (1) automatic surveillance of an area specified by the user and obstacle detection and avoidance using Ultrasonic Sensor (2) human detection using Infrared (IR) thermal camera and identification of friend or foe (IFF) using RFID tags (3) live video surveillance using camera and manual remote control mode. The bot has the ability to detect human presence in an area using thermal image processing. If the bot detects and human presence while operating in surveillance mode, it confirms whether the person is a friend or foe by reading RFID. If the bot identifies the person as foe, it automatically sends the user a notification of intrusion and turns on live video streaming. The user would be able to take total control of the bot remotely in order to verify and judge on the situation using live video streaming. It also exhibits warning message in its display and points a toy gun at the intruder. In real life cases, the toy gun can be replaced with actual ones. The user bears the authority to decide whether to shoot or not. Due to having tank rover chassis, the robot has the ability to maneuver in rough terrains which enhances its versatility and usability.