In this paper, SAD(Sum of Absolute Differences) matching algorithm and IMM Kalman filtering algorithm are combined

to build a prototype of real-time tracking and monitoring system. The system detects the target by using SAD matching algorithm,combined with IMM Kalman filtering algorithm to make the tracking more accurate, so as to optimize the existing monitoring system.The SAD matching algorithm and IMM Kalman filtering algorithm are respectively simulated by MATLAB in this paper. The simulation results show that the combination of SAD matching algorithm and IMM Kalman filtering algorithm can realize the detection and tracking function, which has practical significance.