Gesture recognition plays an important role in the field of human-computer interaction. Skin color detection algorithm is used for gesture image segmentation. Based on convolutional neural network MobileNetV2, the data training set is established. Through transfer learning, the gesture recognition model suitable for mobile devices is established.