This design realizes a vision detection system, which can detect human visual acuity through gesture recognition technology. The system includes several modules: acquisition, data storage and conversion, gesture recognition and output control. And the camera, memory, display and speaker are connected externally. The visual icon "E" is displayed on the display screen, and then people use gestures to indicate the direction of "E". After the camera captures the image, the system recognizes and judges the direction of gesture, and then compares the correct direction to detect the visual acuity of people. Because the system eliminates manual detection, it is convenient, accurate and it saves manpower. The system realizes dynamic gesture interaction, being interesting and easy to be popularized.