Based on the machine vision technology, convolutional neural network (CNN) was used to detect and recognize, and verified the cherry defects. The results showed that the recognition accuracy of intact cherry was 99.25%, with the average recognition accuracy of defective cherry of 97.99%, and the recognition speed was 25 per second. Compared with other research methods, this method could accurately detect and identify various types of defects.