Diseases in fruit cause catastrophic problem in economic losses and production in agricultural industry worldwide. The main aim of this paper is to provide literature survey which gives an idea that what has been done till now and what is the scope of current research for the image categorization problems and present a solution to farmers for detecting and classifying diseases present in fruit which are experimentally validated. Image processing based approach composed of the following steps is used; in the first step the proposed approach would be using clustering technique for image segmentation which is followed by extraction of some features from the segmented image and finally images are classified into one of the classes.