The aim of the project deals with the Classification of the disease-affected Pomegranate fruit into 3 classes Bacterial, Fungal, or Healthy. The data set consisted of 239 Images of Leaves and 419 Images of Fruits. We developed a Convolutional Neural Network(CNN) for its Classification.