Example Image Classification

From BoofCV
Revision as of 11:09, 12 July 2021 by Peter (talk | contribs)
Jump to navigationJump to search

Example of how to use a previously trained neural network (trained using Torch loaded and run in Java using DeepBoof) and apply it the problem of image classification. Model data is often quite large and so you will need to download it from an external source. Locations for where you can download the model from are included with the high level interface.

Example Code:

Concepts:

  • Image Classification
  • Deep Neural Networks
  • Torch

Related Examples:

Videos:

Example Code

/**
 * This example shows how to create an image classifier using the high level factory, download the model, load it,
 * process images, and then look at the results.
 *
 * @author Peter Abeles
 */
public class ExampleImageClassification {
	public static void main( String[] args ) throws IOException {
		ClassifierAndSource cs = FactoryImageClassifier.vgg_cifar10();  // Test set 89.9% for 10 categories
//		ClassifierAndSource cs = FactoryImageClassifier.nin_imagenet(); // Test set 62.6% for 1000 categories

		File modelPath = DeepBoofDataBaseOps.downloadModel(cs.getSource(), new File("download_data"));

		ImageClassifier<Planar<GrayF32>> classifier = cs.getClassifier();
		classifier.loadModel(modelPath);
		List<String> categories = classifier.getCategories();

		String imagePath = UtilIO.pathExample("recognition/pixabay");
		List<String> images = UtilIO.listByPrefix(imagePath, null, ".jpg");
		Collections.sort(images);

		ImageClassificationPanel gui = new ImageClassificationPanel();
		ShowImages.showWindow(gui, "Image Classification", true);

		for (String path : images) {
			File f = new File(path);
			BufferedImage buffered = UtilImageIO.loadImage(path);
			if (buffered == null)
				throw new RuntimeException("Couldn't find input image");

			Planar<GrayF32> image = new Planar<>(GrayF32.class, buffered.getWidth(), buffered.getHeight(), 3);
			ConvertBufferedImage.convertFromPlanar(buffered, image, true, GrayF32.class);

			classifier.classify(image);

			// add image and results to the GUI for display
			gui.addImage(buffered, f.getName(), classifier.getAllResults(), categories);
		}
	}
}