Difference between revisions of "Example Planar Image"

From BoofCV
Jump to navigationJump to search
(Created page for MultiSpectral example)
 
m
 
(15 intermediate revisions by the same user not shown)
Line 1: Line 1:
= MultiSpectral Images =
The class Planar is used to store color images where each color or band is stored as an independent gray scale image. The advantage of using independent gray scale images for each band is that they can be easily processed by algorithms written for ImageGray.


MultiSpectral are used to store color images where each color or band is stored as an independent gray scale image.  This allows for each band in the image to be independently processed or modified easily.
In the example code below it is demonstrated how to convert Planar to and from BufferedImages, how to process each band independently, and how to access the pixel values.


Example code detailing how to convert, use, and manipulate MultiSpectral images is provided here:
Example File: [https://github.com/lessthanoptimal/BoofCV/blob/v0.40/examples/src/main/java/boofcv/examples/imageprocessing/ExamplePlanarImages.java ExamplePlanarImages.java]


[https://github.com/lessthanoptimal/BoofCV/blob/master/examples/src/boofcv/examples/ExampleMultiSpectralImages.java MultiSpectral Example Code]
Concepts:
* Color image processing


For now only a reference to the example code is provided because the code is not compatible with the current "stable" release, v0.3. Just after the release of v0.3 a bug was discovered where the color bands were not properly ordered when converting a MultiSpectral image into a BGR BufferedImage. The fix for this issue required a change the API and how ConvertRaster behaves. To get access to this fix check out the source code from github.
= Example Code =
 
<syntaxhighlight lang="java">
/**
* {@link Planar} images are one way in which color images can be stored and manipulated inside
* of BoofCV. Inside of a Planar image each color band is stored as an independent {@link ImageGray}.
* This is unlike the more common interleaved format where color information is stored in adjacent bytes in
* the same image.
*
* The main advantage of {@link Planar} is the ease at which gray scale operations can be applied to each
* band independently with no additional code. This is particularly useful in a library,
* such as BoofCV, which is heavily focused on gray scale image processing and computer vision. The are also
* situations for some scientific applications where processing each band independently makes more sense.
*
* @author Peter Abeles
*/
public class ExamplePlanarImages {
 
public static ListDisplayPanel gui = new ListDisplayPanel();
 
/**
* Many operations designed to only work on {@link ImageGray} can be applied
* to a Planar image by feeding in each band one at a time.
*/
public static void independent( BufferedImage input ) {
// convert the BufferedImage into a Planar
Planar<GrayU8> image = ConvertBufferedImage.convertFromPlanar(input, null, true, GrayU8.class);
 
// declare the output blurred image
Planar<GrayU8> blurred = image.createSameShape();
 
// Apply Gaussian blur to each band in the image
for (int i = 0; i < image.getNumBands(); i++) {
// note that the generalized version of BlurImageOps is not being used, but the type
// specific version.
BlurImageOps.gaussian(image.getBand(i), blurred.getBand(i), -1, 5, null);
}
 
// Declare the BufferedImage manually to ensure that the color bands have the same ordering on input
// and output
var output = new BufferedImage(image.width, image.height, input.getType());
ConvertBufferedImage.convertTo(blurred, output, true);
 
gui.addImage(input, "Input");
gui.addImage(output, "Gaussian Blur");
}
 
/**
* Values of pixels can be read and modified by accessing the internal {@link ImageGray}.
*/
public static void pixelAccess( BufferedImage input ) {
// convert the BufferedImage into a Planar
Planar<GrayU8> image = ConvertBufferedImage.convertFromPlanar(input, null, true, GrayU8.class);
 
int x = 10, y = 10;
 
// to access a pixel you first access the gray image for the each band
for (int i = 0; i < image.getNumBands(); i++)
System.out.println("Original " + i + " = " + image.getBand(i).get(x, y));
 
// change the value in each band
for (int i = 0; i < image.getNumBands(); i++)
image.getBand(i).set(x, y, 100 + i);
 
// to access a pixel you first access the gray image for the each band
for (int i = 0; i < image.getNumBands(); i++)
System.out.println("Result  " + i + " = " + image.getBand(i).get(x, y));
}
 
/**
* There is no real perfect way that everyone agrees on for converting color images into gray scale
* images. Two examples of how to convert a Planar image into a gray scale image are shown
* in this example.
*/
public static void convertToGray( BufferedImage input ) {
// convert the BufferedImage into a Planar
Planar<GrayU8> image = ConvertBufferedImage.convertFromPlanar(input, null, true, GrayU8.class);
 
var gray = new GrayU8(image.width, image.height);
 
// creates a gray scale image by averaging intensity value across pixels
ConvertImage.average(image, gray);
BufferedImage outputAve = ConvertBufferedImage.convertTo(gray, null);
 
// convert to gray scale but weigh each color band based on how human vision works
ColorRgb.rgbToGray_Weighted(image, gray);
BufferedImage outputWeighted = ConvertBufferedImage.convertTo(gray, null);
 
// create an output image just from the first band
BufferedImage outputBand0 = ConvertBufferedImage.convertTo(image.getBand(0), null);
 
gui.addImage(outputAve, "Gray Averaged");
gui.addImage(outputWeighted, "Gray Weighted");
gui.addImage(outputBand0, "Band 0");
}
 
public static void main( String[] args ) {
BufferedImage input = UtilImageIO.loadImageNotNull(UtilIO.pathExample("apartment_building_02.jpg"));
 
ExamplePlanarImages.independent(input);
ExamplePlanarImages.pixelAccess(input);
ExamplePlanarImages.convertToGray(input);
 
ShowImages.showWindow(gui, "Color Planar Image Examples", true);
}
}
</syntaxhighlight>

Latest revision as of 15:08, 17 January 2022

The class Planar is used to store color images where each color or band is stored as an independent gray scale image. The advantage of using independent gray scale images for each band is that they can be easily processed by algorithms written for ImageGray.

In the example code below it is demonstrated how to convert Planar to and from BufferedImages, how to process each band independently, and how to access the pixel values.

Example File: ExamplePlanarImages.java

Concepts:

  • Color image processing

Example Code

/**
 * {@link Planar} images are one way in which color images can be stored and manipulated inside
 * of BoofCV. Inside of a Planar image each color band is stored as an independent {@link ImageGray}.
 * This is unlike the more common interleaved format where color information is stored in adjacent bytes in
 * the same image.
 *
 * The main advantage of {@link Planar} is the ease at which gray scale operations can be applied to each
 * band independently with no additional code. This is particularly useful in a library,
 * such as BoofCV, which is heavily focused on gray scale image processing and computer vision. The are also
 * situations for some scientific applications where processing each band independently makes more sense.
 *
 * @author Peter Abeles
 */
public class ExamplePlanarImages {

	public static ListDisplayPanel gui = new ListDisplayPanel();

	/**
	 * Many operations designed to only work on {@link ImageGray} can be applied
	 * to a Planar image by feeding in each band one at a time.
	 */
	public static void independent( BufferedImage input ) {
		// convert the BufferedImage into a Planar
		Planar<GrayU8> image = ConvertBufferedImage.convertFromPlanar(input, null, true, GrayU8.class);

		// declare the output blurred image
		Planar<GrayU8> blurred = image.createSameShape();

		// Apply Gaussian blur to each band in the image
		for (int i = 0; i < image.getNumBands(); i++) {
			// note that the generalized version of BlurImageOps is not being used, but the type
			// specific version.
			BlurImageOps.gaussian(image.getBand(i), blurred.getBand(i), -1, 5, null);
		}

		// Declare the BufferedImage manually to ensure that the color bands have the same ordering on input
		// and output
		var output = new BufferedImage(image.width, image.height, input.getType());
		ConvertBufferedImage.convertTo(blurred, output, true);

		gui.addImage(input, "Input");
		gui.addImage(output, "Gaussian Blur");
	}

	/**
	 * Values of pixels can be read and modified by accessing the internal {@link ImageGray}.
	 */
	public static void pixelAccess( BufferedImage input ) {
		// convert the BufferedImage into a Planar
		Planar<GrayU8> image = ConvertBufferedImage.convertFromPlanar(input, null, true, GrayU8.class);

		int x = 10, y = 10;

		// to access a pixel you first access the gray image for the each band
		for (int i = 0; i < image.getNumBands(); i++)
			System.out.println("Original " + i + " = " + image.getBand(i).get(x, y));

		// change the value in each band
		for (int i = 0; i < image.getNumBands(); i++)
			image.getBand(i).set(x, y, 100 + i);

		// to access a pixel you first access the gray image for the each band
		for (int i = 0; i < image.getNumBands(); i++)
			System.out.println("Result   " + i + " = " + image.getBand(i).get(x, y));
	}

	/**
	 * There is no real perfect way that everyone agrees on for converting color images into gray scale
	 * images. Two examples of how to convert a Planar image into a gray scale image are shown
	 * in this example.
	 */
	public static void convertToGray( BufferedImage input ) {
		// convert the BufferedImage into a Planar
		Planar<GrayU8> image = ConvertBufferedImage.convertFromPlanar(input, null, true, GrayU8.class);

		var gray = new GrayU8(image.width, image.height);

		// creates a gray scale image by averaging intensity value across pixels
		ConvertImage.average(image, gray);
		BufferedImage outputAve = ConvertBufferedImage.convertTo(gray, null);

		// convert to gray scale but weigh each color band based on how human vision works
		ColorRgb.rgbToGray_Weighted(image, gray);
		BufferedImage outputWeighted = ConvertBufferedImage.convertTo(gray, null);

		// create an output image just from the first band
		BufferedImage outputBand0 = ConvertBufferedImage.convertTo(image.getBand(0), null);

		gui.addImage(outputAve, "Gray Averaged");
		gui.addImage(outputWeighted, "Gray Weighted");
		gui.addImage(outputBand0, "Band 0");
	}

	public static void main( String[] args ) {
		BufferedImage input = UtilImageIO.loadImageNotNull(UtilIO.pathExample("apartment_building_02.jpg"));

		ExamplePlanarImages.independent(input);
		ExamplePlanarImages.pixelAccess(input);
		ExamplePlanarImages.convertToGray(input);

		ShowImages.showWindow(gui, "Color Planar Image Examples", true);
	}
}