Validation:Algorithms - Revision history

Peter at 19:07, 11 June 2014

2014-06-11T19:07:12Z

← Older revision		Revision as of 19:07, 11 June 2014
Line 89:		Line 89:
	\| MeanShiftComaniciu2003 \|\| \|\|		\| MeanShiftComaniciu2003 \|\| \|\|
	\|}		\|}

			== Dense Optical Flow ==
			{\| class="wikitable" border="1"
			! scope="col" width="75" \| Algorithm
			! scope="col" width="50" \| Status
			! scope="col" width="600" \| Comments
			\|-
			\| Brox Warping \|\| \|\|
			\|-
			\| HornSchunck \|\| \|\|
			\|-
			\| HornSchunck Pyramid \|\| \|\|
			\|-
			\| KLT \|\| \|\| Common technique.
			\|-
			\| Block \|\| \|\| Nothing to validate against. Not based off any specific paper.
			\|}

			== Image Segmentation ==
			{\| class="wikitable" border="1"
			! scope="col" width="75" \| Algorithm
			! scope="col" width="50" \| Status
			! scope="col" width="600" \| Comments
			\|-
			\| FelzenHutten04 \|\| \|\|
			\|-
			\| Mean-Shift \|\| \|\|
			\|-
			\| SLIC \|\| \|\|
			\|-
			\| Watershed \|\| \|\|
			\|}


	== Image Processing ==		== Image Processing ==

Peter: added link to validation boof and updated text

2013-12-28T19:45:45Z

added link to validation boof and updated text

← Older revision		Revision as of 19:45, 28 December 2013
Line 1:		Line 1:
	= ~~External~~ Validation =		= Validation and Regression =

	Correctly implementing algorithms and producing the expected performance is difficult. ~~Academic~~ papers ~~more of then than not~~ leave out important ~~implementation details which are~~ needed to reproduce their ~~results~~. ~~Just like with~~ the ~~halting problem in CS, its nearly impossible to formally prove that~~ an ~~algorithm is correctly implemented~~.		Correctly implementing algorithms and producing the expected performance is difficult. BoofCV contains thousands internal tests to help ensure correctness of its algorithms, but it is nearly impossible to be 100% sure that the implementation is correct. This is especially true since often academic papers leave out important implementations needed to reproduce their work!. In the best case scenario an implementation will be compared against the author's original implementation. This page contains a list of important algorithms inside of BoofCV and if they have been validated against external libraries or not.

	BoofCV contains ~~over a thousand internal~~ tests to ~~help ensure correctness~~ of ~~its~~ algorithms~~, but testing against external sources provides a hard number to compare against~~. ~~This page contains a list of important algorithms inside of BoofCV~~ and ~~if they~~ have ~~been validated against external libraries or not~~. ~~Just because some code has not been validated does not mean it is incorrect~~.		Source code used to validate BoofCV can be found at the [https://github.com/lessthanoptimal/ValidationBoof\| ValidationBoof project on GitHub]. ValidationBoof also contains regression tests designed to check for changes in stability/performance of different algorithms. It is entirely possible for all the unit tests to pass and have a 20% drop in performance due to a minor change. Regression tests are designed to catch those problems.

	{\| class="wikitable" border="1"		{\| class="wikitable" border="1"

Peter at 23:52, 27 December 2013

2013-12-27T23:52:59Z

← Older revision		Revision as of 23:52, 27 December 2013
Line 75:		Line 75:
	\|-		\|-
	\| Linear Trifocal 7 \|\| Validated \|\| [http://www.csse.uwa.edu.au/~wongt/matlab.html Compared to matlab code found online that was based off the same source.] [https://github.com/lessthanoptimal/ValidationBoof/tree/master/fast Validation Code]		\| Linear Trifocal 7 \|\| Validated \|\| [http://www.csse.uwa.edu.au/~wongt/matlab.html Compared to matlab code found online that was based off the same source.] [https://github.com/lessthanoptimal/ValidationBoof/tree/master/fast Validation Code]
			\|}

			== Object Tracking ==
			{\| class="wikitable" border="1"
			! scope="col" width="75" \| Algorithm
			! scope="col" width="50" \| Status
			! scope="col" width="600" \| Comments
			\|-
			\| TLD \|\| Validated \|\| Comparable to slightly less stable than original. TLD is less stable than it at first appears, making scoring difficult.
			\|-
			\| Circulant \|\| Validated \|\| Improved over original. Much faster and slightly more stable.
			\|-
			\| MeanShiftComaniciu2003 \|\| \|\|
	\|}		\|}

Peter at 20:45, 28 August 2013

2013-08-28T20:45:32Z

← Older revision		Revision as of 20:45, 28 August 2013
Line 26:		Line 26:
	\| SURF \|\| Validated \|\| Original authors reference binary and others. http://boofcv.org/index.php?title=Performance:SURF		\| SURF \|\| Validated \|\| Original authors reference binary and others. http://boofcv.org/index.php?title=Performance:SURF
	\|-		\|-
	\| SIFT \|\| \|\| ~~Validation on going~~. ~~Initial results are very promising~~.		\| SIFT \|\| Validated \|\| Scale-space is computed significantly different from original. Out performs reference binary, possibly due to more tuning options.
	\|-		\|-
	\| KLT \|\| \|\|		\| KLT \|\| \|\|

Peter at 14:19, 5 December 2012

2012-12-05T14:19:24Z

← Older revision		Revision as of 14:19, 5 December 2012
Line 25:		Line 25:
	\|-		\|-
	\| SURF \|\| Validated \|\| Original authors reference binary and others. http://boofcv.org/index.php?title=Performance:SURF		\| SURF \|\| Validated \|\| Original authors reference binary and others. http://boofcv.org/index.php?title=Performance:SURF
			\|-
			\| SIFT \|\| \|\| Validation on going. Initial results are very promising.
	\|-		\|-
	\| KLT \|\| \|\|		\| KLT \|\| \|\|
	\|-		\|-
	\| BRIEF \|\| \|\|		\| BRIEF \|\| \|\|
	\|-
	~~\| Oriented Gaussian \|\| NA \|\| Not validated and known to not replicate the original paper~~
	\|}		\|}

Peter at 12:18, 6 November 2012

2012-11-06T12:18:03Z

← Older revision		Revision as of 12:18, 6 November 2012
Line 74:		Line 74:
	\| Linear H \|\| \|\|		\| Linear H \|\| \|\|
	\|-		\|-
	\| Linear Trifocal 7 \|\| Validated \|\| [http://www.csse.uwa.edu.au/~wongt/matlab.html Compared to matlab code found online that was based off the same source.]		\| Linear Trifocal 7 \|\| Validated \|\| [http://www.csse.uwa.edu.au/~wongt/matlab.html Compared to matlab code found online that was based off the same source.] [https://github.com/lessthanoptimal/ValidationBoof/tree/master/fast Validation Code]
	\|}		\|}

Peter at 12:15, 6 November 2012

2012-11-06T12:15:31Z

← Older revision		Revision as of 12:15, 6 November 2012
Line 74:		Line 74:
	\| Linear H \|\| \|\|		\| Linear H \|\| \|\|
	\|-		\|-
	\| Linear Trifocal 7 \|\| Validated \|\| Compared to matlab code found online that was based off the same source.		\| Linear Trifocal 7 \|\| Validated \|\| [http://www.csse.uwa.edu.au/~wongt/matlab.html Compared to matlab code found online that was based off the same source.]
	\|}		\|}

Peter at 12:13, 6 November 2012

2012-11-06T12:13:47Z

← Older revision		Revision as of 12:13, 6 November 2012
Line 73:		Line 73:
	\|-		\|-
	\| Linear H \|\| \|\|		\| Linear H \|\| \|\|
			\|-
			\| Linear Trifocal 7 \|\| Validated \|\| Compared to matlab code found online that was based off the same source.
	\|}		\|}

Peter: /* 3D Vision */

2012-09-19T12:40:14Z

3D Vision

← Older revision		Revision as of 12:40, 19 September 2012
Line 62:		Line 62:
	\| EPnP \|\| \|\| Pending verification against author's code		\| EPnP \|\| \|\| Pending verification against author's code
	\|-		\|-
	\| ~~Linear F~~ \|\| \|\|		\| 8+ pt Fundamental \|\| \|\|
			\|-
			\| 8+ pt Essential \|\| \|\|
			\|-
			\| 7 pt Fundamental \|\| \|\|
			\|-
			\| 7 pt Essential \|\| \|\|
			\|-
			\| 5 pt Essential Nister \|\| \|\| Pending validation against author's Matlab code
	\|-		\|-
	\| Linear H \|\| \|\|		\| Linear H \|\| \|\|

Peter: /* Feature Detectors */

2012-09-18T19:18:00Z

Feature Detectors

← Older revision		Revision as of 19:18, 18 September 2012
Line 41:		Line 41:
	\|-		\|-
	\| Fast Hessian \|\| Validated \|\| Original authors reference binary and others. http://boofcv.org/index.php?title=Performance:SURF		\| Fast Hessian \|\| Validated \|\| Original authors reference binary and others. http://boofcv.org/index.php?title=Performance:SURF
			\|-
			\| FAST \|\| Validated \|\| Original author's source code. [https://github.com/lessthanoptimal/ValidationBoof/tree/master/fast Validation Code]
	\|-		\|-
	\| Harris Corner \|\| \|\|		\| Harris Corner \|\| \|\|