ExInpaint plugin - Exemplar-Based Image Inpainting

Fizick · 14th January 2008, 21:51

Exemplar-Based Image Inpainting - removing large objects from images.

Selected objects has been replaced by a visually plausible background that mimics the appearance of the source region. Unlike other inpainting tools (logo removers), this filter does not blur image "holes". It tries to replace holes by similar texture elements (patches, exemplars, blocks) from frame image area, taking into account the image special points (with estimated confidence and priority). Block inpainting is started at hole border and propagates to its internal area, with isophote as a direction.

Algorithm is based on article: Object Removal by Exemplar-Based Inpainting. A. Criminisi, P. Perez, K. Toyama. In Proc. Conf. Comp. Vision Pattern Rec., Madison, WI, Jun 2003. http://research.microsoft.com/vision...isi_cvpr03.pdf

Code is based on project of Qiushuang Zhang
http://www.cc.gatech.edu/grads/q/qsz...inpainting.htm

First version of ExInpaint plugin is slow, not optimized, especially for large radius.

It is spatial filter developed for still images. Only current frame is used. So, we can see temporal instability in this version.

Potentially it may be used in video for:
-film restoration (spots and scratches removal);
-logo removal;
-filling of empty areas (borders) after motion stabilization (compensation);
-filling damaged areas after VHS capture;
-frame increasing without resizing :-)

It can be implemented differently, may be as a part of MVTools. Current version is mostly for experiment and testing.

For logo removing and similar tasks you can also try XLogo, AVSInpaint, Greycstoration inpainting filters.

14th January 2008, 21:51	#1 \| Link
Fizick AviSynth plugger Join Date: Nov 2003 Location: Russia Posts: 2,183	ExInpaint plugin - Exemplar-Based Image Inpainting Exemplar-Based Image Inpainting - removing large objects from images. Selected objects has been replaced by a visually plausible background that mimics the appearance of the source region. Unlike other inpainting tools (logo removers), this filter does not blur image "holes". It tries to replace holes by similar texture elements (patches, exemplars, blocks) from frame image area, taking into account the image special points (with estimated confidence and priority). Block inpainting is started at hole border and propagates to its internal area, with isophote as a direction. Algorithm is based on article: Object Removal by Exemplar-Based Inpainting. A. Criminisi, P. Perez, K. Toyama. In Proc. Conf. Comp. Vision Pattern Rec., Madison, WI, Jun 2003. http://research.microsoft.com/vision...isi_cvpr03.pdf Code is based on project of Qiushuang Zhang http://www.cc.gatech.edu/grads/q/qsz...inpainting.htm First version of ExInpaint plugin is slow, not optimized, especially for large radius. It is spatial filter developed for still images. Only current frame is used. So, we can see temporal instability in this version. Potentially it may be used in video for: -film restoration (spots and scratches removal); -logo removal; -filling of empty areas (borders) after motion stabilization (compensation); -filling damaged areas after VHS capture; -frame increasing without resizing :-) It can be implemented differently, may be as a part of MVTools. Current version is mostly for experiment and testing. For logo removing and similar tasks you can also try XLogo, AVSInpaint, Greycstoration inpainting filters.