Computer Aided Puzzle Assembly based on Shape and Texture
M. S. Sagiroglu
The puzzle assembly has a great importance that it can be applied many areas such as restoration and reconstruction of archeological findings, repairing of broken objects, solving jigsaw type puzzles, molecular docking problem, etc. The puzzle pieces usually include not only geometrical shape information but also visual information of texture, color, continuity of lines and so on. Moreover, textural information is mainly used to assembly pieces in some cases like classic jigsaw puzzles. This research presents a new approach that pictorial assembly, in contrast to previous curve matching methods, uses texture information as well as geometric shape. The assembly is performed using textural features and geometrical constraints. First, the texture of a band outside the border of pieces is predicted by inpainting and texture synthesis methods. The feature values are derived by these original and predicted images of pieces. A combination of the feature and confidence values is used to generate an affinity measure of corresponding pieces. Two new algorithms using FFT based image registration techniques are developed to optimize the affinity. The algorithms for inpainting, affinity and FFT based assembly are explained with experimental results on real and artificial data. The main contributions of this research are;
- The development of a performance measure that represents the goodness of assembly of pieces based on textural features and geometrical shape.
- Solution of assembly problem by using of the FFT based methods.