Hidden Markov Models, 2 D Shape Classification, Model Selection, Probabilistic Learning
Abstract
Abstract—In this paper, Hidden Markov Models (HMMs) are investigated for the purpose of classifying planar shapes represented by their curvature coefficients. In the training phase, special attention is devoted to the initialization and model selection issues, which make the learning phase particularly effective. The results of tests on different data sets show that the proposed system is able to accurately classify objects that were translated, rotated, occluded, or deformed by shearing, also in the presence of noise.
1. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint. MIT Press, 2003.
2. S. Loncaric, "A Survey of Shape Analysis Techniques," Pattern Recognition, vol. 31, no. 8, pp. 983-1001, 1998.
3. P. Suetens, P. Fua, and A. Hanson, "Computational Strategies for Object Recognition," ACM Compuiting Surveys, vol. 24, no. 1, pp. 5-61, 1992.
4. L. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, 1989.
5. J. Hu, M. Brown, and W. Turin, "HMM Based Online Handwriting Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 10, pp. 1039-1045, oct. 1996.
6. R. Hughey, and A. Krogh, "Hidden Markov Model for Sequence Analysis: Extension and Analysis of the Basic Method," Computer Applications in the Biosciences, vol. 12, pp. 95-107, 1996.
7. S. Eickeler, A. Kosmala, and G. Rigoll, "Hidden Markov Model Based Continuous Online Gesture Recognition," Proc. IEEE Int'l Conf. Pattern Recognition, vol. 2, pp. 1206-1208, 1998.
8. T. Jebara, and A. Pentland, "Action Reaction Learning: Automatic Visual Analysis and Synthesis of Interactive
Behavior," Proc. Int'l Conf. Computer Vision Systems, 1999.
9. Y. He, and A. Kundu, "2-D Shape Classification Using Hidden Markov Model," IEEE Trans. Pattern Analysis Machine Intelligence, vol. 13, no. 11, pp. 1172-1184, Nov. 1991.
10. N. Arica, and F. Yarman-Vural, "A Shape Descriptor Based on Circular Hidden Markov Model," proc. IEEE Int'l Conf. Pattern Recognition, vol. 1, pp. 924-927, 2000.
11. A. Fred, J. Marques, and P. Jorge, "Hidden Markov Models vs. Syntactic Modeling in Object Recognition," Proc. IEEE Int'l Conf. Image Processing, vol. 1, pp. 893-896, 1997.
12. J. Cai, and Z.-Q. Liu, "Hidden Markov Models with Spectral Features for 2D Shape Recognition," IEEE Trans. Pattern Analysis Machine Intelligence, vol. 23,
no. 12, pp. 1454-1458, Dec. 2001.
13. G. Schwarz, "Estimating the Dimension of a Model," The Annals of Statistics, vol. 6, no. 2, pp. 461-464, 1978.
14. L. Baum, T. Petrie, G. Soules, and N. Weiss, "A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions
of Markov Chains," Annals of Math. Statistics, vol. 41, no. 1, pp. 164-171, 1970.
15. A. Dempster, N. Laird, and D. Rubin, "Maximum Likelihood from Incomplete Data via the EM Algorithm," J. Royal Statistical Soc. B, vol. 39, pp. 1-38, 1977.
16. L. Baum, "An Inequality and Associated Maximization Technique in Statistical Estimation for
Probabilistic Functions of Markov Processes," Inequality, vol. 3, pp. 1-8, 1970.
17. G. McLachlan, and D. Peel, Finite Mixture Models. New York: John Wiley & Sons, 2000.
18. C. Wu, "On the Convergence Properties of the EM Algorithm," The Annals of Statistics, vol. 11, no. 1, pp. 95-103, 1983.
19. A. Stolcke, and S. Omohundro, "Hidden Markov Model Induction by Bayesian Model Merging," Advances in Neural Information Processing Systems, S. Hanson, J. Cowan, and C. Giles, eds., pp. 11-18, vol. 5, Morgan Kaufmann, 1993.
20. M. Brand, "An Entropic Estimator for Structure Discovery," Advances in Neural Information Processing Systems, MIT Press, M. Kearns, S. Solla, and D. Cohn, eds.,
vol. 11, 1999.
21. M. Bicego, A. Dovier, and V. Murino, "Designing the Minimal Structure of Hidden Markov Models by Bisimulation," Energy Minimization Methods in Computer Vision and Pattern Recognition, M. Figueiredo, J. Zerubia, and A. Jain, eds., Springer, pp. 75-90, 2001.
22. M. Bicego, V. Murino, and M. Figueiredo, "A Sequential Pruning Strategy for the Selection of the Number of States in Hidden
Markov Models," Pattern Recognition Letters, vol. 24, nos. 9-10, pp. 1395-1407, 2003.
23. T. Sebastian, P. Klein, and B. Kimia, "Recognition of Shapes by Editing Shock Graphs," Proc. Int'l Conf. Computer Vision, pp. 755-762, 2001.
24. M. Bicego, and V. Murino, "2D Shape Recognition by Hidden Markov Models," Proc. IEEE Int'l Conf. Image Analysis and Processing, pp. 20-24, 2001.
25. L. Shapiro, and G. Stockman, Computer Vision. Prentice Hall, 2001.
26. S. Theodoridis, and K. Koutroumbas, Pattern Recognition. Academic Press, 1999.