Abstract
We propose an object recognition method in which the identity of objects are determined by observing the finger pointing action of persons. The system determines the head and hands regions, tracks them in real time, and verifies them through an analysis of 3-D data points. Then it determines the pointing direction and intersects it with an environment model. Intersection computations are based on potential field models for both the finger pointing process and the object representations.