Semantic Indexing of Multimedia Documents

We propose two approaches for semantic indexing of audio–visual documents, based on bottom-up and top-down strategies. We base the first approach on a finite state machine using low-level motion indices extracted from an MPEG compressed bitstream. The second approach innovatively performs semantic indexing through Hidden Markov Models.