Keynote - Adversary Modeling in Multimedia Surveillance
Mohan Kankanhalli

Abstract- Multimedia Surveillance systems are used for three purposes of deterrence, real-time monitoring and forensics. In all of intended uses, the notion of an adversary who is actively trying to defeat the system has not been studied much.

We consider surveillance problems to be a set of system-adversary interaction problems in which an adversary can be modeled as a rational (selfish) agent trying to maximize his utility. We feel that appropriate adversary modeling can provide deep insights into the system performance and also clues for optimizing the system's performance against the adversary. Further, the system designers should exploit the fact that they can impose certain restrictions on the intruders and the way they interact with the system. The system designers can analyze the scenario to determine conditions under which system outperforms the adversaries, and then suitably re-engineer the environment under a "scenario engineering" approach to help the system outperform the adversary. We show such enhancements to two significantly different surveillance scenarios using a game theoretic framework and present results of their adaptation. While the precise enforcements for the zero-sum ATM lobby monitoring scenario and the non-zero-sum traffic monitoring scenario are different, they lead to some useful generic guidelines for surveillance system designers.

Mohan Kankanhalli is a Professor at the Department of Computer Science at the National University of Singapore. He is also the Vice-Dean for Academic Affairs and Graduate Studies at the NUS School of Computing. He obtained his BTech (Electrical Engineering) from the Indian Institute of Technology, Kharagpur and his MS/PhD (Computer and Systems Engineering) from the Rensselaer Polytechnic Institute.

He is actively involved in the organization of many major conferences in the area of Multimedia. He is on the editorial boards of several journals including the ACM Transactions on Multimedia Computing, Communications, and Applications, IEEE Transactions on Multimedia, Springer Multimedia Systems Journal, Multimedia Tools and Applications, and the Pattern Recognition Journal.

His current research interests are in Multimedia Systems (content processing, retrieval) and Multimedia Security (surveillance, digital rights management and forensics).

More details are available at:

For problems or suggestions: contact Imagelab group - Webmaster: Roberto Vezzani - ©2007 -