The project intends to establish a link between fundamental sensing tasks and automated cognition processes that concern the understanding a short-term prediction of human behaviour as well as complex human interaction. The analysis of human behaviour is unrestricted environments, including localization and tracking of multiple people and recognition of their activities, currently constitutes a topic of intensive research in the signal processing and computer vision communities. This research is driven by diferent important applications, including unattended surveillance and intelligent space monitoring. The overall goal of the project is the development of principled methods to link fundamental sensing tasks using multiple modalities, and automated cognition regarding the understanding of human behaviour in complex indoor environments, at both individual and collective levels. Given the two above principles, the consortium will conduct research on three core scientific and technological objectives: 1) sersor modelling and information fusion from multiple, heterogeneous perceptual modalities 2) modelling, localization, and tracking of multiple people 3) modelling, recognition, and short-term prediction of continuous complex human behaviour