Chennai Mathematical Institute

Seminars




Data Science Seminar
Date: 03/03/2023
Day: Friday
Time: 2 pm
Venue: NKN Hall
Title: Egocentric Activity Recognition by Subject-Action Relevance

Snehasis Mukherjee
Shiv Nadar University.
03-03-23


Abstract

Human Activity Recognition in videos is a well-studied problem during the last two decades. However, the problem of recognizing human activity, especially in challenging videos with unusual abrupt motion and background disturbances, still remains an unsolved problem. Egocentric videos are videos captured from a camera placed on the performers’ head. The unexpected head movements of the wearer make the process of recognition challenging in egocentric videos. Due to the absence of gesture information of the performers, motion information of the surrounding objects are the only cue in the recognizing process. However, the surrounding objects may even get changed in different videos of the same activity, leading to a high intra-class variation. The intra-class variation makes it difficult to apply any learning based algorithms. Further, the extreme camera jerk makes the recognition task even more challenging. In such a scenario, this talk will feature a few published articles on the same topic, and show how the published methods address the challenges involved in Egocentric Activity Recognition. The method proposed in this talk, will establish a relationship between the subject (the object, the wearer interacts with), and the action. Further, this talk will conclude with a few possible directions of future research based on this topic.

Short bio: Snehasis Mukherjee is an Assistant Professor at Shiv Nadar University, Delhi NCR, India. He obtained his PhD in Computer Science from Indian Statistical Institute in 2012. He worked as a Post Doctoral Fellow at NIST, Gaithersburg, USA for 2 years. Then he spent 6 years as an Assistant Professor at IIIT Sricity till April 2020. He has authored several peer-reviewed research papers in reputed journals and conferences. Snehasis is an Associate Editor of the Springer journal of SN Computer Science. He is an active reviewer of several reputed journals such as IEEE Trans. NNLS, IEEE Trans. CSVT, IEEE Trans. IP, IEEE Trans. ETCI, IEEE Trans. HMS, IEEE Trans. Cyb, IEEE CIM, CVIU, Pattern Recognition, Neural Networks, Neurocomputing, and many more. He chaired sessions in several prestigious conferences such as ICARCV, ICVGIP and NCVPRIPG. His research area includes Computer Vision, Machine Learning, Image Processing and Graphics.