ACM Student Chapter Eminent Speaker Program
"Multimodal Information Processing :
Some recent NLP applications"
at Techno India University, West Bengal
Organized by Techno India University WB ACM Student Chapter
Dr. Sriparna Saha
Associate Professor
Department of Computer Science and Engineering
Indian Institute of Technology Patna, India
Multimodal Information Processing: Some recent NLP applications
Synopsis
Multimodal information processing deals with the efficient usage of information available in different modalities such as audio, video, text, etc. for solving various task applications of real life. This talk will discuss how the multimodal information extracted from different modalities can help in improving different tasks of dialogue systems, summarization, hate speech detection, and complaint mining.
Multimodal information collected from audio tones, facial expressions, and texts is utilized for determining the type of utterance in a multitask setting where emotion recognition and dialogue act classification tasks are solved simultaneously. Multimodal information collected from videos, images, and texts can also be utilized for generating a summary.
Images and texts collected from Amazon reviews are utilized for developing some aspect-based multimodal complaint detection systems in a multi-task setting where sentiment and emotion information are utilized as auxiliary tasks. Memes collected from social media are utilized for the detection of hate speech in a multitask setting where sentiment, emotion, and sarcasm detection are utilized as auxiliary tasks. This talk will highlight these different applications of multimodal information processing in solving different NLP tasks.
Speaker Biography
Dr. Sriparna Saha is currently serving as an Associate Professor in the Department of Computer Science and Engineering, Indian Institute of Technology Patna, India. She has authored or co-authored more than 400 papers. Her current research interests include machine learning, deep learning, natural language processing, multi-objective optimization, and biomedical information extraction.
She has published in reputed forums like IEEE/ACM Transactions, ACL, AAAI, ACM Multimedia, ECML, COLING, SIGIR and many more. She won the best paper awards in ICONIP 2023, IEEE-INDICON 2015, ICACCI 2012, and among others. She is a senior member of IEEE, ACM and a fellow of IET, UK.
Notable Awards & Recognition
She is currently serving as Associate Editor of IEEE Transactions on Artificial Intelligence, IEEE/ACM Transactions on Computational Biology and Bioinformatics, IEEE Transactions on Computational Social Systems, ACM Transactions on Asian and Low-Resource Language Information Processing, Expert Systems with Applications, Pattern Recognition Letters, PLOS ONE, and Machine Learning with Applications.
About the Program
The ACM Student Chapter Eminent Speaker Program (ESP) aims to provide students and faculty members with valuable exposure to emerging trends, research directions, and professional practices in the field of computing through interaction with eminent speakers. The event is expected to foster academic enrichment, inspire innovation, and strengthen the culture of research and professional excellence within the university.
For more information, contact your ACM Student Chapter