Uday Agarwal

I'm currently a Visiting Scholar at the Computer Vision and Machine Learning Group, National University of Singapore advised by Prof. Angela Yao, where I am working on tasks related to AI for Video Understanding.

Previously, I served as a Research Assistant at the Vision, Language and Learning Group, Indian Institute of Technology Jodhpur advised by Prof. Anand Mishra. My work there centered on fine-grained video understanding, including moment retrieval, video retrieval using multi-modal queries, and self-supervised representation learning. During this time, I was fortunate to be mentored by Dr. Manish Gupta (Microsoft Bing) on fine-grained video analysis.

I am also privileged to be mentored by Dr. Ankush Gupta (Google DeepMind). During the course of my mentorship I reviewed recent research papers, presented seminars, worked on relevant coursework, implemented projects on programming and trained neural networks from scratch.

I graduated with a Bachelors in Computer Science (specialization in Artificial Intelligence and Machine Learning) in September, 2023.

I am grateful to Mr. Anup Gupta (Nexus Venture Partners) and Mr. Anurag Gupta (EY) for their invaluable guidance on my career path.

Email / LinkedIn / CV / Google Scholar / Github

Recent Activities

Mar 2026: Joined the CVML@NUS at National University of Singapore as a Visiting Scholar advised by Prof. Angela Yao.
Nov 2026: Our work PatientVLM Meets DocVLM got accepted at AAAI 2026 (Main Track) !
Oct 2025: Will be attending ICCV 2025 in-person in Honolulu, Hawaii
Jun 2025: Our work on Video-to-Video Moment Retrieval got accepted at ICCV 2025 !
Dec 2024: Will be attending ICVGIP 2024 in-person at IIIT, Bangalore.
Oct 2024: Our work ChapVidMR has been accepted at ICVGIP 2024.
July 2024:Will be attending NCVPRIPG 2024 in-person at IIST, Thiruvananthapuram.
Apr 2024: In the organizing team of Summer Challenge on Automatic Assessment of Handwritten Answersheets at NCVPRIPG'24. Consider participating!
Mar 2024: Joined the Vision, Language and Learning Group (VL2G) at IIT Jodhpur as a Research Assistant.

Selected Publications

PatientVLM Meets DocVLM: Pre-Consultation Dialogue Between Vision-Language Models for Efficient Diagnosis
K Lokesh^*, Abhirama Subramanyam Penamakuri^*, Uday Agarwal, Apoorva Challa, Shreya K Gowda, Somesh Gupta, Anand Mishra
AAAI, 2026 (Main Track) (*equal contribution)
paper / project page

Aligning Moments in Time using Video Queries
Yogesh Kumar^*, Uday Agarwal^*, Manish Gupta, Anand Mishra
ICCV, 2025 (*equal contribution)
paper / code & dataset / slides

CHAPVIDMR:Chapter-based Video Moment Retrieval using Natural Language Queries
Uday Agarwal^*, Yogesh Kumar^*, Abu Shahid^*, Prajwal Gatti, Manish Gupta, Anand Mishra
ICVGIP, 2024 (Spotlight) (* equal contribution)
paper / code & dataset

Miscellanea

I have been learning and practicing the violin for the past 18 years and am skilled in both Indian Classical and Western Styles of Music. My musical journey has been guided by the esteemed Mr. Gulzar Hussain.

Template design taken from here.