Imaging Science Seminar: Dynamic Lighting Estimation for Augmented Reality Systems
Imaging Science Seminar
Dynamic Lighting Estimation for Augmented Reality Systems
Zoom Link here
Dr. Yiqin Zhao
School of Interactive Games and Media
Rochester Institute of Technology
Abstract:
Accurate environment lighting is the foundation for immersive user experiences in mobile augmented reality (AR) applications. However, achieving visually coherent environment lighting estimation for Mobile AR is challenging due to several key limitations associated with AR device sensing capabilities, including limitations in device camera FoV and pixel dynamic ranges. Recent advancements in 3D vision and generative AI present many new opportunities for high-quality lighting estimation. While these are promising solutions, challenges remain in addressing the system latency, privacy concerns, and test-time quality of lighting estimation systems. Additionally, to ensure accurate and robust estimation, we must address the key limitations of AI models regarding generation hallucination and slow inference processes. These challenges are critical for dynamic and interactive AR applications and profoundly impact the real-world performance of AR systems. In this talk, I will present systems research prototypes to discuss key issues for lighting estimation in dynamic application contexts: 1) efficient system resource management, 2) mobility-induced data quality issues, and 3) robust integration with generative models. I will also discuss the rising privacy and security concerns of lighting estimation in augmented reality content sharing
Bio:
Yiqin Zhao joined RIT in 2025 as an assistant professor at the School of Interactive Games and Media, GCCIS. He received his Ph.D. from Worcester Polytechnic Institute in August 2025. His research focuses on building AI models and system for real-world applications in dynamic contexts, with a special emphasis on enabling the seamless integration between virtual contents and the physical world.
Intended Audience:
Beginners, undergraduates, graduates. Those with interest in the topic.
To request an interpreter, please visit myaccess.rit.edu
Event Snapshot
When and Where
Who
This is an RIT Only Event
Interpreter Requested?
No