Navigation in 360-Degree Video Content: Challenges, Solutions and Opportunities

Klara Nahrstedt | University of Illinois | Thursday, December 17, 2020 | 15:00 (CET, 14:00 UTC) | online

Abstract: With the emergence of  360-degree cameras, VR/AR display devices, ambisonics auditory devices, more diverse 360-degree multi-modal content has become available and with it the challenging demands for the capability of navigating within the 360-degree multi-modal content to enhance users’ multi-modal experience.  In this talk, we will discuss the challenges of navigating through the 360-degree multi-modal content in a HMD-Cloud-based distributed environment, and discuss the concept of the navigation graph to organize the 360-video content for successful delivery and viewing. We will dive into more details of the navigation graph’ concept as one possible direction of potential solutions to represent views-objects-tiles navigation. We will show how navigation graphs are serving as models for viewing behaviors in the temporal and spatial domains to perform a better rate adaptation of tiled media associated with view and object predictions. The experimental results are encouraging and support the claim that the navigation graph modeling provides a strong representation of navigation and viewing patterns of users, and its usage enhances the streaming and viewing quality in 360-degree video applications. We conclude the talk with research opportunities that this area is offering.

Joint work with UIUC collaborators: Dr. Jounsup Park, Mingyuan Wu, Eric Lee, Bo Chen, and UMass collaborators: Ariel Rosenthal, Yash Shah, John Murray, Kevin Spiteri, Dr. Michael Zink, Dr. Ramesh Sitaraman.

Bio: Klara Nahrstedt is the Ralph and Catherine Fisher Professor in the Computer Science Department, and Director of Coordinated Science Laboratory in the College of Engineering at the University of Illinois at Urbana-Champaign. Her research interests are directed toward Internet-of-Things systems, tele-immersive systems, end-to-end Quality of Service (QoS) and resource management in large scale distributed systems and networks, and real-time security and privacy in cyber-physical systems such as power grid. She is the co-author of multimedia books `Multimedia: Computing, Communications and Applications‘ published by Prentice Hall, and ‘Multimedia Systems’ published by Springer Verlag.

She is the recipient of the IEEE Communication Society Leonard Abraham Award for Research Achievements, University Scholar, Humboldt Research Award, IEEE Computer Society Technical Achievement Award, ACM SIGMM Technical Achievement Award, TU Darmstadt Piloty Prize, the Grainger College of Engineering Drucker Award, and the former chair of the ACM Special Interest Group in Multimedia. She was the general co-chair and TPC co-chair of many international conferences including ACM Multimedia, IEEE Percom, IEEE IOTDI and others. Klara Nahrstedt received her Diploma in Mathematics from Humboldt University, Berlin, Germany in 1985. In 1995 she received her PhD from the University of Pennsylvania in the Department of Computer and Information Science. She is ACM Fellow, IEEE Fellow, AAAS Fellow, and Member of the German National Academy of Sciences (Leopoldina Society).

Please follow and like us:
Posted in TEWI-Kolloquium | Kommentare deaktiviert für Navigation in 360-Degree Video Content: Challenges, Solutions and Opportunities