Hao Li


Hao Li is a computer scientist, innovator, and entrepreneur from Germany, working in the fields of computer graphics and computer vision. He is founder and CEO of Pinscreen, Inc., associate professor of computer science at the University of Southern California, as well as director of the Vision and Graphics Lab at the USC Institute for Creative Technologies. He was previously a visiting professor at Weta Digital and a research lead at Industrial Light & Magic / Lucasfilm.
For his contributions in non-rigid shape registration, human digitization, and real-time facial performance capture, Li received the TR35 Award in 2013, recognizing him as one of the top 35 innovators under the age of 35, from the MIT Technology Review. He was named Andrew and Erna Viterbi Early Career Chair in 2015, and was awarded the Google Faculty Research Award and the Okawa Foundation Research Grant the same year. Li won an Office of Naval Research Young Investigator Award in 2018 and was named to the DARPA ISAT Study Group in 2019. He is member of the Global Future Council on Virtual and Augmented Reality of the World Economic Forum.

Biography

Li was born in 1981 in Saarbrücken, Germany. His parents are both Taiwanese immigrants living in Germany. He went to a French-German high school in Saarbrücken and speaks four languages fluently. He obtained his Diplom in Computer Science at the Karlsruhe Institute of Technology in 2006 and his PhD in Computer Science at ETH Zurich in 2010. He was a visiting researcher at ENSIMAG in 2003, the National University of Singapore in 2006, Stanford University in 2008, and EPFL in 2010. He was also a postdoctoral fellow at Columbia University and Princeton University between 2011 and 2012.

Career

Li joined Industrial Light & Magic / Lucasfilm in 2012 as a research lead to develop the next generation real-time performance capture technologies for virtual production and visual effects. He has been on the faculty in the Computer Science department at the University of Southern California since 2013, where he is currently an associate professor. In 2014, he spent a summer as a visiting professor at Weta Digital advancing the facial tracking and hair digitization technologies for the visual effects of Furious 7 and . In 2015, he founded Pinscreen, Inc., an Artificial Intelligence startup that specializes on the creation of photorealistic virtual avatars using advanced machine learning algorithms. In 2016, he was appointed director of the Vision and Graphics Lab at the USC Institute for Creative Technologies.

Research

He is best known for his work on dynamic geometry processing and data-driven techniques for making 3D human digitization and facial animation accessible to the masses. During his PhD, Li co-created the first real-time and markerless system for performance-driven facial animation based on depth sensors which won the best paper award at the ACM SIGGRAPH / Eurographics Symposium on Computer Animation in 2009. The team later commercialized a variant of this technology as the facial animation software Faceshift. His technique in deformable shape registration is used by the company C-Rad AB and widely deployed in hospitals for tracking tumors in real-time during radiation therapy. In 2013, he introduced a home scanning system that uses a Kinect to capture people into game characters or realistic miniature versions. This technology was licensed by Artec and released as a free software Shapify.me. In 2014, he was brought on as visiting professor at Weta Digital to build the high-fidelity facial performance capture pipeline for reenacting the deceased actor Paul Walker in the movie Furious 7.
His recent research focuses on combining techniques in Deep Learning and Computer Graphics to facilitate the creation of 3D avatars and to enable true immersive face-to-face communication and telepresence in Virtual Reality. In collaboration with Oculus / Facebook, he developed in 2015, the first facial performance sensing head-mounted display, which allows users to transfer their facial expressions onto their digital avatars while being immersed in a virtual environment. In the same year, he founded the company Pinscreen, Inc. in Los Angeles, which introduced a technology that can generate realistic 3D avatars of a person including the hair from a single photograph. Their innovations include the development of deep neural networks that can infer photorealistic faces and expressions, which has been showcased at the Annual Meeting of the New Champions 2019 of the World Economic Forum in Dalian. Due to the ease of generating and manipulating digital faces, Li has been raising public awareness about the threat of manipulated videos such as deepfakes. In 2019, Li and media forensics expert, Hany Farid, from the University of California, Berkeley, released a research paper outlining a new method for spotting deepfakes by analyzing facial expression and movement patterns of a specific person. With the rapid progress in artificial intelligence and computer graphics, Li has predicted that genuine videos and deepfakes will become indistinguishable in as soon as 6 to 12 months, as of September 2019. In January 2020, Li spoke at the World Economic Forum Annual Meeting 2020 in Davos about deepfakes and how they could pose a danger to democracy and vulnerable groups. Li and his team at Pinscreen, Inc. also demonstrated a real-time deepfake technology at the annual meeting, where the faces of celebrities are superimposed onto the participants' face.

Awards

For his technological contributions in visual effects, Li has been credited in major motion pictures, including Blade Runner 2049, Valerian and the City of a Thousand Planets, Furious 7, , and Noah. Li also appeared as himself in various documentaries on artificial intelligence and deepfakes, including Buzzfeed's Follow This in 2018, CBC's The Fifth Estate in 2018, and iHuman in 2019.