Introduction

I am an Assistant Professor in the Computer Graphics and Visualization Group at TU Delft. I conduct research in computational imaging and displays covering both perceptual aspects of AR/VR/lightfield displays as well as computer vision techniques for 3D scene representation including neural rendering.

Since 2019, I have been a Visiting Scholar in the Stanford Computational Imaging Lab of Prof. Gordon Wetzstein at Stanford University and Senior Technical Staff member at Raxium. Between 2017 and 2019 I was a Postdoctoral Associate in the Computational Fabrication Group of Prof. Wojciech Matusik at MIT CSAIL.
Between September 2012 and December 2016 I was a PhD Student in the Computer Graphics Department at MPI Informatik and Saarland University under supervision of Prof. Karol Myszkowski and Prof. Hans-Peter Seidel.
I have defended my PhD thesis Perceptual modeling on stereoscopic 3D on 4th November 2016 and obtained degree Dr.-Ing. with summa cum laude.

Research Interests

• Computational displays and perceptual rendering
• Neural rendering and 3D GANs
• Computational imaging and deep learning
• Appearance based gaze tracking
• Neural sensing

Open Positions

I am looking for enthusiastic Master students interested in development and evaluation of perception-driven algorithms for capture, processing and rendering of light fields for advanced display applications including virtual and augmented reality. The topics include among others neural rendering, generative image synthesis, perceptual modeling and display algorithms.

Teaching

• CS4365 Applied Image Processing (MSc CS)
• IN4310 Seminar Computer Graphics (MSc CS)
• TI3135TU Visual Data Processing (Minor CS)

Publications

2023
	Template-free Articulated Neural Point Clouds for Reposable View Synthesis Lukas Uzolas, Elmar Eisemann, Petr Kellnhofer arXiv.org PDF Project Page
	Towards Attention-aware Foveated Rendering Brooke Krajancich, Petr Kellnhofer, Gordon Wetzstein SIGGRAPH 2023 (ACM Transactions on Graphics journal) PDF Project Page
2022
	Generative Neural Articulated Radiance Fields Alexander W. Bergman*, Petr Kellnhofer*, Wang Yifan*, Eric R. Chan*, David B. Lindell, Gordon Wetzstein NeurIPS 2022 PDF Project Page
2021
	Fast Training of Neural Lumigraph Representations using Meta Learning Alexander W. Bergman, Petr Kellnhofer, Gordon Wetzstein NeurIPS 2021 PDF Project Page
	A Perceptual Model for Eccentricity-dependent Spatio-temporal Flicker Fusion and its Applications to Foveated Graphics Brooke Krajancich, Petr Kellnhofer, Gordon Wetzstein ACM SIGGRAPH 2021 PDF Project Page
	Neural Lumigraph Rendering Petr Kellnhofer, Lars Jebe, Andrew Jones, Kari Pulli, Gordon Wetzstein IEEE CVPR 2021 (Oral) [Best paper candidate] PDF Project Page
	pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis Eric Chan*, Marco Monteiro*, Petr Kellnhofer, Jiajun Wu, Gordon Wetzstein IEEE CVPR 2021 (Oral) PDF Project Page
	Tensor Holography: Towards Real-time Photorealistic 3D Holography with Deep Neural Networks Liang Shi, Beichen Li, Changil Kim, Petr Kellnhofer, Wojciech Matusik Nature, 592 (234–239), 2021 PDF Project Page
2020
	Optimizing Depth Perception in Virtual and Augmented Reality through Gaze-contingent Stereo Rendering Brooke Krajancich, Petr Kellnhofer, Gordon Wetzstein ACM Transactions on Graphics 39(6) (Proc. SIGGRAPH Asia 2020, Daegu, South Korea). PDF Project Page
2019
	Gaze360: Physically Unconstrained Gaze Estimation in the Wild Petr Kellnhofer*, Adrià Recasens*, Simon Stent, Wojciech Matusik, and Antonio Torralba ICCV 2019 (Soul, South Korea, October 29th - November 1st 2019). * Denotes equal contribution. PDF Project Page
	Learning the signatures of the human grasp using a scalable tactile glove Subramanian Sundaram, Petr Kellnhofer, Yunzhu Li, Jun-Yan Zhu, Antonio Torralba, and Wojciech Matusik Nature, 569 (7758), 2019 PDF Project Page
	Neural Inverse Knitting: From Images to Manufacturing Instructions Alexandre Kaspar*, Tae-Hyun Oh*, Liane Makatura, Petr Kellnhofer, Jacqueline Aslarus, and Wojciech Matusik ICML 2019 (Long Beach, CA, USA, 10th - 15th June 2019). * Denotes equal contribution. PDF Project Page
2018
	Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networks Adrià Recasens*, Petr Kellnhofer*, Simon Stent, Wojciech Matusik, and Antonio Torralba ECCV 2018 (Munich, Germany, 8th - 14th September 2018). * Denotes equal contribution. PDF Project Page
	A Dataset of Flash and Ambient Illumination Pairs from the Crowd Yagiz Aksoy, Changil Kim, Petr Kellnhofer, Sylvain Paris, Mohamed Elgharib, Marc Pollefeys, and Wojciech Matusik ECCV 2018 (Munich, Germany, 8th - 14th September 2018). PDF Project Page
2017
	3DTV at Home: Eulerian-Lagrangian Stereo-to-Multiview Conversion Petr Kellnhofer, Piotr Didyk, Szu-Po Wang, Pitchaya Sitthi-Amorn, William Freeman, Fredo Durand, and Wojciech Matusik ACM Transactions on Graphics 36(4) (Proc. SIGGRAPH 2017, Los Angeles, California, USA, 30th - 3rd August 2017). PDF Project Page
	Membrane AR: Varifocal, Wide-Field-of-the-View Augmented Reality Display from Deformable Membranes D. Dunn, C. Tippets, K. Torell, P. Kellnhofer, K. Akşit, P. Didyk, K. Myszkowski, D. Luebke, and H. Fuch ACM SIGGRAPH Emerging Technologies (Los Angeles, California, USA, 30th - 3rd August 2017). PDF Project Page
	Perceptual real-time 2D-to-3D conversion using cue fusion [extended version] Thomas Leimkühler, Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel IEEE Transactions on Visualization and Computer Graphics, 2017. PDF Project Page
	Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors [Best Paper Award] D. Dunn, C. Tippets, K. Torell, P. Kellnhofer, K. Akşit, P. Didyk, K. Myszkowski, D. Luebke, and H. Fuch IEEE Transactions on Visualization and Computer Graphics (Selected Proceedings, IEEE Virtual Reality 2017, Los Angeles, CA). PDF Project Page
2016
	Perceptual modeling for stereoscopic 3D Petr Kellnhofer PhD thesis - Universität des Saarlandes, defended on 4th November 2016. PDF
	Motion Parallax in Stereo 3D: Model and Applications Petr Kellnhofer, Piotr Didyk, Tobias Ritschel, Belen Masia, Karol Myszkowski, Hans-Peter Seidel ACM Transactions on Graphics 35(6) (Proc. SIGGRAPH Asia 2016, The Venetian Macao, Macao, 5th - 8th December 2016). PDF Project Page
	A Transformation-Aware Perceptual Image Metric Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel Journal of Electronic Imaging, 2016. PDF Project Page
	GazeStereo3D: Seamless Disparity Manipulations Petr Kellnhofer, Piotr Didyk, Karol Myszkowski, Mohamed M. Hefeeda, Hans-Peter Seidel, Wojciech Matusik ACM Transactions on Graphics 35(4) (Proc. SIGGRAPH 2016, Anaheim, California, USA, 24th - 28th July 2016). PDF Project Page
	Eye Tracking for Everyone Aditya Khosla*, Kyle Krafka*, Petr Kellnhofer, Harini Kannan, Suchi Bhandarkar, Wojciech Matusik, Antonio Torralba IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, 26th June - 1st July 2016. PDF Project Page
	Perceptual real-time 2D-to-3D conversion using cue fusion [Best Student Paper Award] Thomas Leimkühler, Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel Graphics Interface 2016, Victoria, British Columbia, Canada, 31st May - 3rd June 2016. PDF Project Page
2015
	What makes 2D-to-3D stereo conversion perceptually plausible? [Best Presentation Award] (presented by T. Leimkühler) Petr Kellnhofer, Thomas Leimkühler, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel ACM Symposium on Applied Perception (Tübingen/Germany, 13-14 September 2015), 2015. PDF Project Page
	Modeling Luminance Perception at Absolute Threshold Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Elmar Eisemann, Hans-Peter Seidel Computer Graphics Forum (Proc. EGSR 2015, Darmstadt/Germany, 24-26 June 2015), 2015. PDF Project Page
	A Transformation-Aware Perceptual Image Metric [Best Student Paper Award] Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel IS&T/SPIE Electronic Imaging 2015 (Human Vision and Electronic Imaging XX, San Francisco/CA/USA, 8-12 February 2015), 2015. PDF Project Page
2014
	Stereo Day-for-Night: Retargeting Disparity for Scotopic Vision Petr Kellnhofer, Tobias Ritschel, Peter Vangorp, Karol Myszkowski, Hans-Peter Seidel ACM Transactions on Applied Perception (TAP) - Special issue SAP 2014 (Symposium on Applied Perception 2014, Vancouver, 8-9 August 2014), 2014. PDF Project Page
	Manipulating Refractive and Reflective Binocular Disparity Łukasz Dąbała, Petr Kellnhofer, Tobias Ritschel, Piotr Didyk, Krzysztof Templin, Karol Myszkowski, Przemysław Rokita, Hans-Peter Seidel Computer Graphics Forum 33(2) (Proc. Eurographics 2014, Strasbourg/France, 7-11 April 2014), 2014. PDF Project Page
	Improving Perception of Binocular Stereo Motion on 3D Display Devices Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel IS&T/SPIE Electronic Imaging 2014 (Stereoscopic Displays and Applications XXV, San Francisco/CA/USA, 3-6 February 2014), 2014. PDF Project Page
2013
	Optimizing Disparity for Motion in Depth Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel Computer Graphics Forum (Proc. EGSR 2013, Zaragoza/Spain, 19-21 June 2013), 2013. PDF Project Page
2012
	Time-Convenient Deformation of Musculoskeletal System Petr Kellnhofer, Josef Kohout In Proceedings of the Algoritmy 2012 Conference (Podbanske/Slovakia, 9-14 September 2012), 2012. PDF
	Fast Deformation for Modelling of Musculoskeletal System Josef Kohout, Petr Kellnhofer, Saulo Martelli In Proceedings of the International Conference on Computer Graphics Theory and Applications: GRAPP 2012 (Rome/Italy, 24-26 February 2012), 2012. PDF

Awards

• ECCV 2022 Outstanding Reviewer
• ICLR 2022 Highlighted Reviewer
• Eurographics PhD Award 2018 - Eurographics Annual Award for Best PhD Thesis (Perceptual modeling for stereoscopic 3D)
• Dr.-Eduard-Martin-Preis 2016/17 for the PhD Dissertation work Perceptual modeling for stereoscopic 3D
• Digital Content Association of Japan Award for the SIGGRAPH 2017 Emerging Technology demo "Membrane AR: Varifocal, Wide-Field-of-the-View Augmented Reality Display from Deformable Membranes"
• Nomination for the Gessellschaft für Informatik Best Dissertation Prize 2016 for Perceptual modeling for stereoscopic 3D
• Best Paper Award, IEEE Virtual Reality 2017 (Paper: Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors)
• Best Student Paper Award, Graphics Interface 2016 (Paper: Perceptual real-time 2D-to-3D conversion using cue fusion)
• Best Presentation Award, ACM Symp. Applied Perception 2015 (Paper: What makes 2D-to-3D stereo conversion perceptually plausible?) (presented by T. Leimkühler)
• Best Student Paper Award, SPIE Conference on Human Vision and Electronic Imaging 2015 (Paper: A Transformation-Aware Perceptual Image Metric)
• 7th place in Czech ACM Chapter & Slovakia ACM Chapter Student Project of the Year in Master category, 2012, Prague, Czech Republic.
• 1st place in Czech ACM Chapter & Slovakia ACM Chapter Student Project of the Year in Bachelor category, 2010, Prague, Czech Republic.
• CCA award for the best Bachelor thesis in IT, 2010, Plzeň, Czech Republic.

Education

• September 2012 - December 2016:
  Ph. D. student in Computer Science at the Max-Planck-Institut für Informatik and the Universität des Saarlandes, Saarbrücken, Saarbrücken, Saarland, Germany
  
  
• June 2015 - January 2016:
  Visiting the Computational Fabrication Group in the Computer Science and Artificial Intelligence Laboratory of the Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
  
  
• September 2007 - June 2012:
  Studies in Computer Science on the Faculty of Applied Sciences at the University of West Bohemia in Plzen, Czech Republic
  Title of Master's Thesis (Diplomarbeit): Non-rigid Transformations for Musculoskeletal Model (supervisor: doc. Ing. Josef Kohout, Ph.D.) (PDF)
  
  
• June 2007
  High school Diploma (Abitur) at the Gymnasium Rokycany
  
  

Community service

Committees:

• Eurographics 2023 - Full Papers International Program Committee Member
• Pacific Graphics 2022 - Program Committee Member Member
• SIGGRAPH Asia 2022 - Technical Paper Committee Member Member
• IEEE International Conference on Computational Photography (ICCP) 2022 - Program Committee Member
• SIGGRAPH Asia 2019 - Technical Briefs and Posters Committee Member

Selected reviewer duties:

• ACM SIGGRAPH, ACM SIGGRAPH Asia, Eurographics, IEEE TVCG, IEEE TCI, ICCP, IEEE VR, Computers & Graphics, Pacific Graphics, Graphic Interface, ACM Symposium on Applied Perception (SAP), ACM Transactions on Applied Perception (TAP)
• CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, AAAI, IEEE Winter Conf. on Applications of Computer Vision (WACV), ACM Symposium on Virtual Reality Software and Technology
• Scientific Reports, IEEE Robotics and Automation Letters , IEEE Transactions on Broadcasting, International Journal on Artificial Intelligence Tools, Multimedia Systems, MDPI Sensors, MDPI Inventions

Media coverage

• CNET: You could soon watch 3D movies without ridiculous glasses
• Mashable: 3D TVs were presumed to be dead and gone, but these scientists believe they can bring it back
• Engadget: MIT solves a major problem holding up glasses-free 3D TV
• Daily Mail: MIT solves a major problem holding up glasses-free 3D TVs
• TechCrunch: MIT solves a major problem holding up glasses-free 3D TVs
• Inverse: MIT Tech Will Show 3D 'Star Wars' Without the Silly Glasses
• Digital Trends: Research suggests glasses-free 3D videos could be coming soon to home TVs
• International Business Times: Study: Glasses-Free 3D TVs May Soon Be In Living Rooms
• Tech Explore: Watch 3-D movies at home, sans glasses
• TechSpot: MIT wants to bring glasses-free 3D technology to the living room

Hobbies

• Cycling, Running, Swimming, History, Astrophysics