I am an Assistant Professor in the Computer Graphics and Visualization Group at TU Delft. I conduct research in computational imaging and displays covering both perceptual aspects of AR/VR/lightfield displays as well as computer vision techniques for 3D scene representation including neural rendering.

Previously, I was a Visiting Scholar in the Stanford Computational Imaging Lab of Prof. Gordon Wetzstein at Stanford University and Senior Technical Staff member at Raxium between 2019 and 2021. Between 2017 and 2019, I was a Postdoctoral Associate in the Computational Fabrication Group of Prof. Wojciech Matusik at MIT CSAIL. Between 2012 and 2016, I was a PhD Student in the Computer Graphics Department at MPI Informatik and Saarland University where I work on Perceptual modeling for stereoscopic 3D under supervision of Prof. Karol Myszkowski and Prof. Hans-Peter Seidel.

Research Interests

• Neural rendering and generative AI (NeRF, 3D Gaussians, differentiable rendering,...) with focus on interaction (reposing, animation, physics, editing,...)
• Computational imaging and deep learning (GANs, Diffusion,...)
• Computational displays and perceptual rendering (Foveation, VR, holography, stereoscopy, high refresh-rate, image metrics...)
• Neural sensing (extracting novels signals from RGB cameras, tactile arrays, microphones,...)

Teaching

MSc Thesis Topics

I am looking for enthusiastic TU Delft MSc students interested in projects related to my research interests to work on topics including but not limited to:

• Investigating properties of neural shape representations (Neural Jacobian Fields, NN for Pointclouds, Signed Distance Fields, ...)
• Implicit neural appearance representations for real-time 3D rendering (Focus on visual fidelity and realism)
• Real-time 3D interaction from a multi-view camera capture (A combination of data capture, reconstruction, analysis and rendering)
• Human visual attention (A perceptual meaning of attending a visual feature)
• Perceptual relevance of computer vision metrics
• ...many others.

Custom research ideas for MSc project are welcome and highly encouraged.

Courses

• DSAIT4120 Applied Image Processing (MSc CS Theme "Computer Graphics" & MSc DSAIT Theme "Visual Computing")
• DSAIT4130 3D Visual Computing (MSc DSAIT Theme "Visual Computing")
• DSAIT4080 3D Visualization (MSc DSAIT Theme "Interactive Visual Analysis")
• IN4310 Seminar Computer Graphics (MSc CS)
• CS4705 Research Seminar Computer Graphics (MSc CS)
• DSAIT4215 Research in Visual Computing and Interactive Visual Analysis (MSc CS)
• TI3135TU Visual Data Processing (Minor CS)

Lectures

• Effective User Studies in Computer Graphics, Eurographics 2023, May 7th, 2023
• Bridging the Technological Gap Workshop, Göttingen, Germany, July 31st – Aug 6th, 2022

Supervision

PhD students

• Lukas Uzolas (2022-now)
• Guowei Lu (2022-now)

MSc students

• Jorge Romeu Huidobro (2024-now)
• Lukas Zimmerhackl (2024-now)
• Adriaan Pardoel: Patch-Based Inpainting of 3D Gaussian Splatting (2023-24)
• Pavlos Makridis: Gaussians as Supervision for Joint Physical Parameter Estimation and Appearance Reconstruction of Elastic Objects (2023-24)

BSc projects

See the TU Delft Library Repository for the student reports covering the past topics:

• Procedural Tree Generation (2023/24): #1, #2, #3, #4
• Neural Radiance Field (NeRF) as a Rendering Primitive (2022/23): #1, #2, #3, #4
• Chromostereoscopy - From Color to Depth Perception (2021/22): #1, #2, #3, #4, #5

Publications

2024
	Sheared Polygonal Texture Filtering Guowei Lu, Jerry Guo, Petr Kellnhofer, Elmar Eisemann Graphics Interface 2024 [Michael A. J. Sweeney Award (Best Student Paper)] PDF Project Page
2023
	Template-free Articulated Neural Point Clouds for Reposable View Synthesis Lukas Uzolas, Elmar Eisemann, Petr Kellnhofer NeurIPS 2023 PDF Project Page
	Towards Attention-aware Foveated Rendering Brooke Krajancich, Petr Kellnhofer, Gordon Wetzstein SIGGRAPH 2023 (ACM Transactions on Graphics journal) [Honorable mention] PDF Project Page
2022
	Generative Neural Articulated Radiance Fields Alexander W. Bergman*, Petr Kellnhofer*, Wang Yifan*, Eric R. Chan*, David B. Lindell, Gordon Wetzstein NeurIPS 2022 PDF Project Page
2021
	Fast Training of Neural Lumigraph Representations using Meta Learning Alexander W. Bergman, Petr Kellnhofer, Gordon Wetzstein NeurIPS 2021 PDF Project Page
	A Perceptual Model for Eccentricity-dependent Spatio-temporal Flicker Fusion and its Applications to Foveated Graphics Brooke Krajancich, Petr Kellnhofer, Gordon Wetzstein ACM SIGGRAPH 2021 PDF Project Page
	Neural Lumigraph Rendering Petr Kellnhofer, Lars Jebe, Andrew Jones, Kari Pulli, Gordon Wetzstein IEEE CVPR 2021 (Oral) [Best paper candidate] PDF Project Page
	pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis Eric Chan*, Marco Monteiro*, Petr Kellnhofer, Jiajun Wu, Gordon Wetzstein IEEE CVPR 2021 (Oral) PDF Project Page
	Tensor Holography: Towards Real-time Photorealistic 3D Holography with Deep Neural Networks Liang Shi, Beichen Li, Changil Kim, Petr Kellnhofer, Wojciech Matusik Nature, 592 (234–239), 2021 PDF Project Page
2020
	Optimizing Depth Perception in Virtual and Augmented Reality through Gaze-contingent Stereo Rendering Brooke Krajancich, Petr Kellnhofer, Gordon Wetzstein ACM Transactions on Graphics 39(6) (Proc. SIGGRAPH Asia 2020, Daegu, South Korea). PDF Project Page
2019
	Gaze360: Physically Unconstrained Gaze Estimation in the Wild Petr Kellnhofer*, Adrià Recasens*, Simon Stent, Wojciech Matusik, and Antonio Torralba ICCV 2019 (Soul, South Korea, October 29th - November 1st 2019). * Denotes equal contribution. PDF
	Learning the signatures of the human grasp using a scalable tactile glove Subramanian Sundaram, Petr Kellnhofer, Yunzhu Li, Jun-Yan Zhu, Antonio Torralba, and Wojciech Matusik Nature, 569 (7758), 2019 PDF Project Page
	Neural Inverse Knitting: From Images to Manufacturing Instructions Alexandre Kaspar*, Tae-Hyun Oh*, Liane Makatura, Petr Kellnhofer, Jacqueline Aslarus, and Wojciech Matusik ICML 2019 (Long Beach, CA, USA, 10th - 15th June 2019). * Denotes equal contribution. PDF Project Page
2018
	Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networks Adrià Recasens*, Petr Kellnhofer*, Simon Stent, Wojciech Matusik, and Antonio Torralba ECCV 2018 (Munich, Germany, 8th - 14th September 2018). * Denotes equal contribution. PDF Project Page
	A Dataset of Flash and Ambient Illumination Pairs from the Crowd Yagiz Aksoy, Changil Kim, Petr Kellnhofer, Sylvain Paris, Mohamed Elgharib, Marc Pollefeys, and Wojciech Matusik ECCV 2018 (Munich, Germany, 8th - 14th September 2018). PDF Project Page
2017
	3DTV at Home: Eulerian-Lagrangian Stereo-to-Multiview Conversion Petr Kellnhofer, Piotr Didyk, Szu-Po Wang, Pitchaya Sitthi-Amorn, William Freeman, Fredo Durand, and Wojciech Matusik ACM Transactions on Graphics 36(4) (Proc. SIGGRAPH 2017, Los Angeles, California, USA, 30th - 3rd August 2017). PDF Project Page
	Membrane AR: Varifocal, Wide-Field-of-the-View Augmented Reality Display from Deformable Membranes D. Dunn, C. Tippets, K. Torell, P. Kellnhofer, K. Akşit, P. Didyk, K. Myszkowski, D. Luebke, and H. Fuch ACM SIGGRAPH Emerging Technologies (Los Angeles, California, USA, 30th - 3rd August 2017). PDF Project Page
	Perceptual real-time 2D-to-3D conversion using cue fusion [extended version] Thomas Leimkühler, Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel IEEE Transactions on Visualization and Computer Graphics, 2017. PDF Project Page
	Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors [Best Paper Award] D. Dunn, C. Tippets, K. Torell, P. Kellnhofer, K. Akşit, P. Didyk, K. Myszkowski, D. Luebke, and H. Fuch IEEE Transactions on Visualization and Computer Graphics (Selected Proceedings, IEEE Virtual Reality 2017, Los Angeles, CA). PDF Project Page
2016
	Perceptual modeling for stereoscopic 3D Petr Kellnhofer PhD thesis - Universität des Saarlandes, defended on 4th November 2016. PDF
	Motion Parallax in Stereo 3D: Model and Applications Petr Kellnhofer, Piotr Didyk, Tobias Ritschel, Belen Masia, Karol Myszkowski, Hans-Peter Seidel ACM Transactions on Graphics 35(6) (Proc. SIGGRAPH Asia 2016, The Venetian Macao, Macao, 5th - 8th December 2016). PDF Project Page
	A Transformation-Aware Perceptual Image Metric Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel Journal of Electronic Imaging, 2016. PDF Project Page
	GazeStereo3D: Seamless Disparity Manipulations Petr Kellnhofer, Piotr Didyk, Karol Myszkowski, Mohamed M. Hefeeda, Hans-Peter Seidel, Wojciech Matusik ACM Transactions on Graphics 35(4) (Proc. SIGGRAPH 2016, Anaheim, California, USA, 24th - 28th July 2016). PDF Project Page
	Eye Tracking for Everyone Aditya Khosla*, Kyle Krafka*, Petr Kellnhofer, Harini Kannan, Suchi Bhandarkar, Wojciech Matusik, Antonio Torralba IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, 26th June - 1st July 2016. PDF
	Perceptual real-time 2D-to-3D conversion using cue fusion [Best Student Paper Award] Thomas Leimkühler, Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel Graphics Interface 2016, Victoria, British Columbia, Canada, 31st May - 3rd June 2016. PDF Project Page
2015
	What makes 2D-to-3D stereo conversion perceptually plausible? [Best Presentation Award] (presented by T. Leimkühler) Petr Kellnhofer, Thomas Leimkühler, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel ACM Symposium on Applied Perception (Tübingen/Germany, 13-14 September 2015), 2015. PDF Project Page
	Modeling Luminance Perception at Absolute Threshold Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Elmar Eisemann, Hans-Peter Seidel Computer Graphics Forum (Proc. EGSR 2015, Darmstadt/Germany, 24-26 June 2015), 2015. PDF Project Page
	A Transformation-Aware Perceptual Image Metric [Best Student Paper Award] Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel IS&T/SPIE Electronic Imaging 2015 (Human Vision and Electronic Imaging XX, San Francisco/CA/USA, 8-12 February 2015), 2015. PDF Project Page
2014
	Stereo Day-for-Night: Retargeting Disparity for Scotopic Vision Petr Kellnhofer, Tobias Ritschel, Peter Vangorp, Karol Myszkowski, Hans-Peter Seidel ACM Transactions on Applied Perception (TAP) - Special issue SAP 2014 (Symposium on Applied Perception 2014, Vancouver, 8-9 August 2014), 2014. PDF Project Page
	Manipulating Refractive and Reflective Binocular Disparity Łukasz Dąbała, Petr Kellnhofer, Tobias Ritschel, Piotr Didyk, Krzysztof Templin, Karol Myszkowski, Przemysław Rokita, Hans-Peter Seidel Computer Graphics Forum 33(2) (Proc. Eurographics 2014, Strasbourg/France, 7-11 April 2014), 2014. PDF Project Page
	Improving Perception of Binocular Stereo Motion on 3D Display Devices Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel IS&T/SPIE Electronic Imaging 2014 (Stereoscopic Displays and Applications XXV, San Francisco/CA/USA, 3-6 February 2014), 2014. PDF Project Page
2013
	Optimizing Disparity for Motion in Depth Petr Kellnhofer, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel Computer Graphics Forum (Proc. EGSR 2013, Zaragoza/Spain, 19-21 June 2013), 2013. PDF Project Page
2012
	Time-Convenient Deformation of Musculoskeletal System Petr Kellnhofer, Josef Kohout In Proceedings of the Algoritmy 2012 Conference (Podbanske/Slovakia, 9-14 September 2012), 2012. PDF
	Fast Deformation for Modelling of Musculoskeletal System Josef Kohout, Petr Kellnhofer, Saulo Martelli In Proceedings of the International Conference on Computer Graphics Theory and Applications: GRAPP 2012 (Rome/Italy, 24-26 February 2012), 2012. PDF

Invited Talks

• Invited talk at the CS department of the University of West Bohemia, Czechia, April 2024.
• Invited talk on Gaze Tracking in the Wild at the Social AI lab Colloquium, VU University Amsterdam, NL, June 16th, 2022.
• Invited talk at ICRA 2020 Workshop "Beyond Soft Robotics" (virtual, timestamp 5:34:00).
• DyViTo Virtual Network Meeting (virtual), University of Zaragoza, Spain, 2020.
• Invited talk at The Stanford Center for Image System Engineering (SCIEN), CA, USA, 2018.
• Tutorial: Perceptual Displays. 3DTV Conference, Budapest, Hungary, 2014.

Awards

• SIGGRAPH 2023 Technical Papers Honorable Mentions Award (Paper: Towards Attention-aware Foveated Rendering)
• ECCV 2022 Outstanding Reviewer
• ICLR 2022 Highlighted Reviewer
• CVPR 2021 Best Paper Candidate (Paper: Neural Lumigraph Rendering)
• Eurographics PhD Award 2018 - Eurographics Annual Award for Best PhD Thesis (Perceptual modeling for stereoscopic 3D)
• Dr.-Eduard-Martin-Preis 2016/17 for the PhD Dissertation (Perceptual modeling for stereoscopic 3D)
• Digital Content Association of Japan Award for the SIGGRAPH 2017 Emerging Technology demo "Membrane AR: Varifocal, Wide-Field-of-the-View Augmented Reality Display from Deformable Membranes"
• Nomination for the Gessellschaft für Informatik Best Dissertation Prize 2016 for Perceptual modeling for stereoscopic 3D
• Best Paper Award, IEEE Virtual Reality 2017 (Paper: Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors)
• Best Student Paper Award, Graphics Interface 2016 (Paper: Perceptual real-time 2D-to-3D conversion using cue fusion)
• Best Presentation Award, ACM Symp. Applied Perception 2015 (Paper: What makes 2D-to-3D stereo conversion perceptually plausible?) (presented by T. Leimkühler)
• Best Student Paper Award, SPIE Conference on Human Vision and Electronic Imaging 2015 (Paper: A Transformation-Aware Perceptual Image Metric)
• 7th place in Czech ACM Chapter & Slovakia ACM Chapter Student Project of the Year in Master category, 2012, Prague, Czech Republic.
• 1st place in Czech ACM Chapter & Slovakia ACM Chapter Student Project of the Year in Bachelor category, 2010, Prague, Czech Republic.
• CCA award for the best Bachelor thesis in IT, 2010, Plzeň, Czech Republic.

Professional service

Committees:

• Pacific Graphics 2024 - Program Committee Member
• High Performance Graphics (HPG) 2024 - Program Committee Member
• IEEE International Conference on Computational Photography (ICCP) 2024 - Program Committee Member
• Eurographics 2024 - Full Papers International Program Committee
• SIGGRAPH Asia 2023 - Technical Paper Committee Member Member
• Eurographics 2023 - Full Papers & STAR Program Committee Member
• IEEE International Conference on Computational Photography (ICCP) 2023 - Program Committee Member
• Pacific Graphics 2022 - Program Committee Member
• SIGGRAPH Asia 2022 - Technical Paper Committee Member Member
• IEEE International Conference on Computational Photography (ICCP) 2022 - Program Committee Member
• SIGGRAPH Asia 2019 - Technical Briefs and Posters Committee Member

Selected reviewer duties:

• ACM SIGGRAPH, ACM SIGGRAPH Asia, Eurographics, IEEE TVCG, IEEE TCI, ICCP, IEEE VR, Computers & Graphics, Pacific Graphics, Graphic Interface, ACM Symposium on Applied Perception (SAP), ACM Transactions on Applied Perception (TAP)
• CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, AAAI, IEEE Winter Conf. on Applications of Computer Vision (WACV), ACM Symposium on Virtual Reality Software and Technology
• Scientific Reports, IEEE Robotics and Automation Letters , IEEE Transactions on Broadcasting, International Journal on Artificial Intelligence Tools, Multimedia Systems, MDPI Sensors, MDPI Inventions

Media coverage

• MIT News: Sensor-packed glove learns signatures of the human grasp
• Nature News & Views: Bridging the gap between artificial vision and touch
• Nature communities: Learning dexterity from humans
• The Economist: Improving robots’ grasp requires a new way to measure it in humans
• PBS NOVA: This electronic glove gets a grip on human touch
• BBC Radio
• New Scientist: Smart glove works out what you’re holding from its weight and shape
• FOX 35 Orlando: Teaching a robot to touch with glove fitted with sensors
• CNET: You could soon watch 3D movies without ridiculous glasses
• Mashable: 3D TVs were presumed to be dead and gone, but these scientists believe they can bring it back
• Engadget: MIT solves a major problem holding up glasses-free 3D TV
• Daily Mail: MIT solves a major problem holding up glasses-free 3D TVs
• TechCrunch: MIT solves a major problem holding up glasses-free 3D TVs
• Inverse: MIT Tech Will Show 3D 'Star Wars' Without the Silly Glasses
• Digital Trends: Research suggests glasses-free 3D videos could be coming soon to home TVs
• International Business Times: Study: Glasses-Free 3D TVs May Soon Be In Living Rooms
• Tech Explore: Watch 3-D movies at home, sans glasses
• TechSpot: MIT wants to bring glasses-free 3D technology to the living room

Education

• September 2012 - December 2016:
  Ph. D. student in Computer Science at the Max-Planck-Institut für Informatik and the Universität des Saarlandes, Saarbrücken, Saarbrücken, Saarland, Germany
  
  
• June 2015 - January 2016:
  Visiting the Computational Fabrication Group in the Computer Science and Artificial Intelligence Laboratory of the Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
  
  
• September 2007 - June 2012:
  Studies in Computer Science on the Faculty of Applied Sciences at the University of West Bohemia in Plzen, Czech Republic
  Title of Master's Thesis (Diplomarbeit): Non-rigid Transformations for Musculoskeletal Model (supervisor: doc. Ing. Josef Kohout, Ph.D.) (PDF)
  
  
• June 2007
  High school Diploma (Abitur) at the Gymnázium a SOŠ Rokycany, Czech Republic
  
  

Hobbies

• Running, Mountain biking, Mountain hiking, Swimming, Astrophysics, History