Matthias Niessner

155 Followers
15 Following
51 Posts

Professor for Visual Computing & Artificial Intelligence at TU Munich

Co-Founder @Synthesia

From time to time, research can be quite intense. To stay sharp, I love getting some exercise - it's actually a great way to come up with new research ideas.

Also funny: quite a few PhD students joined the same gym recently, hence creating a huge incentive to not slack off :)

We released our Neural Parametric Head Models (NPHM) dataset from our #CVPR2023 paper!

It includes over 5600 high-fidelity 3D scans of human heads from 272 subjects - all publicly available!

Check it out!
https://simongiebenhain.github.io/NPHM/

We've also released the NPHM code: https://github.com/SimonGiebenhain/NPHM

We provide several examples and a small demo how to use our dataset. It's now super easy to build your own parametric face/head model!

Great work by Simon, Tobias, Markos Martin Lourdes!

Learning Neural Parametric Head Models

Learning Neural Parametric Head Models

Excited to share "ClipFace: Text-guided Editing of Textured 3D Morphable Models" at #SIGGRAPH23.

ClipFace utilizes 3DMMs to synthesize textures and geometric expressions in 3D guided by text prompts.

Video: https://youtu.be/toGOQqFuNmA
@shivangi2201 @angelaqdai @JustusThies

ClipFace: Text-guided Editing of Textured 3D Morphable Models (SIGGRAPH'23)

YouTube

Super exciting keynotes scheduled at #Eurographics2023!

Looking forward to seeing the talks by Elmar Eisemann,
Gordon Wetzstein, Ben Mildenhall, and Mirela Ben-Chen!

https://eg2023.saarland-informatics-campus.de/

Eurographics 2023 | Saarbrücken

On my way to #Eurographics2023!

Looking forward to an exciting paper program. Also feel free to ping me if you want to catch up. I'd love to learn more about ongoing research directions :)

https://eg2023.saarland-informatics-campus.de

Eurographics 2023 | Saarbrücken

📢📢📢NeRSemble #SIGGRAPH'23!

We reconstruct dynamic radiance fields for high-quality novel view synthesis of human heads.

Key is a deformation field and an ensemble of multi-resolution hash encodings to model coarse & fine-scale deformations.

To train our model, we record a novel multi-view video dataset from 16 cameras containing over 4700 sequences of human heads covering a variety of facial expressions.

The dataset will be publicly available!

Video: https://youtu.be/a-OAWqBzldU

Since the backbone of the German economy is printed paper, it seems a great opportunity to run ChatGPT on a typewriter.

Received 10+ media inquiries to talk about #AI:
- danger of deep fakes
- danger of ChatGPT
- danger of TikTok filters
- danger of voice cloning
- danger of big tech dominance

Not disagreeing with certain issues, but I'd also love to share my excitement about new opportunities!

Excited to share "Learning Neural Parametric Head Models" #CVPR2023!

We capture over 5200 high-quality 3D human head scans from which we build a neural parametric head model that disentangles & expressions and deformations.

Core of our representation is an ensemble of local MLPs to facilitate high geometric detail. We will release the entire data asap!

https://simongiebenhain.github.io/NPHM/
https://youtu.be/0mDk2tFOJCg

Learning Neural Parametric Head Models

Learning Neural Parametric Head Models

Preparing our "Introduction to Deep Learning" course!

Almost done automating myself with my #AI avatar :)

Avatar by @synthesiaIO #AI #GenerativeAI