Abstract
This course covers the core technologies required to model and simulate digital humans. The curriculum includes human body modeling, human motion capture, data-driven human motion synthesis, and ML-based generative models. Each topic will be extensively illustrated with examples to provide a comprehensive understanding of the subject matter.
Objectives
Students will learn how to estimate human pose, shape, and motion from videos and create basic human avatars from various visual inputs. Students will also learn how to represent and algorithmically generate motions for digital characters. To help students prepare for the midterm exam, four ungraded exercises will be released following the corresponding lectures and will be reviewed during the tutorial sessions.Content
- Basic concepts of 3D representations- Human body/hand models
- Human motion capture
- Neural rendering
- Transformers
- Generative models for digital humans
Lecture Notes
Lecture and tutorial slides will be available on moodle.Prerequisites
Experience with python and C++ programming, numerical linear algebra, multivariate calculus and probability theory. Some background in deep learning, computer vision, physics-based modeling, kinematics, and dynamics is preferred.Administration
| Number | 263-5806-00L |
|---|---|
| Lecturer | Prof. Dr. Siyu Tang, Dr. Sergey Prokudin |
| Assistants | Kaifeng Zhao (head TA) Korrawe Karunratanakul Marko Mihajlovic Shaofei Wang Gen Li |
| Location and Time | Lecture: Tue 14:15-17:00 LFO C 13 Tutorial: Thu 16:15-18:00 ETF E 1 |
| Moodle | https://moodle-app2.let.ethz.ch/course/view.php?id=25021 |
| ECTS Credits | 8 |
| Exam | The grade will be determined by 40% interim examination and 60% final project presentation and report. |
Schedule
Lecture
| Week | Date (14pm-17pm) | Topic |
|---|---|---|
| 01 | 18-Feb | Introduction |
| 02 | 25-Feb | Human body models |
| 03 | 4-Mar | From Images to Human Models |
| 04 | 11-Mar | Mesh-based Human Avatars |
| 05 | 18-Mar | Volumetric Human Avatars (Neural Fields) |
| 06 | 25-Mar | Point-based Human Avatars (3D Gaussian Splats) |
| 07 | 1-Apr | Generative Models |
| 08 | 8-Apr | Human motion |
| 09 | 15-Apr | Midterm Exam |
| 10 | 22-Apr | Week after Easter: no classes |
| 11 | 29-Apr | Project presentation |
| 12 | 6-May | Project Office Hour |
| 13 | 13-May | Project Office Hour |
| 14 | 20-May | Project Office Hour |
| 15 | 27-May | Project presentation |
Tutorial
| Week | Date (16pm-18pm) | Topic |
|---|---|---|
| 01 | 20-Feb | |
| 02 | 27-Feb | |
| 03 | 6-Mar | Exercise 1 |
| 04 | 13-Mar | Pytorch Tutorial |
| 05 | 20-Mar | Exercise 2 |
| 06 | 27-Mar | Exercise 3 |
| 07 | 3-Apr | Project Introduction |
| 08 | 10-Apr | Exercise 4 |
| 09 | 17-Apr | Cluster Tutorial |
| 10 | 24-Apr | Week after Easter: no classes |
| 11 | 1-May | Project Office Hour |
| 12 | 8-May | Project Office Hour |
| 13 | 15-May | Project Office Hour |
| 14 | 22-May | Project Office Hour |
