When people want to learn e.g. dances or martial arts moves, they can copy the motions from a video, or from a teacher in real life. However, videos can only be watched from a single viewpoint, which may make learning certain actions more difficult. And teachers aren't always available. So we made ReMagicMirror, which displays the action the user with the same orientation as the user's own body, making comparisons much simpler!
We use a single RGB-D sensor to capture a person's movements, creating a reenactment - novel view synthesis using only a single viewpoint. The reenactment does not include any background; we fill this gap by using augmented reality to overlay it on top of a real environment.