Unleashing the Future: Creating Virtual Humans with Volumetric Video

Unleashing the Future: Creating Virtual Humans with Volumetric Video

Table of Contents:

1. Introduction 1.1 About Volumetric Video
2. Creating a Digital Human 2.1 Overview of the Capture System 2.2 Steps Involved in Volumetric Video
3. Microsoft Mixed Reality Capture Studio 3.1 The Capture Stage 3.2 Processing and Output
4. Metastage and Jedu App 4.1 Creating Digital Humans for Jedu App 4.2 Connecting Fans and Performers
5. Emotional Impact of Volumetric Video 5.1 Santander Bank Project 5.2 BTS and Samsung Collaboration 5.3 Real-Time Interaction with Digital Humans
6. Editing Digital Humans 6.1 Traditional Video Production vs. Volumetric Video Pipeline 6.2 HollowEdit: A Post-Production Pipeline for Volumetric Video
7. Distribution of Digital Humans 7.1 Importance of Distribution 7.2 AR Distributors and Augmented Reality 7.3 Holostream: Adaptive Streaming Solution
8. Use Cases for Digital Humans
9. Conclusion
10. FAQs

Creating Digital Humans with Volumetric Video

Volumetric video is an innovative technology that allows Creators to develop digital humans and forge human connections even when physical presence is not feasible. In this article, we will explore the process of creating digital humans using volumetric video and the various applications and possibilities it offers.

1. Introduction

In this section, we will provide an overview of volumetric video and its significance in enabling human connections in a digital environment. We will discuss the potential of digital humans as stand-ins for in-person events and the advantages they offer in an augmented reality-driven world.

2. Creating a Digital Human

In this section, we will Delve into the process of creating a digital human using volumetric video. We will start by introducing the capture system, specifically highlighting the unique features of the Tetavi capture system. Then, we will explore the steps involved in capturing a performance and transforming it into a usable digital format.

3. Microsoft Mixed Reality Capture Studio

This section will focus on the Microsoft Mixed Reality Capture Studio, run by Metastage in Los Angeles. We will discuss the setup of the capture stage and the equipment used for capturing performances. Additionally, we will examine the processing and output stages, where the captured performances are transformed into usable MP4 files.

4. Metastage and Jedu App

Here, we will explore the collaboration between Metastage and the Jedu app. We will discuss how Metastage has been creating digital humans for the Jedu app, which allows fans to perform alongside holograms of their favorite musicians and performers. We will highlight the power of such experiences in connecting fans with their idols when physical concerts and events are not possible.

5. Emotional Impact of Volumetric Video

In this section, we will showcase the emotional impact of volumetric video through two compelling examples. Firstly, we will explore a project for Santander Bank that beautifully illustrates the struggles of the working homeless. Secondly, we will discuss how the Korean boy band BTS helped launch a new Samsung phone by including digital versions of themselves, creating excitement among their fans.

6. Editing Digital Humans

Here, we will compare the traditional video production pipeline with the specific requirements of editing digital humans. We will introduce HollowEdit, a post-production pipeline designed for volumetric video, which streamlines the process of fixing mesh, cleaning textures, and making necessary adjustments to the digital human's physical performance.

7. Distribution of Digital Humans

This section will shed light on the importance of distribution in reaching the audience with digital humans. We will discuss AR distributors like 8th Wall that have broken down barriers for big brands to explore augmented reality with digital humans. Additionally, we will introduce Holostream, an adaptive streaming solution pioneered by Arcturus, which enables streaming of volumetric video to any device and maintains real-time interactions between digital humans and viewers.

8. Use Cases for Digital Humans

In this section, we will explore various use cases for digital humans beyond the examples Mentioned earlier. We will discuss the potential applications in industries such as healthcare (hologram concierge or nurse), gaming (real-time interactions), and more.

9. Conclusion

In conclusion, we will summarize the key points discussed throughout the article and reiterate the potential of volumetric video in creating digital humans and enabling human connections in a digital landscape.

10. FAQs

To provide further Clarity on the topic, we will address frequently asked questions related to the creation and distribution of digital humans using volumetric video technology.

Note: The headings and subheadings are subject to change during the writing process to ensure the flow and coherence of the article.