Silhouette of a person kneeling on the ground in a misty forest with dense trees and rocks in dim blue lighting.

The Morph

矍
实时动捕表演 & 虚拟制片短片
Category
现场表演
Location
纽约大学ITP，美国纽约
YEAR
2024/11

Statement

一场融合现场表演与影片的混合实践，通过由观众驱动的身体控制实时改变表演者的数字化身，探讨身份、能动性与外部影响之间的张力。

Equiptment

OptiTrack 光学动捕系统、定制可穿戴追踪器、绳索、短焦投影仪

Project Involvement

与来自纽约大学ITP及IDM的跨学科团队合作完成

Credit

现场表演:

创意总监：John Luo
编舞：Audrey Chou, Mingjun Han
用户体验联合指导：Lois He
投影映射：Damon Chen
3D全流程制作：Damon Chen, John Luo
开发：John Luo
表演者：Audrey Chou
作曲：Audrey Chou
特别鸣谢：NYU @Media Commons, Kevin Cunningham

影片制作:

导演、表演、编舞、声音设计：Audrey Chou
技术总监、虚幻引擎、虚拟制片、容积捕捉：Adi Somaiah
编剧、角色设计、动作捕捉、虚幻引擎：John Luo
摄影指导、虚幻引擎、视频剪辑、灯光：Matt Toups
3D全流程制作：John Luo, Damon Chen
调色：Sania Bhatia
特别鸣谢：NYU Tandon @ The Yard, WLAB XR, Matthew Rader, Evercoast
项目描述

概述 >

The Morph 是一场融合现场表演与影片的混合实践，探讨外部力量如何塑造身份、能动性与身体感知。

在表演现场，一位核心表演者立于空间中央，身体被观众手持的绳索所束缚。当观众拖拽表演者时，她那同步映射动作的数字化身，将在游戏引擎中实时触发场景、灯光与角色形态的转变。化身最初无面无形，却逐渐累积增生元素——象征着技术、权力、社会期待或抽象的有机异变等外部影响。

随着表演推进，表演者的身体与情绪状态不断演变：起初她仅是被动反应，继而开始接纳其形态，但随着更多外力强加于身，身体终不堪重负而崩塌。至终章，表演者奋力抵抗拉扯，在与观众力量的抗争中挣扎，却无法挣脱。

作品融合物理与数字空间，使表演者既成为被控制的对象，亦成为化身蜕变的情感核心。配合虚拟制片LED墙与容积捕捉技术制作的影片，则提炼了表演中最精炼的编舞段落，以电影语言重新演绎这场身体的演变与挣扎。

The Morph - 现场表演片段 >

The Morph - 实验短片片段  >

技术细节
THE MORPH: 现场表演 >

刚性动捕系统 >_

表演采用基于虚幻引擎定制的动作捕捉系统，通过3D打印的刚性固定架将舞者肢体作为独立单元进行追踪。该设置实现了精准的动作捕捉，将表演者身体“碎片化”，创造出肢体既独立运动又相互连接的独特视觉效应，强化了化身超现实的形变，呼应外部控制与身体演变的主题。

投影映射与实时交互 >_

表演在两个不同场地进行，分别探索观众视角与互动性的可能性。一处采用单面长墙投影映射，引导集中的视线；另一处则以三面墙环绕投影相同内容。此设置旨在探索空间沉浸感与观众移动如何影响其参与度——当他们以物理方式操控表演者时。

影像画廊 >

Silhouette of a person bending forward with ropes attached, in front of a lit backdrop showing faint floral imagery.
Silhouetted person in dark clothing standing amidst horizontal ropes against a foggy backdrop.
Person in dark clothing striking a dynamic pose with arms extended, tethered by multiple ropes in a dimly lit space with a projection in the background.
Silhouetted figure bending forward with several ropes or cords attached, against a dark background with a faint abstract projection in shades of red and white.
Silhouette of a person with harness and ropes against a dimly lit backdrop showing abstract shapes.
Person in blue pants and black top wearing motion capture gear performing on a dark stage with a digital projection in the background.
A dark eerie scene with a floating, twisted wooden sculpture resembling a distorted face and torso above a tiled floor and sparse foliage.
Dark room with a surreal floating sculpture combining skeletal arms, golden ornate elements, and pearls, with broken ancient columns in the background.
Digital surreal scene featuring a wheelchair, two screens showing multiple surveillance camera feeds, humanoid forms, a large rock, and abstract shapes on a reddish tiled floor.
3D rendered scene showing scattered, broken statues and debris on a large red tiled floor with a foggy gray background.
THE MORPH: 影片制作 >

动作捕捉与容积捕捉 >_

影片融合OptiTrack动作捕捉与容积捕捉技术，在保留表演者编舞精准度的同时赋予角色生命力。OptiTrack确保身体动作的准确追踪，而容积捕捉则将舞者无缝嵌入数字世界，使肉体表演与持续演变的化身在电影化的叙事中交融，呈现关于蜕变与控制的再想象。

虚拟制片 >_

影片采用LED墙虚拟制片技术，确保数字世界与实拍灯光无缝融合，实现真实的机内视觉效果。此设置增强了表演者的沉浸感，使其能对环境做出自然反应，同时实现精确反射、交互式灯光调整与实时场景变化。该技术也减少了后期合成工作量，创造出更统一高效的工作流程。

影像画廊 >

Silhouette of a person kneeling on the ground in a misty forest with dense trees and rocks in dim blue lighting.
Silhouette of a person with an outstretched arm against a blue background of leafless tree branches.
Silhouetted person standing on a checkered floor in a dark room with various objects like a rocking horse, wheelchair, and furniture floating around.
Woman with hair in a bun looking upward with hands raised, shadows cast on her face in a dark setting.
Silhouette of a person with hair tied back, head tilted back and mouth open, against a blue background with bare tree branches.
Abstract humanoid figure composed of dark limbs and golden objects floating in a dark room with suspended vintage items around.
Dark scene bathed in red light featuring a large, monstrous creature lying on the ground surrounded by scattered limbs and human figures in distress.
Dark red-lit scene featuring a spider-like machine with multiple screens and mechanical limbs in a dim industrial space.
Silhouette of a person with hair tied back illuminated by red light in a dark industrial setting.
Surreal image of a fragmented skeletal figure standing on a checkered floor with a tricycle, chair, and book floating in the dark background.