Silhouette of a person kneeling on the ground in a misty forest with dense trees and rocks in dim blue lighting.

The Morph

Live Motion Capture performance & Virtual Production short
Category
live performance
Location
NYU ITP, New York, Us
YEAR
2024/11

Statement

Equiptment

Project Involvement

Credit

Project DEscription

Overview >

The Morph is a hybrid performance and film that explores how external forces shape identity, agency, and embodiment.

In the live performance, a central performer stands in the middle of the space, physically restrained by ropes held by the audience. As they pull and drag the performer, her digital avatar—mirroring her movements—triggers real-time scene, lighting, and avatar transformations in a game engine. The avatar, initially featureless, gradually accumulates growing elements—representing external influences such as technology, power, societal expectations, or abstract organic mutations.

As the performance progresses, the performer’s physical and emotional state shifts; at first, she simply reacts, then begins to embrace her form, but as more is imposed upon her, the body becomes overburdened and ultimately collapses. In the final stage, the performer resists being pulled, struggling against the force of the audience yet unable to escape.

The work merges physical and digital space, making the performer both the subject of control and the emotional core of the avatar’s transformation. The accompanying film, created with virtual production LED walls and volumetric capture, captures the most refined choreography from the performance, presenting a cinematic reimagination of the evolving body and its struggle.

The Morph - Live Performance >

The Morph - Experimental Short  >

technical details
THE MORPH: LIVE PERFORMANCE >

RIGIDBODY MOTION CAPTURE >_

The performance features a custom motion capture system developed in Unreal Engine, utilizing 3D-printed rigid body holders to track the dancer’s limbs as separate units. This setup enables precise motion capture that fragments the performer’s body, creating a unique visual effect where each limb moves independently yet remains connected. The system enhances the surreal transformation of the avatar, reinforcing themes of external control and evolving embodiment.

PROJECTION MAPPING & LIVE INTERACTION >_

The performance took place in two distinct venues, each experimenting with audience perspective and interactivity. One featured projection mapping on a single long horizontal wall, guiding a focused line of sight, while the other surrounded the space with three walls projecting the same content. This setup allowed for an exploration of how spatial immersion and audience movement influenced engagement as they physically manipulated the performer.

Image Gallery >

Silhouette of a person bending forward with ropes attached, in front of a lit backdrop showing faint floral imagery.
Silhouetted person in dark clothing standing amidst horizontal ropes against a foggy backdrop.
Person in dark clothing striking a dynamic pose with arms extended, tethered by multiple ropes in a dimly lit space with a projection in the background.
Silhouetted figure bending forward with several ropes or cords attached, against a dark background with a faint abstract projection in shades of red and white.
Silhouette of a person with harness and ropes against a dimly lit backdrop showing abstract shapes.
Person in blue pants and black top wearing motion capture gear performing on a dark stage with a digital projection in the background.
A dark eerie scene with a floating, twisted wooden sculpture resembling a distorted face and torso above a tiled floor and sparse foliage.
Dark room with a surreal floating sculpture combining skeletal arms, golden ornate elements, and pearls, with broken ancient columns in the background.
Digital surreal scene featuring a wheelchair, two screens showing multiple surveillance camera feeds, humanoid forms, a large rock, and abstract shapes on a reddish tiled floor.
3D rendered scene showing scattered, broken statues and debris on a large red tiled floor with a foggy gray background.
THE MORPH: film >

MOTION CAPTURE & VOLUMETRIC CAPTURE >_

The film integrates both OptiTrack motion capture and volumetric capture to bring the creature to life while preserving the precision of the performer’s choreography. OptiTrack ensures accurate body movement tracking, while volumetric capture seamlessly embeds the dancer into the digital world, blending physical performance with the evolving avatar in a cinematic reimagination of transformation and control.

VIRTUAL PRODUCTION >_

The film utilizes virtual production with an LED wall, ensuring the digital world seamlessly integrates with practical lighting for realistic in-camera visuals. This setup enhances immersion for the performer, allowing them to react naturally to their environment while achieving accurate reflections, interactive lighting adjustments, and real-time scene changes. It also reduces post-production compositing, creating a more cohesive and efficient workflow.

Image Gallery >

Silhouette of a person kneeling on the ground in a misty forest with dense trees and rocks in dim blue lighting.
Silhouette of a person with an outstretched arm against a blue background of leafless tree branches.
Silhouetted person standing on a checkered floor in a dark room with various objects like a rocking horse, wheelchair, and furniture floating around.
Woman with hair in a bun looking upward with hands raised, shadows cast on her face in a dark setting.
Silhouette of a person with hair tied back, head tilted back and mouth open, against a blue background with bare tree branches.
Abstract humanoid figure composed of dark limbs and golden objects floating in a dark room with suspended vintage items around.
Dark scene bathed in red light featuring a large, monstrous creature lying on the ground surrounded by scattered limbs and human figures in distress.
Dark red-lit scene featuring a spider-like machine with multiple screens and mechanical limbs in a dim industrial space.
Silhouette of a person with hair tied back illuminated by red light in a dark industrial setting.
Surreal image of a fragmented skeletal figure standing on a checkered floor with a tricycle, chair, and book floating in the dark background.