Dark surreal artwork featuring numerous distorted, grimacing human faces clustered tightly in a shadowy background.

Synthetic Dystopia

人工合成废托邦
机器学习艺术与视觉实验
Category
机器学习
Location
纽约大学，美国纽约
YEAR
2022/05

Statement

《人工合成废托邦》是一系列围绕“城市杀戮”主题展开的机器学习艺术与视觉实验。项目试图通过机器学习算法创作一系列思辨性数字艺术作品，以此可视化城市衰败，从而修复我们对“城市杀戮”这一概念的疏离认知，并挑战我们这一代人，重新敏感化我们对城市毁灭的视角。

Project Involvement

此为纽约大学互动媒体艺术专业的毕业创作。感谢Derrick Schultz提供的宝贵资源与机器学习艺术家AvantContra的协助，本项目获得了IMA及中国机器学习艺术社群的积极反响。我曾受邀在Bilibili直播的“艺术宇宙谈”中展示并阐述该作品。

Credit

制作： Damon Chen
特别致谢：
AvantContra
Daniel Shiffman
Derrick Schultz
HuemanInstrumenti
William Chen
Roopa Vasudevan
Julie LizardoTora Thuland

resources

Synthetic Dystopia项目论文Synthetic Dystopia 项目演示文稿
创作主旨

Urbicide 城市杀戮 >

“城市杀戮” （Urbicide）意指“针对城市的暴力”。其最显著的形式是对城市肌理的暴力，即城市与其建筑的物理性摧毁与拆除。多年来，该术语的内涵不断拓宽。城市基础与城市生活的毁灭，实则是居民多元身份、信仰、传统、文化及记忆的毁灭。

情感钝化 >

对暴力的情感钝化是一种习惯化结果，导致人们在通过数字媒体反复接触暴力后，对暴力的负面反应与情绪日益减弱。人们越来越对城市环境中的战争与毁灭无动于衷，甚至产生依附情绪。大量社群非但没有阻止进一步的破坏与暴力，反而有意或间接地加剧了敌对双方间的紧张关系，有时甚至引发新的敌对形式，从而制造出城市杀戮暴力的恶性循环。

机器学习 >

我选择机器学习作为创作手段，原因有二：首先，我将AI视为创意生产的工具或媒介。机器学习可被视为一个促进图像生成、动画制作与操控的工具包。此过程可理解为人类艺术家与AI助手之间的协作。其次，我相信AI在“城市杀戮”主题中具有抽象的再现能力与象征意义。在此项目中，我构建了一个虚构情境：AI是艺术家或造梦者。换言之，我通过一个虚构的通用人工智能的视角来理解城市杀戮。
Act I : 衰变转换器

内部空间 ⥦ 衰败空间 >

Before

After

Before

After

概述 >_

衰变转换器能将一个内部空间转化为其衰败形态。该转换器能够基于衰变前图像的输入，生成持续进行中的、中间状态的衰变，以及未来的预期性破坏，反之亦然。它结合了正在发生的衰变与未来的预期性破坏。这套生成的图像旨在通过预言我们周遭环境处于城市衰败状态下的结局，向观众传递一种不安感与紧迫感。

呈现形式 >.

衰变转换器以数据雕塑或数据绘画的形式呈现。理想情况下，它将是一个数字画框或设置于所生成衰变房间内的投影映射装置。粒子系统的使用是对机器学习艺术的类比。由于生成图像的每个像素都代表机器学习模型中的一片数据，它正如浩瀚 turbulent 结构中的一粒微尘，在不断地变换、扭曲、转向，直至无穷。

技术细节 >

模型：MUNIT / CycleGAN
程序：Derrick Schultz的Colab Notebook，Unity音频反应式VFX（灵感源自Yuma Yanagisawa）
数据集：3343张内部空间图像，3890张衰败空间图像
数据集来源：Flicker (4750)，Google (2283)，个人相册 (200)

decayed example (ITP classroom) >

Before

After

Empty conference room with rows of black chairs and tables under fluorescent lights.
Empty classroom with multiple rows of tables and chairs facing whiteboards and a large TV screen.
Empty classroom with long tables and chairs arranged in rows facing a whiteboard.
Dark, abandoned conference room with long tables and black chairs scattered across a damaged floor.

衰变示例 (纽约大学IMA CApstone演讲场地) >

Before

After

Empty room with rows of brown chairs facing a dark wall with a telescope and tripod on wooden floor.
Empty dark classroom with rows of black chairs facing a blackboard and a teacher's desk.
Empty room with rows of red chairs facing a projector screen and a small table with equipment on a worn wooden floor.
Empty lecture room with rows of chairs facing a podium and a large screen.

衰变转换器数据雕塑 >

Abstract art installation composed of numerous small reflective square tiles arranged in a swirling, dynamic pattern.
Dimly lit empty conference room with a long table, chairs, and large windows.
Modern conference room with black tables and chairs arranged in a U-shape, a large flatscreen TV on a stand, and a whiteboard wall on the right.
Act II : 人类建筑的时间线（演化与灭绝）

机器生成建筑草图 >

Black and white sketch of a modern multi-story building with balconies and large windows.
Grid of 25 detailed black and white line drawings depicting various traditional and modern Japanese buildings.
Grid of 25 detailed black ink architectural sketches of various buildings and houses on a white background.

概述 >_

项目采用一个非凡人工智能的虚构视角，设定于人类已不复存在的未来。作为漫长破败城市中最后的意识存在，这位AI正在梦中回望过去，沉思人类文明反高潮的终局。它追忆曾经发生的暴力，见证过的冷漠，并哀叹文化的衰败与人性的沦丧。

呈现形式 >.

该系列机器学习艺术作品是以科学插图风格呈现的建筑草图。这些时间线是机器如何研究人类过去的印象，如同我们在百科全书或解剖学书籍中看到的那些生成插图。

技术细节 >

模型：StyleGan2 ADA, StyleClip, Disco Diffusion
程序：StyleGan2 ADA PyTorch Colab (Derrick Schulz), StyleClip (StyleGan3 + CLIP) Colab (nshepperd), Disco Diffusion v5.2 Colab (Katherine Crowson)
数据集：570张处理过的建筑草图
数据集来源：@jlron, @yann.leroy, @i_am_yeono, @its_leepd, @maxiaowei_artist

"建筑草图"（定制训练的StyleGAN模型） >

潜在空间线性插值 (z:0.8) >

截断插值 (ψ=0.8-2.8, seed 470) >

人类建筑时间线 >

Detailed black-and-white ink drawing of a traditional two-story Japanese house surrounded by foliage.
Black and white pen sketch of a row of old, weathered buildings with varied architectural styles and details.
Detailed black and white ink sketch of an industrial building facade with pipes, windows, and structural supports.
Black and white sketch of three connected storefront buildings with varying roof and window styles.
Detailed black ink sketch of a multi-story industrial building with antennas and external staircases.
Black and white sketch of a multi-level modern building with various windows and structural details.
Detailed black and white sketch of a two-story building with storefront windows and awnings.
Artistic digital rendering of a modern building with curved glass facades and a traditional roof section.
Metallic abstract sculpture resembling a distorted, multi-layered building facade with windows and balconies.
Detailed sketch of a modern two-story building with large windows and exterior staircases under bright lighting.
Futuristic metallic sculpture with sharp, abstract architectural elements and reflective surfaces.
Sketched modern multi-story building with large windows and a power pole in front.
Futuristic architectural sketch of a multi-level building with modern and angular design elements, featuring large windows and varying textures.
Abstract digital artwork resembling a futuristic, fragmented building with protruding structures and illuminated windows.
Futuristic industrial building with complex pipes and modern skyscrapers in the background.
Futuristic, abstract building with complex metallic and glass structures, featuring a mix of geometric and layered design elements.
Digital artwork of a futuristic, weathered industrial building with intricate mechanical and metallic details.
Futuristic industrial building with metallic textures and complex architecture isolated on white background.
A weathered, industrial-style concrete building with exposed pipes and a utility pole in front, set against a white background.
Futuristic digital artwork of a multi-story urban building blending modern and traditional architecture with detailed textures and light reflections.
A digitally rendered dilapidated multi-story building overgrown with plants and graffiti, showing signs of decay and abandonment.
Abandoned industrial building ruins overgrown with greenery and vines.
Futuristic multi-level building with integrated greenery and industrial design elements.
Two weathered, abandoned buildings with broken windows and overgrown green plants on and around them.
Abandoned futuristic building partially covered with greenery and plants.
A futuristic, concrete building overgrown with tall green plants and vines against a white background.
A dilapidated abandoned building overgrown with green plants and moss, isolated on a white background.

人类建筑时间线（城市杀戮的起因） >

Detailed black and white sketch of a two-story building with balconies, windows, and dense foliage surrounding it.
Modern building with curved, cantilevered upper section and adjacent greenery in an urban setting.
Abstract futuristic sculpture resembling a metallic, fluid form with embedded translucent textured rectangular panels on a reflective surface.
Abandoned, weathered concrete building with overgrown plants and cracked pavement surrounding it.
Abstract digital sculpture resembling a futuristic, organic architectural form on a textured surface.
Futuristic architectural model of a building with greenery and wooden textures on a layered base.
Abstract architectural structure blending organic, porous pink forms with modern metallic and glass elements on a light background.
Sketch of a two-story building with multiple windows, doors, and roller shutters.
Futuristic concrete building with smooth, curved architectural design and geometric detailing.
Futuristic architectural building with smooth, flowing curves and reflective metallic surfaces.
Futuristic, weathered building with layered concrete structures, graffiti, and sparse greenery.
Abstract architectural structure resembling a modern building with layered, beige, and textured surfaces on a barren ground.
Rustic, weathered wooden house with multiple levels and red vines growing around it.
Abstract futuristic building with organic mushroom-like structures and red dripping accents.
Detailed black and white sketch of a traditional two-story Japanese house with tiled roof and wooden exterior.
Digital artwork of a stylized multi-story house combining wooden and concrete architectural elements with a curved roof.
Intricately detailed traditional Asian-style building with layered roofs and wooden accents.
Old traditional Asian-style building with curved tiled roofs and weathered wooden walls isolated on white background.
Ancient wooden Asian-style house partially submerged in still water with detailed carvings and a small rock in the foreground.
Model of a partially destroyed traditional Asian-style building with visible wooden beams, crumbling walls, glowing embers, and smoke rising from the structure.
Futuristic, densely-packed multi-level building combining traditional and modern architecture styles.
Black ink sketch of a traditional two-story Japanese house with tiled roof and detailed wooden features.
Abstract symmetrical digital artwork resembling a pair of traditional Asian-style buildings with intricate wood-like textures on a white background.
Intricately detailed miniature of a traditional East Asian wooden house with ornate carvings and glowing lanterns.
Intricate digital rendering of an ancient Asian-style building with layered rooftops and detailed textures on a white background.
Intricately detailed ancient Chinese-style temple with a flowing water feature and green vegetation around it.
Ancient temple engulfed in flames and smoke, partially damaged with glowing fire inside.
Futuristic, heavily mechanized building combining traditional Asian architectural elements with large mechanical gun turrets.
Act III: 机器学习艺术

人工梦魇 4K >

基于PYTTI工具的3D动画实验

概述 >_

《人工合成废托邦》的第三幕汇集了图像或动画形式的机器学习艺术作品。图像集合包含两种风格：
‍
1. 对衰败城市环境意象的图形化描绘。
2. 对人类文明虚妄的宏伟及其静默衰败中深层反讽的抽象表征与符号。

技术细节 >

模型：Disco Diffusion, PYTTI Tools
程序：Disco Diffusion v5.2 Colab (Katherine Crowson), PYTTI Colab (sportsracer48

城市杀戮 (Pink Floyd - Speak To Me / Breathe) 4K >

基于Disco Diffusion的3D动画实验（灵感源自HuemanInstrumenti）

空心人 (T.S. Eliot - The Hollow Men) 4K >

故事板与实验

Dark surreal landscape filled with humanoid scarecrow figures made of tattered material under a cloudy sky and rocky hills in the background.
Black and white surreal artwork featuring three distorted human faces intertwined with twigs and branches.
Surreal grayscale scene with distorted humanoid figures in a nightmarish composition, featuring a large head, skeletal limbs, and shadowy entities.
Surreal dark artwork showing grotesque humanoid figures with elongated limbs confronting each other across a cracked mirror.
Dark, surreal painting of distorted humanoid figures in a grim, eerie scene with a large haunting face on the right.
Dark surreal scene with mysterious cloaked figures and a large cracked mask-like face blending into the textured background.
Dark, surreal scene of distorted humanoid figures in tattered clothing gathered in a dimly lit space, evoking a nightmarish atmosphere.
Close-up of a dark, fantastical eye surrounded by textured, glossy tentacles and spiral shell-like structures.
Abstract organic structure resembling intertwined tentacles with glowing, eye-like orbs and a central bright light.
Ancient column supporting a swirling wooden vortex with a glowing galaxy at its center.
Surreal scene with a massive eye-shaped wooden structure floating above a smoky, fiery landscape with small humanoid figures beneath it.
Surreal figures with skeletal faces and glowing eyes emerging from swirling, cloud-like textures.
Dark surreal scene of ghostly, hooded figures with tangled gray hair and haunting, distorted faces blending into a misty background.
Dark, surreal scene with numerous robed figures gathered around a fiery, volcanic landscape with glowing lava and smoky skies.
Surreal scene with towering, abstract humanoid figures and a crowd of smaller figures in a smoky, orange-lit environment.
Surreal scene with towering humanoid figures overlooking a crowded gathering in a barren landscape under a cloudy sky.
Crowd of distorted humanoid figures standing in a dark, surreal wasteland with tall, eerie structures under a cloudy sky.
Surreal desert scene with humanoid cacti figures having eerie faces, twisted branches, and a misty background.
Surreal landscape with large skull-like structures featuring mechanical, spiral eyes and eerie humanoid figures scattered on a barren ground.
Surreal scene with large, decayed bird-like heads entwined with roots and branches, and distorted, elongated human limbs amidst a barren, smoky landscape.
Surreal, dark fantasy scene featuring grotesque, creature-like forms with tangled, root-like textures and large hollow eyes on a muted background.
Dark surreal artwork featuring three distorted and grotesque human-like faces with exaggerated wrinkles and deformed features on a textured background.
Post-apocalyptic scene with tall, dilapidated buildings and overgrown vegetation under a cloudy sky.
Dark, abandoned cityscape with tall, dilapidated buildings under a gloomy sky and scattered orange street lights.

作品阐释

《空心人》机器学习动画基于T.S.艾略特的同名诗歌。诗中的“填充草人”暗喻冷漠的民众，如同稻草人，随风而动。我借用诗中的“填充草人”意象，来象征那些人云亦云、畏惧直言真相，进而维系情感钝化循环的人。

作品阐释

我的多件作品描绘了人群，他们并非处于骚动，而是默许——当背景中的城市在燃烧、爆炸、鲜血横流，各种暴行肆虐之时。这正契合了诗末诗人的预言：随着情感钝化加剧，冷漠的人群聚集，终成“王国”，届时“世界将并非轰然落幕，而是呜咽告终”。

最终影像呈现

《人工合成废托邦》VR虚拟画廊 >

虚幻引擎实时演示 >

截图 >

Modern art gallery with wooden floor displaying dark, surreal paintings on both walls and illuminated square artwork at the far end.
Modern art gallery with wooden floor, white walls, black-and-white photographic portraits, architectural images, and white benches.
Modern art gallery with polished wooden floor, white walls, and various dark, surreal paintings on display.
Modern art gallery room with wooden floors, white benches, and surreal dark-toned paintings displayed on walls.