AI Creative Technologist creating the app and AIs at the heart of Chorus of Light, the Samsung interactive immersive installation at Vivid festival of light. Near the Sydney Opera House, for a month, thousands of visitors each night walked through a 3D grid of volumetric light effects, to speak to tablets in the centre to share their hopes for the future as a custom volumetric light-effect filling the entire space. The web-app and AIs capture each person’s speech in any language, translate and speak it back in a generated voice for each language in turn, interpret its emotion and meaning into categories, to sequence a custom effect sent to play on the lighting system - a full-stack JS
and Node
app, views and interaction, audio-verbal inference and translation via Google Cloud
and Gemini
akin to Galaxy AI
, combination and time-sequencing of custom light-effects, real-time networking over OSC
and WebSockets
. Led this core tech from pitch to production - in collaboration with Amplify, Lightology, Susan Kosti, Ta-ku, Eat the Elephant.
2024.03-2024.05 [0
1
2
3
4
5
6
7
8
9
A
B
C
D
E
F
G
H
I
J
] ++
[Toggle any arrows for details; double-tap media to expand the view; try any broken links on **archive.org]**
Chorus of Light, installation, AI ~ project @ Samsung, Vivid, Amplify