Facial / Hand Gesture Interaction Design / Product Design
Shown at
Pleasure Engineered, Accent Sisters, NYC
Award
1st Place, NYC Product Build Club Contest
Key Visual
GAME / INTERACTION FUNCTIONS
1. Breath Interaction Participants can blow toward the camera or microphone to generate expanding clouds of color and fluid particle diffusion. Different breathing intensities affect the scale, speed, and emotional density of the visual output.
Visual Effects
Dynamic color blooming
Ink/water diffusion simulation
Floating particles
Atmospheric motion fields
2. Finger Gesture Interaction Hand and finger tracking allow users to directly manipulate visual materials in space.
Functions
Push and drag particles
Blend colors like liquid paint
Generate ripple distortions
Create motion trails and fluid deformation
3. Blink Recognition Eye blinking triggers hidden symbolic elements within the system.
Depending on the selected mode:
blinking generates stars,
floating numerical symbols,
or hidden visual fragments.
This mechanism transforms unconscious bodily behavior into poetic digital output, emphasizing the relationship between attention, awareness, and machine perception.
4. Mood-Based Color System The project includes a customizable emotional palette system inspired by:
Morandi colors,
pastel gradients,
natural elements,
and AI-generated atmospheric color mapping.
Participants can influence the emotional tone of the environment through simple prompts or interaction patterns.
5. Finish & Save System At the end of each session, the system freezes the generative canvas and transforms it into a final “Vibe Painting” poster.
The output acts as:
a memory trace,
emotional snapshot,
or digital self-portrait generated through interaction.
Installation View at Accent Sisters “Pleasure Engineered”
“Pleasured Engineered” Exhibition Poster
INTRODUCTION
An experimental creative tool that turns facial movements and hand gestures into expressive digital paintings and personalized posters, with no mouse or keyboard needed. I designed it end to end, from the interaction model and gesture vocabulary to the visual system and the final build. It won 1st Place at the Product Build Hackathon in NYC and was exhibited in the AI art show Pleasure Engineered at Accent Sisters.
Positioned between game, installation, and emotional interface, the project explores how invisible human emotions can be translated into fluid digital landscapes through computer vision and generative systems. Rather than functioning as a traditional game with fixed goals, Vibe Painting creates an open-ended sensory experience where participants “paint” using their body, mood, and presence.
Through blowing, finger movement, eye blinking, and spatial interaction, colors, particles, stars, numbers, and abstract visual elements continuously emerge, dissolve, and reorganize on screen — forming a living emotional canvas that is never repeated twice.
Inspired by meditation practices, emotional computing, East Asian aesthetics, and generative art, the system treats interaction not as command, but as a process of resonance between human perception and machine interpretation.