Jingyi Zhang


> Index
> Work
> Project

> About

I design AI-powered product with creativity and systematic thinking.

B2B/B2C SaaS for creative & production workflow.

Currently @ReelShort.




© 2026
       
         © 2026

Vibe Painting

Role
Creative Technologist, Interaction Designer
Medium
Facial / Hand Gesture Interaction Design / Product Design
Shown at
Pleasure Engineered, Accent Sisters, NYC
Award
1st Place, NYC Product Build Club Contest
0524

Key Visual




GAME / INTERACTION FUNCTIONS


1. Breath Interaction
Participants can blow toward the camera or microphone to generate expanding clouds of color and fluid particle diffusion.
Different breathing intensities affect the scale, speed, and emotional density of the visual output.
Visual Effects
  • Dynamic color blooming
  • Ink/water diffusion simulation
  • Floating particles
  • Atmospheric motion fields
2. Finger Gesture Interaction
Hand and finger tracking allow users to directly manipulate visual materials in space.
Functions
  • Push and drag particles
  • Blend colors like liquid paint
  • Generate ripple distortions
  • Create motion trails and fluid deformation


3. Blink Recognition
Eye blinking triggers hidden symbolic elements within the system.

Depending on the selected mode:
  • blinking generates stars,
  • floating numerical symbols,
  • or hidden visual fragments.

This mechanism transforms unconscious bodily behavior into poetic digital output, emphasizing the relationship between attention, awareness, and machine perception.
4. Mood-Based Color System
The project includes a customizable emotional palette system inspired by:
  • Morandi colors,
  • pastel gradients,
  • natural elements,
  • and AI-generated atmospheric color mapping.

Participants can influence the emotional tone of the environment through simple prompts or interaction patterns.


5. Finish & Save System
At the end of each session, the system freezes the generative canvas and transforms it into a final “Vibe Painting” poster.

The output acts as:
  • a memory trace,
  • emotional snapshot,
  • or digital self-portrait generated through interaction.



Landing Experience & System Interface Design


Gesture Recognition–Based Interactive Interface Design
 



Screenshot-2026-04-29-at-21.43.34

Customized Poster Generation Output
Screenshot-2026-05-02-at-01.41.58
Screenshot-2026-04-30-at-12.04.03



 

                       
                       Design Elements
Screenshot-2026-04-30-at-12.04.08
Screenshot-2026-05-02-at-10.39.30
    




Screenshot-2026-05-04-at-10.49.54

Interactive Interface Design


TECHNOLOGY USED



COMPUTER VISION

  • MediaPipe Hand Tracking
  • Face Landmark Detection
  • Blink Detection Algorithms
  • Real-Time Motion Tracking
GENERATIVE VISUAL SYSTEM

  • Particle Systems
  • Fluid Simulation
  • Procedural Animation
  • Noise & Motion Field Generation

CREATIVE CODING & RENDERING

  • JavaScript
  • HTML/CSS
  • Canvas API
  • Three.js / WebGL
  • React & React Three Fiber (R3F)
AI/ INTERACTIVE SYSTEMS

  • AI-assisted visual generation workflows(Gemini 3)
  • Real-time interaction mapping
  • Emotional parameter systems
  • Generative behavior design





word-image-13589-1
Exhibition Picture “Pleasure Engineered”
1
Installation View at Accent Sisters “Pleasure Engineered”


254e628850640c6e0445ccbf7db40b
“Pleasured Engineered” Exhibition Poster



INTRODUCTION

An experimental creative tool that turns facial movements and hand gestures into expressive digital paintings and personalized posters, with no mouse or keyboard needed. I designed it end to end, from the interaction model and gesture vocabulary to the visual system and the final build. It won 1st Place at the Product Build Hackathon in NYC and was exhibited in the AI art show Pleasure Engineered at Accent Sisters.

Positioned between game, installation, and emotional interface, the project explores how invisible human emotions can be translated into fluid digital landscapes through computer vision and generative systems. Rather than functioning as a traditional game with fixed goals, Vibe Painting creates an open-ended sensory experience where participants “paint” using their body, mood, and presence.

Through blowing, finger movement, eye blinking, and spatial interaction, colors, particles, stars, numbers, and abstract visual elements continuously emerge, dissolve, and reorganize on screen — forming a living emotional canvas that is never repeated twice.

Inspired by meditation practices, emotional computing, East Asian aesthetics, and generative art, the system treats interaction not as command, but as a process of resonance between human perception and machine interpretation.