MuseumX Ensemble - Real-time Multi-user Interactive Exhibition
Overview
Real-time multi-user interactive exhibition platform for MuseumX Ensemble event. Visitors design butterflies on mobile web, then control them simultaneously on a large stage projection via WebSocket communication with Unreal Engine renderer.
Work Scope
- Web frontend development (JavaScript, HTML, CSS)
- Canvas API-based butterfly drawing system
- WebSocket real-time communication (Browser ↔ Unreal Engine Renderer)
- Joystick UI and real-time control system
- Multi-user concurrent access and state synchronization
- Responsive web (mobile, tablet, desktop)
Key Features
WebSocket Multi-user Real-time Communication
Bidirectional real-time communication between browser and Unreal Engine renderer. Multiple users create and control their own butterflies simultaneously with low-latency network architecture.
Touch-based Joystick UI
Virtual joystick UI optimized for mobile touch. Users control butterflies on stage in real-time via WebSocket transmission to large projection display.
Canvas Butterfly Drawing System
Butterfly design tool using Canvas API. User-drawn butterfly images are sent to Unreal Engine server and applied as 3D butterfly textures. Supports brush, color palette, touch/mouse input.
Achievements
- Successful event: May 2023 in Gangwon-do with multiple concurrent participants
- Stable multi-user real-time network system
- Low-latency WebSocket communication for instant feedback
- Web-based accessibility: No app installation required