Skip to content

K-Metaverse Festival & Expo 2022 - Interactive LED Wall

Period2022.09 ~ 2022.10
RoleReal-time Video Processing Developer, Computer Vision Engineer
Platform
PCInstallation
Tech
PythonOpenCVReal-time Compositing

Overview

Interactive LED wall installation for K-Metaverse Festival & Expo 2022 visitors. Experience-based media art that composites visitors with cultural heritage volumetric content in real-time and displays on large LED screens.

Work Scope

  • Real-time video processing pipeline (Python, OpenCV)
  • Computer vision system (MediaPipe)
  • LED display control system
  • QR code photo distribution web server
  • On-site installation and operation
  • Venue: COEX Hall B, Seoul

Key Features

Real-time Vision System - Hand Gesture Recognition

ML-based real-time hand gesture recognition for visitor interaction. Visitor position and motion tracking for interactive effect control using MediaPipe.

Real-time Vision System - Hand Gesture Recognition
Real-time Vision System - Hand Gesture Recognition
Real-time Vision System - Hand Gesture Recognition

Real-time Video Compositing

Real-time compositing of visitor video with cultural heritage volumetric content. Background removal via chroma key masking with interactive effects applied in real-time.

Real-time Video Compositing
Real-time Video Compositing

QR Photo Distribution System

Auto-capture of visitor experience photos with QR code generation. Instant mobile download via QR scan with server-based photo management system.

QR Photo Distribution System
QR Photo Distribution System

Achievements

  • Successful 3-day exhibition: Oct 13-15, 2022 at COEX
  • Uninterrupted operation throughout the event
  • Real-time compositing of visitors with volumetric content
  • Completed in 33 days: design, development, installation, testing