K-Heritage AR - Volumetric Cultural Heritage Viewer
Overview
AR viewer platform for popularizing intangible cultural heritage. Volumetric video performances (Taekkyeon, Pansori, Cheoyongmu, etc.) from the National Intangible Heritage Center can be viewed in real-time on mobile and AR glasses.
Work Scope
- iOS/Android native app development (Swift, Kotlin, ARKit, ARCore)
- Volumetric compression technology research & development
- 10-stage content production pipeline design
- Real-time rendering engine development (SceneKit + Metal, GLES)
- Nreal AR Glass platform porting (Unity3D)
- Admin web system (Node.js, GCP)
Key Features
10-Stage Volumetric Pipeline & Compression
Designed 10-stage post-processing pipeline combining Draco mesh compression + H.264/HEVC texture compression. Achieved 96% compression rate (2GB → 73MB) with custom glTF Binary extension format.
Real-time 3D Mesh Rendering & Video-Mesh Sync
Built native rendering engines from scratch for iOS (SceneKit+Metal) and Android (ARCore+GLES). Triple buffering and GPU context synchronization for perfect video-mesh sync at 30fps without frame drops.
AR Plane Detection & Content Placement
Real-time volumetric content placement using ARKit/ARCore plane detection. Supports space recognition and card recognition modes with pinch/swipe/drag gestures for size, rotation, and position control.
Nreal AR Glass Platform
Developed Unity3D-based AR glass viewer for Nreal Light. Utilized compression technology and packaging pipeline from native apps with hands-free optimized UI/UX.
Admin Web System & Server
Full-stack server built with Node.js and GCP. Integrated Firebase real-time database, cloud storage, and CDN for content management, user analytics, and app version control.
Achievements
- 96% compression rate: 2GB → 73MB
- 30fps playback for 2min+ content without frame drops (vs. previous 8-12fps, 30sec limit)
- Multi-platform support: iOS, Android, Nreal AR Glass
- Featured on KTV Industry News (Ministry of Trade, Industry and Energy)
- Released on App Store and Google Play Store