Menu

Post image 1
Post image 2
1 / 2
0

STIKSHOT - A STICKMAN VIDEO RENDERER TOWARDS BEYOND

DEV Community: tensorflow·Mathew Addala·3 months ago
#pT4Jw76F
#dev#meta#browser#resolve#completed#photo
Reading 0:00
15s threshold

Build a 100% Client-Side AI Motion Capture Engine in the Browser Imagine uploading a dance video and having it instantly turned into a neon stickman animation—all without uploading a single megabyte to a server. That is stikshot, a local-first, serverless AI motion-capture web app. In this article, we'll dive into the architecture, the browser APIs we used, and the workarounds we engineered to make WebCodecs run stably on desktop and mobile. The Core Stack To keep stikshot completely serverless, static, and scale-free, we built the entire pipeline to run inside the user's browser sandbox: AI Engine: TensorFlow.js running the MoveNet Multipose model. Background Thread: Web Workers to keep the UI responsive. Compression: The browser's native WebCodecs API (VideoEncoder and AudioEncoder). Muxer: webm-muxer to compile the video/audio streams into a playable WebM file.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More