fork of openclaw — v0.2.0

Your local AI,
now with a face.

A VTuber-style 3D avatar overlay for OpenClaw with real-time expressions, eye tracking, lip sync, and speech — all running locally on your desktop.

Compatible with
LM StudioOllamaWhatsAppTelegramDiscordSlackSignal
features

Everything bolted on.
Nothing stripped away.

Animation, gaze tracking, lip sync, expressions, rendering, and window controls — on top of OpenClaw's full feature set.

3D Avatar Overlay

A transparent Electron window renders your VRM model with a 4-state FSM — idle, thinking, speaking, working — driven by agent lifecycle events. Mixamo FBX clips crossfade between states with procedural breathing, head sway, and blinking fallbacks. VRM 0.x and 1.0 supported.

three-vrm 3.x · electron 33 · 4-state fsm

Eye Gaze & Awareness

Cursor-tracking gaze with eye and head separation, saccades on weighted intervals, and a 4-state hover awareness FSM — unaware, noticing, attentive, curious — that scales gaze intensity in real time.

saccades · hover fsm · vrm 0.x/1.0

Lip Sync + TTS

wLipSync provides real-time MFCC audio analysis with viseme blending. Kokoro TTS delivers offline neural speech across 11 voices. Phoneme-mapped, text-driven, and Web Speech API fallbacks ensure something always works.

wlipsync · kokoro-js 1.2 · 11 voices

Expressions

Six compound-blend expressions — happy, angry, surprised, sad, relaxed, neutral — with cubic easing and per-emotion durations. Hover overlays layer on top of any active state via max-merge blending.

6 blends · cubic easing · max-merge

Rendering & Physics

IBL shader injection computes SH3 coefficients from scene lights into MToon shaders. Spring bone physics drive hair and clothes. Pixel-sampled click-through passes input to windows below.

ibl shaders · spring bones · click-through

Smart Window

Native drag via main-process cursor polling — no webkit hacks. Display-aware bounds clamp on move and hotplug. Scroll-wheel zoom from 0.5× to 6.0× with head, upper body, and full body presets. Opacity, position, and settings persist between sessions.

native drag · zoom presets · persistence

Multi-Channel Gateway

WhatsApp, Telegram, Slack, Discord, Signal, iMessage, Matrix, Line — your assistant lives wherever you chat. All upstream channels and skills fully compatible.

8+ channels · full upstream compat
demo

See it in action.

Watch the avatar react to agent lifecycle events — expressions, eye gaze, lip sync, and state transitions in real time.

/avatar_show to activate

setup

Running in three steps.

An existing OpenClaw install and Node ≥ 22. That's it.

Install Plugin

One command installs the avatar overlay into your existing OpenClaw setup.

openclaw plugins install <release-url>

Restart Gateway

The plugin loads on restart and spawns the Electron overlay automatically.

openclaw restart

Meet Your Avatar

Alive, watching, and ready to assist. Swap in any VRM model.

openclaw plugins list
stack

Modern, fast, no bloat.

Every dependency chosen for performance and developer experience.

Electron 33runtime
Three.js3d
three-vrm 3.xavatar
Kokoro-jstts
wLipSynclip sync
Rolldownbundler
TypeScript 5.9lang
oxlintlint
Vitesttest

Give your AI
a face.

Open source, offline-capable, and fully yours. Fork it, mod it, make it your own.