top of page
Physical Lego bricks, tracked live by a webcam, appear and move inside Unreal Engine in real time as their digital twins.
Claude Code + Unreal MCP (Blueprints):
Dynamic Blueprint authoring via MCP — map-based spawn/update/despawn keyed by label, OSC receiver actor, real-time transform updates, all built through Claude Code's Blueprint too
Unreal Engine
MCP
Computer vision (asset analysis → Unreal):
OpenCV HSV colour thresholding + contour detection identifies each brick, minAreaRect extracts position/rotation/size, persistent ID tracking holds identity across frames, streamed to Unreal over OSC/UDP.
bottom of page