ClaudusBridge

🤖 492+ AI Tools

🔌 MCP Protocol

🏗️ 47+ Categories

🔒 100% Local

👁️ Multi-Agent + Watcher

ClaudusBridge is an AI-powered Unreal Engine 5 editor plugin that exposes 493+ tools for controlling UE Editor in real-time via the Model Context Protocol (MCP). Any MCP-compatible AI client — Claude Code, Codex CLI, Cursor, Windsurf, Claude Desktop and more — can connect and manipulate the editor autonomously.

Version 0.5.0 introduces full multi-agent coordination: per-session event subscriptions, an agent_message bus for agent-to-agent messaging, and a mandatory visual watcher sub-agent that observes the editor through /preview?bare=1 while the primary agent works with the user. The verification gap — tools say success based on API return values but the visual reality may disagree — is now closed by design.

The plugin now also ships a persistent shared knowledge base under Saved/ClaudusBridge/memory/ that every agent (Claude Code, Codex CLI, Cursor, Windsurf, …) reads and writes. The plugin gets more useful with every session instead of re-teaching the same lessons. An ergonomic CLI helper cb.py is auto-generated on every connect and collapses the repetitive curl + JSON-RPC + Python-unwrap pattern into single-line subcommands.

From Blueprint scripting to Material creation, Actor management to Niagara VFX, ClaudusBridge turns natural language into editor actions, with an always-on internal watcher and a self-improvement loop that learns from every session.

---

Who It's For

Target	Use Case
Solo Developers	Accelerate prototyping by describing what you want instead of clicking through menus
Studios & Teams	Automate repetitive editor tasks, batch operations, and pipeline workflows; multiple agents working in parallel without stepping on each other
Technical Artists	Scriptable Material and Niagara workflows via AI commands; visual watcher confirms the result matches the intent
Educators & Students	Learn UE5 concepts with AI-guided, interactive exploration — see exactly what the agent does through the WebRTC stream

---

Key Features

• 493+ Tools across 47+ categories (Blueprints, Materials, Actors, Niagara, Widgets, Sequencer, Animation, Mesh, Audio, Physics, and more)
• cb Ergonomic CLI — Auto-generated Saved/ClaudusBridge/cb.py collapses curl + JSON-RPC + Python-unwrap into single-line subcommands (cb spawn, cb tx, cb capture, cb verify, cb remember, …). The preferred interface for any agent
• Persistent Shared Knowledge Base — Saved/ClaudusBridge/memory/ accumulates tribal knowledge across all agents and sessions. Topic files + _log.jsonl + auto-curated _index.md. Five MCP tools: memory_remember / memory_recall / memory_topics / memory_search / memory_consolidate
• EYES MANDATORY — Every agent driving the editor MUST use the streaming captures. API success ≠ visual success. Every editor tool returns success based on whether the API call completed, NOT whether the result actually looks right. The plugin enforces the rule throughout the auto-generated docs the agent reads on every connect
• Multi-Agent Coordination — Per-session subscription queues, publish_agent_event bus for agent-to-agent messaging, channel-based broadcast or targeted delivery
• Iterative Dialogue Pattern — Make a small change, look at it, decide next change, repeat. The watcher publishes plain-text observations on the agent_message bus; the primary reads them between user turns and acts on visual ground truth
• Dual-Watcher A/B Parity — Spawn TWO watchers in parallel (one per browser extension) for high-stakes parity verification
• Pixel Streaming Readiness Gate — pixel_streaming_status MCP tool gives every agent a single source of truth for whether the editor's WebRTC pipeline is up before any capture
• Persistent Watcher Daemon — Production-grade Python daemon (Saved/ClaudusBridge/claudusbridge_watcher.py) with pattern rules (compile loops, PIE crash-on-start, actor leaks); pure stdlib, JSON logs, exponential-backoff reconnect
• Always-On Internal Watcher — Built-in C++ watcher (FCBInternalWatcher) that runs from plugin load, no setup required
• Self-Improvement Loop — record_feedback writes to Saved/ClaudusBridge/feedback.jsonl and broadcasts on the agent_message bus; the canonical signal for plugin evolution
• Robust Transform Parser — spawn_actor / spawn_basic_shape accept location/rotation/scale as arrays, objects, or top-level scalars (and uniform scale: 2 for all axes); top-level scalars override array form so callers can patch one axis
• Neural Cortex Architecture — Tools organized as interconnected neurons: perception, navigation, creation, and engineering regions
• AI Vision System — /preview WebRTC stream as the primary realtime view; structured perception tools (ai_perceive, ai_vision_stream, get_vision, get_cognitive_map, scan_360, proximity_alert) for spatial awareness without pixel I/O
• Smooth Navigation — WASD-style camera movement, orbit, look_at_actor, fly_to_actor with collision avoidance (never teleport)
• NNE GPU Inference — ONNX model loading via DirectML Tensor Cores (load_nne_model, get_nne_status, list_nne_runtimes)
• Open Protocol — Works with any MCP-compatible AI client; Codex CLI / rmcp-strict transport fully supported (HTTP 202 Accepted on notifications/initialized)
• 100% Local — No cloud, no API keys, no subscriptions. One-time purchase, runs entirely on your machine
• Full C++ Source — Complete source code included, fully extensible
• Real-Time Dashboard — Monitor connections, session stats, multi-agent / watcher status, and recent activity from within the editor
• Cross-Platform — Windows, macOS, and Linux support

---

How It Works

AI Client (Claude Code, Codex CLI, Cursor, Windsurf, Claude Desktop, ...)
    |
    | 1. HTTP POST /mcp (JSON-RPC 2.0, Streamable HTTP, MCP spec 2025-03-26)
    v
ClaudusBridge MCP Server (Port 3000)
    |
    | 2. Per-session event queue + agent_message bus
    |    (subscribe_events, poll_editor_events, publish_agent_event)
    v
Router -> Neural Cortex -> 40+ Manager classes
    |
    | 3. Executes on GameThread
    v
Unreal Engine Editor API + /preview WebRTC stream
    |
    | 4. Internal C++ watcher inspects every event, records feedback
    | 5. Sub-agent watcher observes /preview?bare=1, publishes observations
    v
Your Project (Blueprints, Materials, Actors, Niagara, Sequencer, ...)

1. You describe what you want in natural language to your AI client
2. The AI translates your request into MCP tool calls
3. ClaudusBridge executes the commands in the Unreal Editor
4. The watcher confirms that the visual result matches the intent
5. You see results instantly through the WebRTC /preview stream

---

Quick Example

"Create a Blueprint actor with a BeginPlay event that prints 'Hello World' after a 2-second delay"

The AI will automatically:

1. Subscribe its primary session to agent_message and spawn the visual watcher sub-agent
2. Call read_blueprint to inspect the target
3. Call add_event_node to add BeginPlay
4. Call add_node to create a Delay node and PrintString
5. Call connect_pins to wire the execution flow
6. Call compile_blueprint to validate
7. Drain poll_editor_events to read the watcher's observation confirming the graph compiled green and the Print String node is wired correctly

All without you touching the editor — and with visual ground truth instead of blind tool-success assumptions.

---

Supported Domains

Domain	Tools	Description
Blueprint Nodes	18	Add, delete, configure graph nodes
Pin Connections	3	Wire execution and data flow
Events	2	Standard and custom Blueprint events
Variables	3	Create, delete, configure variables
Functions	5	Create functions with inputs/outputs
Inspection	7	Read Blueprint structure, analyze graphs
Actors	23	Spawn, transform, configure actors and components
Assets	17	Find, duplicate, rename, delete assets
Materials	30	Create materials, expressions, instances
Editor	48	Viewport, PIE, capture_editor_window, console
World	9	Levels, lights, physics
Niagara	30	Particle systems, emitters, renderers
Widgets	29	UMG UI creation, manipulation, animations, events
Sequencer	12	Cinematics and animation tracks
Procedural Mesh	38	Runtime geometry creation and CSG
MetaSound	15	Procedural audio graphs
Editor Events	4	poll/subscribe + publish_agent_event + record_feedback
Neural Cortex	12	ai_perceive, ai_navigate, ai_create, ai_modify, ai_inspect, ai_build, ai_scene, ai_blueprint, ai_media, ai_engineer, ai_evaluate, ai_brain_map
AI Vision	7	ai_vision_stream, ai_vision_identify, NNE GPU inference
And 25+ more...	180+	Animation, Physics, Landscape, Source Control, MVVM, BlueprintLisp...

---

Next Steps

• Installation & Setup — Get ClaudusBridge running in 5 minutes
• Connecting Your AI Client — Configure Claude Code, Codex CLI, Cursor, or any MCP client
• Your First Commands — Hands-on tutorial
• The cb Helper CLI — The preferred ergonomic interface for every agent
• EYES MANDATORY — The foundational rule: never program blind
• Iterative Dialogue Pattern — Talk to the watcher while you work
• Memory System — Persistent shared knowledge across sessions and agents
• Multi-Agent Coordination — Per-session events, agent bus, watcher patterns
• Tools Reference — Complete reference for all 493+ tools