Skip to content

Interactive Visual Suite

The Interactive Visual Suite (launched via agentv console) is a high-density forensic interface for managing the entire agent evaluation lifecycle.

The core of the suite is the Visual Debugger, which provides a frame-by-frame reconstruction of agent reasoning.

  • Node-Based Trajectory: Visualize agent turns as an interactive React Flow graph.
  • State Inspection: Real-time diffing of the Virtual File System (VFS) at any point in the timeline.
  • Live DNA Streaming: When using the RemoteBridgePlugin, evaluations stream events directly to the console in real-time.

One of the suite’s most powerful features is the “Isolate Root Cause” engine.

  • It scans the Failure Taxonomy markers and behavioral telemetry.
  • One-click focus scrolls the trajectory to “Patient Zero”—the exact step where the first logic, security, or state divergence occurred.

For rapid scenario design, the suite includes a drag-and-drop editor for the Agent Evaluation Specification (AES).

  • Node Library: Add task nodes, tool constraints, and success criteria via a GUI.
  • Instant Validation: The editor lints the scenario against the latest industrial schema in real-time.
  • Persistence: Scenarios saved in the builder are persisted directly to the industries/ directory.

The suite aggregates batch results into interactive leaderboards:

  • Head-to-Head Stats: Comparative pass rates, latency, and cost per agent.
  • Robustness Radar: Visualization of success consistency across diverse sectors.
  • Drift Analytics: Identification of behavioral shifts between model versions or prompts.

Developers can extend the Visual Suite using the Plugin System.

  • Custom Views: Inject React components into the dashboard using JIT-Babel hydration.
  • Custom Routes: Use the on_register_console_routes hook to add proprietary monitoring or administration endpoints.