Skip to content

Integrator API Reference

The Integrator API provides programmatic access to the AgentV engine, enabling seamless integration with CI/CD pipelines, custom dashboards, and automated forensic workflows.

All Integrator API requests must include the X-Api-Key header.

Terminal window
X-Api-Key: {SERVICE_API_KEY}

Priority: P0 Programmatic scenario mutation for variance and robustness testing.

  • Body:
    • type (string): Mutation type (e.g., typo, jumble, synonym).
    • path (string): Path to a scenario JSON file.
    • raw_json (object, optional): Raw scenario JSON to mutate directly.
  • Support: Accepts Raw Content for cloud-native integration.

Priority: P0 Lists all registered evaluation metrics available for dynamic hydration.

Priority: P0 Returns the failure taxonomy for categorical diagnostics.

Priority: P1 Converts structured Markdown PRDs into validated scenario JSON stubs.

  • Body:
    • markdown (string): Raw Markdown content.
    • input_path (string): Path to a Markdown file.
  • Support: Accepts Raw Content.

Priority: P1 Environmental health audit. Checks project readiness, plugin loading, and catalog integrity.

Priority: P2 Forensic Root Cause Analysis (RCA). Returns the primary failure trigger and causal chain.


The spec-to-eval service uses a combination of hierarchical section splitting and LLM tasks synthesis. If parsing fails, verify the following Markdown requirements:

  • Title: Must start with an H1 header (# PRD: ...).
  • Sections: Use H2 headers (## Tasks) to demarcate logic blocks.
  • Missing Tasks: If no ## Tasks or ## Test Cases section is found, the engine will attempt LLM synthesis. Ensure this section contains either a bulleted list or H3 sub-headers.
  • Malformed Metadata: Ensure **Industry:** and **Use Case:** segments are correctly labeled in the Overview.
  • Topology Failures: Agent topology requires the pattern **AgentName:** writes to [X], reads from [Y].

If the heuristic parser cannot identify structured nodes, it triggers Gemini-powered Synthesis. Ensure GOOGLE_API_KEY is configured in your environment for high-fidelity fallback.


Faceted search across the global scenario catalog.

Consolidated system health, engine versioning, and telemetry.

Public integrity audit for signed traces.