Skip to content

Quickstart: CrewAI + MultiAgentEval

Bring multi-agent crew evaluation to the MultiAgentEval.

1. Setup Your Agent API

Wrap your crew in an API that processes task requests.

from crewai import Crew, Agent, Task
from fastapi import FastAPI

app = FastAPI()

@app.post("/execute_task")
async def execute(request: dict):
    # Define your agents and tasks based on input
    # ...
    # crew = Crew(agents=[...], tasks=[...])
    # result = crew.kickoff()
    return {"content": result}

2. Register Your Crew

multiagent-eval evaluate --path scenarios/ --agent http://localhost:8000/execute_task --agent-name "CrewAI-Financial-Analyst"

3. Generate Verified Report

multiagent-eval report --path runs/run.jsonl --share