Get Evaluation Status

Get the current status and progress of an evaluation.

This endpoint retrieves the status of a running or completed evaluation with detailed progress metrics. Use this to track progress and determine when results are ready.

Path Parameters:

• evaluation_id: Unique evaluation identifier

Returns:

• evaluation_id: The evaluation identifier
• status: Current status (pending, completed, failed)
• benchmark_id: The benchmark being used for evaluation
• progress (optional): Progress string (e.g., "3/10 questions")
• questions_completed (optional): Number of questions completed so far
• total_questions (optional): Total number of questions in the benchmark
• avg_time_per_question (optional): Average time per question in seconds
• eta_seconds (optional): Estimated time remaining in seconds

Raises:

• 404: If evaluation not found or doesn’t belong to the authenticated user

Example Request:

GET /api/v3/evaluations/eval-xyz789/status
Headers: {"Authorization": "Bearer <api_key>"}

Example Response (Pending):

{
  "evaluation_id": "eval-xyz789",
  "status": "pending",
  "benchmark_id": "task-abc123",
  "progress": "0/10 questions",
  "questions_completed": 0,
  "total_questions": 10
}

Example Response (In Progress):

{
  "evaluation_id": "eval-xyz789",
  "status": "pending",
  "benchmark_id": "task-abc123",
  "progress": "5/10 questions",
  "questions_completed": 5,
  "total_questions": 10,
  "avg_time_per_question": 12.5,
  "eta_seconds": 62
}

Example Response (Completed):

{
  "evaluation_id": "eval-xyz789",
  "status": "completed",
  "benchmark_id": "task-abc123",
  "progress": "10/10 questions",
  "questions_completed": 10,
  "total_questions": 10,
  "avg_time_per_question": 11.8
}

Notes:

• Poll this endpoint periodically to track evaluation progress
• Progress metrics (questions_completed, avg_time_per_question, eta_seconds) are available while evaluation is running
• Once status is completed, use /evaluations/{evaluation_id}/results to get full results
• Status failed indicates an error occurred during evaluation