Create Benchmark Task

Create a new benchmark generation task from documents.

This endpoint starts a process to automatically generate benchmark questions from specified documents using AI. The generated questions can be used for model evaluation and testing.

Request Body:

• documents: List of document IDs to generate benchmarks from (required)
• num_questions: Number of benchmark questions to generate (required)

Returns:

• id: Unique task identifier for tracking generation progress
• status: Initial task status (always pending)

Raises:

• 400: If no documents provided
• 400: If document validation fails (missing documents or unauthorized access)

Example Request:

POST /api/v3/benchmark/create
Headers: {"Authorization": "Bearer <api_key>"}

{
  "documents": ["doc-abc123", "doc-xyz456", "doc-def789"],
  "num_questions": 10
}

Example Response:

{
  "id": "task-abc123-def456",
  "status": "pending"
}

Notes:

• All document IDs are validated before task creation to ensure they exist and belong to the user
• Use the returned task ID with /benchmark/status/{id} endpoint to track generation progress
• Once completed, the benchmark will be available for use in model evaluations