Upload Benchmark File

Upload a pre-prepared benchmark file with questions and answers.

This endpoint allows you to upload a JSON file containing benchmark questions and answers, associating it with a specific document for evaluation purposes.

Request Body (multipart/form-data):

• file: JSON file containing benchmark questions and answers (required)
• name: Display name for the benchmark (required)
• document_id: Document ID that this benchmark is based on (required)
• description (optional): Description of the benchmark

File Format:

The uploaded JSON file should contain an array of question objects. Each question should have:

[
  {
    "question_num": 1,
    "question": "What is...",
    "answer": "The answer is..."
  }
]

Returns:

• id: Unique identifier for the uploaded benchmark
• name: Name of the benchmark
• status: Upload status (pending, completed, failed)
• questions: List of benchmark question objects, each containing:
  • question_num: Question number
  • question: Question text
  • answer: Expected answer text
• num_questions: Total number of questions in the benchmark

Raises:

• 400: If file format is invalid, JSON structure is incorrect, or document_id is not found
• 413: If file size exceeds limit

Example Request:

POST /api/v3/benchmark/upload
Headers: {"Authorization": "Bearer <api_key>"}
Content-Type: multipart/form-data

Form Data:
  file: benchmark_questions.json
  name: "Customer Support Q&A"
  document_id: "doc-abc123"
  description: "Benchmark for customer support documentation"

Example Response:

{
  "id": "benchmark-xyz789",
  "name": "Customer Support Q&A",
  "status": "completed",
  "questions": [
    {
      "question_num": 1,
      "question": "How do I reset my password?",
      "answer": "You can reset your password by clicking the 'Forgot Password' link on the login page."
    },
    {
      "question_num": 2,
      "question": "What are the system requirements?",
      "answer": "The system requires a modern web browser with JavaScript enabled."
    }
  ],
  "num_questions": 2
}

Notes:

• File must be in valid JSON format with proper question structure
• Each question must include question_num, question, and answer fields
• The benchmark is immediately available for use in evaluations after upload
• Uploaded benchmarks are immediately available for evaluation