Get Benchmark Data
Retrieve complete benchmark data with all questions and answers.
This endpoint returns the full benchmark dataset including all questions, expected answers, and metadata. Use this to access the complete benchmark content for evaluation or review.
Path Parameters:
id: Unique benchmark identifier
Returns:
benchmark_id: Benchmark identifierbenchmark_name: Name of the benchmarkstatus: Benchmark statusdocuments: List of document IDs (single-element array for uploaded benchmarks, multiple elements for generated benchmarks)num_questions: Total number of questionsquestions: Full list of benchmark questions with answerscreated_at: Creation timestampupdated_at: Last update timestamp
Raises:
404: If benchmark not found or user doesn’t have access
Example Request:
GET /api/v3/benchmark/task-abc123/data
Headers: {"Authorization": "Bearer <api_key>"}
Example Response:
{
"id": "task-abc123",
"benchmark_name": "Benchmark_doc-123",
"status": "READY",
"documents": ["doc-123", "doc-456"],
"num_questions": 2,
"questions": [
{
"question_num": 1,
"question": "What is the main purpose of the product?",
"answer": "To provide real-time collaboration tools for distributed teams."
},
{
"question_num": 2,
"question": "How does the authentication system work?",
"answer": "Uses OAuth 2.0 with JWT tokens for secure authentication."
}
],
"created_at": "2024-01-15T10:30:00Z",
"updated_at": "2024-01-15T10:32:45Z"
}
Notes:
- Only returns benchmarks owned by the user
- Contains complete question and answer data for evaluation
- Use this endpoint when you need the full benchmark content (not just metadata)
Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Path Parameters
Response
Returns the full benchmark data including all questions and answers for a specific benchmark
Benchmark ID
"benchmark-123"
Name of the benchmark
"Customer Support Q&A"
Benchmark status
PROCESSING, READY, FAILED, DEPLOYING, EVALUATING, UNDEPLOYED, EVALUATED, STOPPED "PROCESSING"
Total number of questions
10
Creation timestamp
"2024-01-15T10:30:00Z"
Last update timestamp
"2024-01-15T12:30:00Z"
Data source
S3 storage key
S3 download URL
"https://s3.amazonaws.com/benchmark-123.zip"
Document IDs used for generation
["doc-abc123", "doc-def456"]Complete list of benchmark questions
[
{
"answer": "Our return policy allows returns within 30 days of purchase.",
"question": "What is the return policy?",
"question_num": 1
}
]Additional metadata
Error message if data fetch failed