Retrieve complete benchmark data with all questions and answers.
This endpoint returns the full benchmark dataset including all questions, expected answers, and metadata. Use this to access the complete benchmark content for evaluation or review.
Path Parameters:
id: Unique benchmark identifierReturns:
benchmark_id: Benchmark identifierbenchmark_name: Name of the benchmarkstatus: Benchmark statusdocuments: List of document IDsnum_questions: Total number of questionsquestions: Full list of benchmark questions with answerscreated_at: Creation timestampupdated_at: Last update timestampRaises:
404: If benchmark not found or user doesn’t have accessExample Request:
GET /api/v3/benchmark/task-abc123/data
Headers: {"Authorization": "Bearer <api_key>"}
Example Response:
{
"id": "task-abc123",
"benchmark_name": "Benchmark_doc-123",
"status": "completed",
"documents": ["doc-123", "doc-456"],
"num_questions": 2,
"questions": [
{
"question": "What is the main purpose of the product?",
"expected_answer": "To provide real-time collaboration tools for distributed teams.",
"category": "product_overview"
},
{
"question": "How does the authentication system work?",
"expected_answer": "Uses OAuth 2.0 with JWT tokens for secure authentication.",
"category": "technical_details"
}
],
"created_at": "2024-01-15T10:30:00Z",
"updated_at": "2024-01-15T10:32:45Z"
}
Notes:
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Returns the full benchmark data including all questions and answers for a specific benchmark
Benchmark ID
"benchmark-123"
Name of the benchmark
"Customer Support Q&A"
Benchmark status
pending, completed, deploying, evaluating, undeployed, evaluated, failed "pending"
Total number of questions
10
Creation timestamp
"2024-01-15T10:30:00Z"
Last update timestamp
"2024-01-15T12:30:00Z"
Data source
S3 storage key
S3 download URL
"https://s3.amazonaws.com/benchmark-123.zip"
Document IDs used for generation
["doc-abc123", "doc-def456"]Complete list of benchmark questions
[
{
"answer": "Our return policy allows returns within 30 days of purchase.",
"question": "What is the return policy?",
"question_num": 1
}
]Additional metadata
Error message if data fetch failed