- Overview
- Changelog
- Versioning
- Legacy
- Introduction to Legacy APIs
- Agent
- Agent Corpus Connection
- Agent Response
- Create Agent Response
- Get All Agent Responses
- Get Agent Responses By User
- Get Agent Responses By Project
- Get Agent Responses By Chat Thread
- Get Agent Response
- Delete Agent Response
- Create Agent Response Comment
- Get Agent Response Comment
- Get Agent Response Dashboard
- Create Agent Response Feedback
- Create Agent Response Log
- Pin Agent Response
- Unpin Agent Response
- Get Pinned Agent Responses
- Agent Reviews
- Agent Rating
- Agent Alias
- Agent Access
- Agent Type
- Agent User
- Agent Tags
- Agent Vote
- Agent Comment
- Chat Thread
- Create Chat Thread
- Get All Chat Threads Of An Agent
- Get All Chat Threads With Admin Panel Filters And Pagination
- Get Reduced Chatlogs by Thread ID for Admin Panel
- Get Chat Thread
- Edit Chat Thread
- Delete Chat Thread
- Add ChatThread-Corpus Connection
- Get ChatThread-Corpus Connection
- Delete ChatThread-Corpus Connection
- Project
- User Project
- Document
- Corpus
- Notification
- Feature Flag
- Get All Feature Flags
- Get DALL-E Feature Flag
- Get Share Agent Feature Flag
- Get Agent Alias Feature Flag
- Get SharePoint Index Feature Flag
- Get Chat Agent Creation Feature Flag
- Get OAuth Feature Flags
- Get Google OAuth Feature Flag
- Get LinkedIn OAuth Feature Flag
- Get MS SSO OAuth Feature Flag
- Get Github OAuth Feature Flag
- Team
- User
- Email Indexing Authorization
- Conversation Starters
- Tool
- Agent Tool Connection
- Organization Tool
- API Tool Template
- LLM Config
- Latest
- Introduction to Latest APIs
- Agents
- Agent Access
- Agent Alias
- Agent Tags
- Agent Comment
- Agent Rating
- Agent Review
- Agent Tools
- Agent User
- Agent User Permission
- Agent Vote
- Agent Type
- Get all Agents
- Create a new Agent
- Get an Agent
- Update an Agent
- Delete an Agent
- Activate an Agent
- Get agent history with pagination
- Restore an agent to a previous checkpoint
- Get Agent Prompt History
- Create a Recent Agent
- Delete a Recent Agent
- Create Starred Agent
- Delete Starred Agent
- Get the Status of an Agent
- Get User's Team Role for an Agent
- Create or Update an Agent using the Agent Builder
- Get Agent Filter
- Generate an image for an agent based on the provided description
- Get all Agents by Project
- Get list of Recent Agents
- Get all Starred Agents of the Authenticated User
- Get Agents accessible to the Current User across their Teams
- Get Agents by Project team, User team
- Agent Response Steps
- Corpora
- Get all Corpus
- Create a Corpus
- Get a Corpus
- Update a Corpus
- Delete a Corpus
- Get Corpus Agent Connections
- Get Default Corpus Agent Connection
- Annotate/Tag a Corpus
- Get Conversation Starters for a Corpus
- Get all Documents for a Corpus
- Upload a Document to a Corpus
- Delete Document(s) from a Corpus
- Check Duplicate Documents in a Corpus
- Get all Permissions for a Corpus
- Create a new Permission for a Corpus
- Delete a user permission for a corpus
- Get all user permissions for a corpus
- Documents
- Chat Logs
- Chat Thread
- Configurations
- Evaluations
- Retrieve all evaluations or filter by datasetGET
- Create a new evaluationPOST
- Delete a set of evaluations or a specific evaluationDELETE
- Retrieve all evaluation datasets for a specific agentGET
- Create a new evaluation dataset for the given agentPOST
- Delete multiple datasets or all datasets for an agentDELETE
- Retrieve a specific evaluationGET
- Update an evaluation runPUT
- Delete a specific evaluationDELETE
- List query results for an evaluation runGET
- Create a query result and save metricsPOST
- Retrieve a specific datasetGET
- Update an evaluation datasetPUT
- Delete a specific datasetDELETE
- Retrieve queries for an evaluation datasetGET
- Create a new query for evaluationPOST
- Retrieve all unique tags from all datasets in the organizationGET
- Get a specific metric result by IDGET
- Retrieve all metrics or filter by category nameGET
- Create a new metricPOST
- Retrieve a specific metricGET
- Update a metricPUT
- Delete a metricDELETE
- Get all metric results for a specific metricGET
- Create a new metric result entry for the given metricPOST
- Retrieve a specific evaluation queryGET
- Update an evaluation queryPUT
- Delete an evaluation queryDELETE
- Get a specific query result with metricsGET
- Update a query resultPUT
- SharePoint
- SharePoint Connector
- Guardrails
- Conversation Starters
- Analytics
- Get Agent Cost Data
- Get Agent Document Count Data
- Get Agent Indexing Mode Data
- Get Agent Most Active Data
- Get Agent Query Count Data
- Get Recent Agent Data
- Get Agent Summary Statistics
- Get Agent Token Data
- Get Agent Vote Data
- Get Corpus Document Count Data
- Get Corpus Indexing Mode Data
- Get Cost Data
- Get Document Count Data
- Get Indexing Mode Data
- Get Project Cost Data
- Get Project Document Count Data
- Get Project Indexing Mode Data
- Get Project Most Active Data
- Get Project Query Count Data
- Get Recent Project Data
- Get Project Summary Statistics
- Get Project Token Data
- Get Project Vote Data
- Get Overall Summary Statistics
- Get Team Cost Data
- Get Team Document Count Data
- Get Team Indexing Mode Data
- Get Team Most Active Data
- Get Team Query Count Data
- Get Recent Team Data
- Get Team Summary Statistics
- Get Team Token Data
- Get Team Vote Data
- Get Total Entity Counts
- Get User Cost Data
- Get User Document Count Data
- Get User Indexing Mode Data
- Get User Most Active Data
- Get User Query Count Data
- Get Recent User Data
- Get User Summary Statistics
- Get User Token Data
- Get User Vote Data
- Get Vote Count Data
- Get Query Count Data
- Get Token Data
- Teammates
- Tools
- Feature Flags
- Get All Feature Flags
- Get Agent Alias Feature Flag
- Get Api Tools Feature Flag
- Get Chat Agent Creation Feature Flag
- Get dall_e Image Generation Feature Flag
- Get Developer Portal Feature Flag
- Get Guardrail Feature Flag
- Get PII Redaction Feature Flag
- Get Share Agent Feature Flag
- Get Sharepoint Index Feature Flag
- Get Youtube Index Feature Flag
- Users
- Notifications
- Projects
- Retrieve all Projects
- Create a Project
- Get a Project
- Update a Project
- Delete a Project
- Get Agent Responses using Project ID
- Add a Recent Project for a User
- Add Users to a Project
- Remove a User from a Project
- Get multiple Projects by their IDs
- Get Projects based on filters
- Get Recent Projects for a User
- Get Projects with Team Details
- Teams
- Organizations
- Get all Configurations
- Get active configuration for an Organization
- Get the Model Deployment for an Organization
- Get Organization Logo
- Get all Tools in an Organization
- Disable a Tool for all Agents in an Organization
- Enable a Tool for all Agents in an Organization
- Get all API Tool Templates
- Create a new API Tool Template
- Create a new API tool
- Create an attachment tool
- Create a new RAG tool in an Organization
- Create a Web Search Tool in an Organization
- Get all Users in an Organization
- Create a User in an Organization
- Get all Configurations of user's Organization
- Get all LLM configurations of the user's Organization
- Get a specific LLM configuration by ID
Create a new evaluation
POST
/api/v2/agents/{agent_id}/evaluations
Evaluationsv2
JSON object containing the evaluation details
JSON response with object containing created evaluation
Request Request Example
Shell
JavaScript
Java
Swift
curl --location --request POST '/api/v2/agents//evaluations' \
--header 'Content-Type: application/json' \
--data-raw '{
"agent_id": 0,
"dataset_ids": [
0
],
"metric_ids": [
0
],
"prefix_prompt": "string",
"model_deployment": "string",
"custom_instructions": {
"property1": null,
"property2": null
},
"source_enabled": false,
"evaluation_name": "string"
}'Response Response Example
201 - Success
{
"success": true,
"message": "Evaluation created successfully",
"data": {
"id": 213,
"agent": 3,
"final_scores": {},
"status": "pending",
"created_on": "2025-01-21T20:59:15.608Z"
}
}Request
Path Params
agent_id
integerÂ
required
Body Params application/json
agent_id
integerÂ
required
dataset_ids
array[integer]
required
metric_ids
array[integer]
required
prefix_prompt
stringÂ
optional
model_deployment
stringÂ
optional
custom_instructions
objectÂ
optional
Additional properties
integer  | number  | string  | booleanÂ
optional
source_enabled
booleanÂ
optional
Default:
false
evaluation_name
string  | nullÂ
optional
Examples
Responses
🟢201Created
application/json
Body
success
booleanÂ
required
message
stringÂ
required
data
array[object (EvaluationRun) {13}]Â
required
id
integerÂ
read-onlyrequired
agent
integerÂ
required
final_scores
objectÂ
read-onlyrequired
guardrail_results
objectÂ
read-onlyrequired
evaluation_name
stringÂ
required
total_query_count
integerÂ
read-onlyrequired
completed_query_count
integerÂ
read-onlyrequired
status
enum<string>Â
required
pending - Pendingrunning - Runningcompleted - CompletedAllowed values:
pendingrunningcompleted
created_on
string <date-time>
read-onlyrequired
created_by
stringÂ
required
<= 512 characters
modified_on
string <date-time>
read-onlyrequired
modified_by
stringÂ
required
<= 512 characters
evaluation_dataset_info
array
read-onlyrequired
🔴500Server Error