Skip to main content
Version: v5.1

Orchestrator Run

Note: The nsfilter (namespace filter) query parameter is mandatory for every request. It sets the context, helping you look up resources within that namespace. Example: GET /datasourcesvc/api/v1/orchrun?nsfilter=proj_DrZrSNrW

A maximum of 20 Orch runs can be created for a specific project if there are already Orch runs in the queued status.

Get Paginated Orchestrator Runs with Optional Filter(s)

Endpoints

GET /datasourcesvc/api/v1/orchrun

Request

Parameters

Path
ParameterTypeDescriptionRequiredDefault
_pageSizeNumberNumber of records to return in the pageOptional20
_offsetNumberNumber of records to offset or skip before the first document to return in the pageOptional0
_statusStringThe orchestrator run status you want to filter byOptional
startDateStringThe orchestrator run start date you want to filter byOptional
endDateStringThe orchestrator run end date you want to filter byOptional

Query

ParameterTypeDescriptionRequired
nsfilterStringProject namespaceRequired

Response

Type

JSON object

Codes

CodeDescription
200Success
500Internal Service error

Body example

{
"_offset": 0,
"_pageSize": 1,
"_total": 1,
"_list": [
{
"id": "b94f4ea3-447d-43a0-9d7f-345d46e11791",
"_orchid": "383f91dd-7d7f-41f6-b3dc-3c26c45d3c16",
"_name": "Test Instant Orch",
"_description": "Test Instant Orch",
"_namespaces": [
"AT_BEtqYlZ4"
],
"_usertype": "test_instant",
"_createdby": "77eee821-b0d4-44c4-b179-7b50ec9575c5",
"_createdat": "1675164393072",
"_updatedat": "1675164428003",
"_status": "COMPLETED",
"_result": "",
"orchrunsteps": [
{
"id": "1e533aed-81a0-45e9-8599-d867eda528a4",
"_name": "test_connector",
"orchstepid": "b4529482-053a-4402-ac57-f4bdd51b5ef9",
"_compid": "eced6368-2c1f-4186-acf0-3fa6e079e9a8",
"_orchrunid": "b94f4ea3-447d-43a0-9d7f-345d46e11791",
"_actualparams": "{}",
"_sequenceno": 1,
"_runparams": "{}",
"_status": "COMPLETED",
"_statusmsg": ""
}
]
}
]
}

Get an Orchestrator Run by ID

Endpoints

GET /datasourcesvc/api/v1/orchrun/{id}

Parameters

Path

ParameterTypeDescriptionRequired
idStringThe orchestrator run's idRequired

Query

ParameterTypeDescriptionRequired
nsfilterStringProject namespaceRequired

Response

Type

JSON object

Codes

CodeDescription
200Success
404File Not Found

Body example

[
{
"id": "13d44e84-a3ab-47a3-a375-46fdc5859522",
"_orchid": "b07990cf-c64d-4cc4-a0bc-02a4daf0510d",
"_name": "Test Instant Orch",
"_description": "Test Instant Orch",
"_namespaces": [
"test_bXgr468E"
],
"_usertype": "test_instant",
"_createdby": "cea475f0-7a61-4e06-8ab0-90777bcba2bf",
"_createdat": "1606885468249",
"_status": "COMPLETED",
"_result": "",
"orchrunsteps": [
{
"id": "ea7dc76e-1087-470d-9929-3fadb4204753",
"_name": "test_connector",
"orchstepid": "578a9663-8fc9-4c06-b70f-ad6be53d77ef",
"_compid": "eced6368-2c1f-4186-acf0-3fa6e079e9a8",
"_orchrunid": "13d44e84-a3ab-47a3-a375-46fdc5859522",
"_actualparams": "{}",
"_sequenceno": 1,
"_runparams": "{}",
"_status": "COMPLETED",
"_statusmsg": ""
}
]
}
]

Get an Orchestrator Run's Logs by ID

Endpoints

GET /datasourcesvc/api/v1/orchrun/logs/{id}

Parameters

Path

ParameterTypeDescriptionRequired
idStringThe OrchRun idRequired

Query

ParameterTypeDescriptionRequired
nsfilterStringProject namespaceRequired

Response

Codes

CodeDescription
200Success
404File Not Found

Response

Type

String

Body example

"{\"orchRunId\":\"8cec89dc-9074-46be-9065-9faade7ad091\",\"level\":\"info\",\"message\":\"Orch run execution has begun\",\"timestamp\":\"2023-09-08T07:50:31.330Z\"}\n
{\"level\":\"info\",\"message\":\"Running Orchestrator: test_connector in Node b4a149b9-6bc3-429e-bbcf-2661a1cdea98, orch_run_id: 8cec89dc-9074-46be-9065-9faade7ad091\",\"timestamp\":\"2023-09-08T07:50:31.331Z\"}\n
{\"level\":\"info\",\"message\":\"Node b4a149b9-6bc3-429e-bbcf-2661a1cdea98 Executing Step: Connector:test_connector, orch_run_id: 8cec89dc-9074-46be-9065-9faade7ad091\",\"timestamp\":\"2023-09-08T07:50:31.854Z\"}\n
{\"level\":\"info\",\"message\":\"Test Connector, orch_run_id: 8cec89dc-9074-46be-9065-9faade7ad091\",\"timestamp\":\"2023-09-08T07:50:31.857Z\"}\n
{\"level\":\"info\",\"message\":\"Executing TestConnector - Connectors with version 1, orch_run_id: 8cec89dc-9074-46be-9065-9faade7ad091\",\"timestamp\":\"2023-09-08T07:50:31.858Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:50:37.881Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:50:43.879Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:50:49.881Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:50:55.882Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:51:01.885Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:51:07.885Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:51:13.888Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:51:19.889Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop in progress\",\"timestamp\":\"2023-09-08T07:51:25.889Z\"}\n
{\"level\":\"info\",\"message\":\"TestConnector_v1: Dummy loop has ended\",\"timestamp\":\"2023-09-08T07:51:31.889Z\"}\n
{\"level\":\"info\",\"message\":\"[\\\"Step: Connector:test_connector took ->60.56\\\"]\",\"timestamp\":\"2023-09-08T07:51:31.894Z\"}\n
{\"level\":\"info\",\"message\":\"Orchestrator test_connector Execution Duration in project auto8080_CzMQc82u is: 60.56, orch_run_id: 8cec89dc-9074-46be-9065-9faade7ad091\",\"timestamp\":\"2023-09-08T07:51:31.894Z\"}\n
{\"level\":\"info\",\"message\":\"Updating orch run status to 4 in OrchExecutionService, orch_run_id: 8cec89dc-9074-46be-9065-9faade7ad091\",\"timestamp\":\"2023-09-08T07:51:31.896Z\"}\n
{\"end\":true,\"level\":\"info\",\"message\":\"Orch run has ended. Closing up file log stream\",\"timestamp\":\"2023-09-08T07:51:32.912Z\"}\n"

Create Orchestrator Run

Endpoints

POST /datasourcesvc/api/v1/orchrun

Parameters

Query

ParameterTypeDescriptionRequired
nsfilterStringProject namespaceRequired

Body

ParameterTypeDescriptionRequired
orchestratorIdStringThe orchestrator's idRequired
_actualParamsArray of ObjectArray of actual parameter objectsRequired
_actualParams.sequence_type_idStringThe sequence type idRequired
_actualParams.paramsObjectAn object that contains the actual parameters and their idsRequired
Example
{
"orchestratorId": "b07990cf-c64d-4cc4-a0bc-02a4daf0510d",
"_actualparams": [
{
"sequence_type_id": "9a616686-571e-4167-8a70-d180dcd585a9",
"params": {
"_fileId": "cb8d42b2-60ec-46e7-a27e-634f092cfddf",
"_fileVersionId": "902aa32c-de61-4240-8f54-700de626498b"
}
}
]
}

Response

Type

JSON object

Codes

CodeDescription
200Success
400Bad Request

Body example

{
"id": "13d44e84-a3ab-47a3-a375-46fdc5859522",
"_orchid": "b07990cf-c64d-4cc4-a0bc-02a4daf0510d",
"_name": "Test Instant Orch",
"_description": "Test Instant Orch",
"_namespaces": [
"test_bXgr468E"
],
"_usertype": "test_instant",
"_createdby": "cea475f0-7a61-4e06-8ab0-90777bcba2bf",
"_createdat": 1606885468249,
"_status": "QUEUED",
"_result": "",
"orchrunsteps": [
{
"id": "ea7dc76e-1087-470d-9929-3fadb4204753",
"_name": "test_connector",
"orchstepid": "578a9663-8fc9-4c06-b70f-ad6be53d77ef",
"_compid": "eced6368-2c1f-4186-acf0-3fa6e079e9a8",
"_orchrunid": "13d44e84-a3ab-47a3-a375-46fdc5859522",
"_actualparams": "{}",
"_sequenceno": 1,
"_runparams": {},
"_status": "QUEUED"
}
]
}

Edit an Orchestrator Run

Endpoints

PUT /datasourcesvc/api/v1/orchrun/{id}

Parameters

Path

ParameterTypeDescriptionRequired
idStringThe orchestrator's id.Required

Query

ParameterTypeDescriptionRequired
nsfilterStringProject namespaceRequired

Body

ParameterTypeDescriptionRequired
idStringThe orchestrator's id.Required
Example
{
"id": "73bde773-6ef8-41af-aa89-67c91e6ff683"
}

Response

Codes

CodeDescription
200Success
400Bad Request
404File or Version Not Found

Body example

[
{
"id": "73bde773-6ef8-41af-aa89-67c91e6ff683",
"_orchid": "b07990cf-c64d-4cc4-a0bc-02a4daf0510d",
"_name": "Test Instant Orch",
"_description": "Test Instant Orch",
"_namespaces": [
"test_bXgr468E"
],
"_usertype": "test_instant",
"_createdby": "cea475f0-7a61-4e06-8ab0-90777bcba2bf",
"_createdat": "1606978503963",
"_status": "REQUEST_CANCEL",
"_result": "",
"orchrunsteps": []
}
]

Delete an Orchestrator Run

Endpoints

DELETE /datasourcesvc/api/v1/orchrun/{id}

Parameters

Path

ParameterTypeDescriptionRequired
idStringThe orchestrator's idRequired

Query

ParameterTypeDescriptionRequired
nsfilterStringProject namespaceRequired

Response

Codes

CodeDescription
204No Content
404File Not Found

Response

None