A data sync run of DataConnector
. After DataConnector
is successfully initialized, data syncs are scheduled at DataConnector.refresh_interval
. A ConnectorRun
represents a data sync either in the past or onging that the moment. //
JSON representation |
---|
{ "name" : string , "startTime" : string , "endTime" : string , "state" : enum ( |
Fields | |
---|---|
name
|
Output only. The full resource name of the Connector Run. Format: |
startTime
|
Output only. The time when the connector run started. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
endTime
|
Output only. The time when the connector run ended. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
state
|
Output only. The state of the sync run. |
errors[]
|
Contains info about errors incurred during the sync. Only exist if running into an error state. Contains error code and error message. Use with the |
stateUpdateTime
|
timestamp at which the connector run sync state was last updated. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
latestPauseTime
|
Output only. The time when the connector run was most recently paused. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
entityRuns[]
|
Output only. The details of the entities synced at the ConnectorRun. Each ConnectorRun consists of syncing one or more entities. |
trigger
|
Output only. The trigger for this |
State
The state of run.
Enums | |
---|---|
STATE_UNSPECIFIED
|
Default value. |
RUNNING
|
The data sync is ongoing. |
SUCCEEDED
|
The data sync is finished. |
FAILED
|
The data sync is failed. |
OVERRUN
|
data sync has been running longer than expected and is still running at the time the next run is supposed to start. |
CANCELLED
|
data sync was scheduled but has been cancelled. |
PENDING
|
data sync is about to start. |
WARNING
|
The data sync completed with non-fatal errors. |
SKIPPED
|
An ongoing connector run has been running longer than expected, causing this run to be skipped. |
EntityRun
Represents an entity that was synced in this ConnectorRun
.
JSON representation |
---|
{ "entityName" : string , "state" : enum ( |
Fields | |
---|---|
entityName
|
The name of the source entity. |
state
|
The state of the entity's sync run. |
errors[]
|
The errors from the entity's sync run. Only exist if running into an error state. Contains error code and error message. |
stateUpdateTime
|
timestamp at which the entity sync state was last updated. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
progress
|
metadata to generate the progress bar. |
statsUpdateTime
|
The timestamp for either extracted_documents_count, indexed_documents_count and error_documents_count was last updated. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
syncType
|
Sync type of this run. |
scheduledRecordCount
|
Optional. The number of documents scheduled to be crawled/extracted from connector source. This only applies to third party connectors. |
extractedRecordCount
|
Optional. The number of documents extracted from connector source, ready to be ingested to VAIS. |
indexedRecordCount
|
Optional. The number of documents indexed. |
errorRecordCount
|
Optional. The total number of documents failed at sync at indexing stage. |
sourceApiRequestCount
|
Optional. The number of requests sent to 3p API. |
deletedRecordCount
|
Optional. The number of documents deleted. |
Progress
Represents the progress of a sync run.
JSON representation |
---|
{ "currentCount" : string , "totalCount" : string , "percentile" : number } |
Fields | |
---|---|
currentCount
|
The current progress. |
totalCount
|
The total. |
percentile
|
Derived. The percentile of the progress.current_count / totalCount. The value is between [0, 1.0] inclusive. |
SyncType
data synchronization type of the connector.
Enums | |
---|---|
SYNC_TYPE_UNSPECIFIED
|
Sync type unspecified. |
FULL
|
Sync triggers full sync of all documents. |
INCREMENTAL
|
Incremental sync of updated documents. |
REALTIME
|
Realtime sync. |
SCALA_SYNC
|
Scala sync. |
Trigger
Triggering reasons for ConnectorRun
.
Enums | |
---|---|
TRIGGER_UNSPECIFIED
|
Default value. |
SCHEDULER
|
ConnectorRun triggered by scheduler if connector has PERIODIC sync mode. |
INITIALIZATION
|
ConnectorRun auto triggered by connector initialization. |
RESUME
|
ConnectorRun auto triggered by resuming connector. |
MANUAL
|
ConnectorRun triggered by user manually. |