RunDatabricksJob
Description
Triggers a pre-defined Databricks job to run with custom parameters. Job parameters can be set using dynamic properties
Tags
databricks, jobs
Properties
In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| Databricks Client * | Databricks Client | Controller Service: DatabricksWorkspaceClientService Implementations: StandardDatabricksWorkspaceClientService | Databricks Client Service. | |
| Wait for Job Completion * | Wait for Job Completion | true |
| Wait for the Databricks job to complete before transferring the FlowFile to success |
| Job Name | Job Name | Databricks Job Name | ||
| Job ID | Job ID | Databricks Job ID |
Dynamic Properties
This component does not support dynamic properties.
Relationships
| Name | Description |
|---|---|
| failure | Databricks failure relationship |
| success | Databricks success relationship |
Reads Attributes
This processor does not read attributes.
Writes Attributes
| Name | Description |
|---|---|
| error.code | The error code for the SQL statement if an error occurred. |
| error.message | The error message for the SQL statement if an error occurred. |
| job.result.state | The result state for the invoked job |
| job.run.id | The run id assigned to the invoked job |
State Management
This component does not store state.
Restricted
This component is not restricted.
Input Requirement
Input requirements are not specified for this component.
System Resource Considerations
This component does not specify system resource considerations.