MoveAzureDataLakeStorage
Description
Moves content within an Azure Data Lake Storage Gen 2. After the move, files will be no longer available on source location.
Tags
adlsgen2, azure, cloud, datalake, microsoft, storage
Properties
In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| ADLS Credentials * | adls-credentials-service | Controller Service: ADLSCredentialsService Implementations: ADLSCredentialsControllerServiceLookup ADLSCredentialsControllerService | Controller Service used to obtain Azure Credentials. | |
| Source Filesystem * | source-filesystem-name | ${azure.filesystem} | Name of the Azure Storage File System from where the move should happen. Supports Expression Language, using FlowFile attributes and Environment variables. | |
| Source Directory * | source-directory-name | ${azure.directory} | Name of the Azure Storage Directory from where the move should happen. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value. Supports Expression Language, using FlowFile attributes and Environment variables. | |
| Destination Filesystem * | filesystem-name | Name of the Azure Storage File System where the files will be moved. Supports Expression Language, using FlowFile attributes and Environment variables. | ||
| Destination Directory * | directory-name | Name of the Azure Storage Directory where the files will be moved. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value. Non-existing directories will be created. If the original directory structure should be kept, the full directory path needs to be provided after the destination directory. e.g.: destdir/${azure.directory} Supports Expression Language, using FlowFile attributes and Environment variables. | ||
| File Name * | file-name | ${azure.filename} | The filename Supports Expression Language, using FlowFile attributes and Environment variables. | |
| Conflict Resolution Strategy * | conflict-resolution-strategy | fail |
| Indicates what should happen when a file with the same name already exists in the output directory |
| Proxy Configuration Service | proxy-configuration-service | Controller Service: ProxyConfigurationService Implementations: StandardProxyConfigurationService | Specifies the Proxy Configuration Controller Service to proxy network requests. Supported proxies: SOCKS, HTTP In case of SOCKS, it is not guaranteed that the selected SOCKS Version will be used by the processor. |
Dynamic Properties
This component does not support dynamic properties.
Relationships
| Name | Description |
|---|---|
| failure | Files that could not be written to Azure storage for some reason are transferred to this relationship |
| success | Files that have been successfully written to Azure storage are transferred to this relationship |
Reads Attributes
This processor does not read attributes.
Writes Attributes
| Name | Description |
|---|---|
| azure.directory | The name of the Azure Directory |
| azure.filename | The name of the Azure File |
| azure.filesystem | The name of the Azure File System |
| azure.length | The length of the Azure File |
| azure.primaryUri | Primary location for file content |
| azure.source.directory | The name of the source Azure Directory |
| azure.source.filesystem | The name of the source Azure File System |
State Management
This component does not store state.
Restricted
This component is not restricted.
Input Requirement
This component requires an incoming relationship.
System Resource Considerations
This component does not specify system resource considerations.
See Also
DeleteAzureDataLakeStorage, FetchAzureDataLakeStorage, ListAzureDataLakeStorage