OneLake

Connection Settings

Endpoint URL

The endpoint URL for the Data Lake storage, found under the Storage Account Endpoints in Azure.

Connection String

The primary connection string of the Gen 2 Storage account, found under Security + Networking Access Keys in Azure.

Output Settings

File System Name

The name of the Gen 2 storage container to place the data. Supports dynamic references.

File Path

The file path to use to place the data. If no name is provided the blob name is a GUID and timestamp. This field supports dynamic references.

Source Type

Specifies where the file content comes from.

Option	Description
Payload	The traditional experience. File content comes from the pipeline payload.
Source File Path	File content is streamed directly from a path on the machine running Intelligence Hub, avoiding loading the entire file into memory at the same time.

Payload Reference

When working with complex payloads, this setting uses dynamic outputs to specify the attribute that contains the file payload (e.g. {{this.filePayload}}). Available when Source Type is set to Payload.

Note: If left blank, the entire payload is written out.

Source File Path

The path to the file on the machine running Intelligence Hub. The file is streamed directly to OneLake, avoiding loading the entire file into memory at the same time. Available when Source Type is set to Source File Path.

Prefix Path with UTC Time

When enabled a time prefix is added to the file path to logically separate files as yyyy/MM/dd/HH/key.