Azure Blob Storage as a Target

This is a step-by-step tutorial for setting up Azure Blob Storage as a Target.

Prerequisites

• If you're new to Azure Blob Storage, start with the Microsoft documentation.

Create an Azure Blob Storage Account and Container

1. Follow the Microsoft documentation to create a Standard Azure Account.
   Please Note: Only Standard Azure accounts can use Azure Blob Storage Containers (Custom Filezones) with Rivery, Make sure to choose Standard in the Performance section.

   

2. Make sure all of the settings are correct before clicking Create. The creation of a Blob account may take a few minutes.

3. Click on Go to resource.
4. Choose Containers (Alternatively, scroll down the main menu to Blob Service and select Containers).

5. In the upper left corner, click on +Containers.
6. Give the container a Name.
7. From the Public access level drop-down menu, select Container.

8. Click Ok.

9. Go to Access Keys in the storage account menu.

10. Copy and save your keys.
    When connecting to Azure Blob Storage in Rivery, this will be used.

Setting Azure Blob Storage as a Target

1. Navigate to the Target tab in your Source to Target River.
2. Select Azure Blob Storage.
3. You will be automatically redirected to the connection form; for more information, see our documentation.
4. Enter you Bucket (Container ) Name.
5. Enter the FileZone path to your storage Container where Rivery will send the data files.
6. Set the period partition timeframe for a FileZone folder.
   Note: You can instruct Rivery to divide the data according to the data insertion day, the Day/Hour, or the Day/Hour/Minute. This means that Rivery will produce data files from your sources under folders that correspond to the correct partition you've selected.
7. Any Source to Target River can now send data to your Container.

Azure Blob Target – Parquet File Format Support

Overview

The Azure Blob target now supports writing data in Parquet file format as part of standard extraction workflows.

Key Features

• Parquet Format Support
  Data can now be extracted and written to Azure Blob Storage in the optimized, columnar Apache Parquet format.

• Standard Extraction Support
  This functionality is integrated into the standard extraction process and works seamlessly across all supported source connectors.

• Custom File Zone Path
  Users can define a custom file zone path when configuring the Azure Blob target, allowing greater flexibility in file organization and management.

Compatibility
This enhancement is available for all connectors currently supported for extraction to Azure Blob.