Setting up a Custom Filezone in Amazon Redshift as a Target

This is a step-by-step tutorial to setting up a custom FileZone in Amazon Redshift.

Overview

Rivery allows you to create a custom FileZone to manage your data in your own S3 service. For up to 24 hours, your data will be stored in your bucket. A bucket is a container that holds objects. An object is a file and any metadata that describes that file.

Prerequisites

• If you're new to Amazon S3 buckets, start with the S3 documentation.
• Create a bucket and connect to Amazon S3.

S3 Bucket, Policy, and Rivery User in AWS:

To enable Rivery to load source data into Redshift, you must create an S3 bucket, configure a bucket policy, and set up a Rivery user in the Amazon Platform Console. These are the essential requirements for the setup.

S3 Bucket

A bucket is an object container. To store data in Amazon S3, you must first create a bucket and specify a bucket name as well as an AWS Region. Then you upload your data as objects to that bucket in Amazon S3. Each object has a key (or key name) that serves as the object's unique identifier within the bucket.
Let's begin by logging into AWS and searching for Buckets:

Note:
This is a tour of the console. Please hover over the rippling dots and read the notes attached to follow through.
For a fullscreen view, click the green dot in the upper left corner.

Policy

A bucket policy is a resource-based policy that allows you to grant access permissions to your bucket and the objects contained within it.
Now that you've created a bucket, let's create a policy to grant the necessary permissions:

<br>

Here's the policy's code:

```text
{
 "Version":"2012-10-17",
 "Statement":[
   {
    "Sid":"RiveryManageFZBucket",
    "Effect":"Allow",
    "Action":[
    "s3:GetBucketCORS",
    "s3:ListBucket",
    "s3:GetBucketLocation"
     ],
    "Resource":"arn:aws:s3:::<RiveryFileZoneBucket>"
   },
   {
    "Sid":"RiveryManageFZObjects",
    "Effect":"Allow",
    "Action":[
      "s3:ReplicateObject",
      "s3:PutObject",
      "s3:GetObjectAcl",
      "s3:GetObject",
      "s3:PutObjectVersionAcl",
      "s3:PutObjectAcl",
      "s3:ListMultipartUploadParts"],
    "Resource":"arn:aws:s3:::<RiveryFileZoneBucket>/*"
  },
  {
     "Sid":"RiveryHeadBucketsAndGetLists",
     "Effect":"Allow",
     "Action":"s3:ListAllMyBuckets",
     "Resource":"*"
  }
 ]
}
```

Rivery User in AWS

Now, in order to connect to the Amazon S3 Source and Target (described in the following section) in Rivery console, you must first create an AWS Rivery user:

Rivery's S3 Connection

Follow our Amazon S3 connection tutorial by scrolling down to Connection Procedure section.

Connection Procedure

In the connection form when setting Amazon Redshift as the target, proceed with the following steps:

1. Type in the Connection Name.
2. Enter your Host name.
3. Fill in your Port.
4. Enter your Username and Password.
5. In the "File Zone Connection" section, make sure to choose the S3 connection that was previously established, and then select the associated S3 Bucket.
6. Use the Test Connection function to see if your connection is up to the task.
7. If the connection succeeded, you can now use this connection in Rivery.