Setting up a Custom Filezone in Amazon S3
  • 2 Minutes to read
  • Dark
    Light
  • PDF

Setting up a Custom Filezone in Amazon S3

  • Dark
    Light
  • PDF

This is a step-by-step tutorial to setting up a custom FileZone in Amazon S3.

Overview

Setting up a Custom File Zone in Rivery is an optional feature, with the default option relying on the Managed File Zone provided by the platform, which requires no setup.
The main advantage of setting up a Custom File Zone is the ability for organizations to ensure that data is stored within their own file zones, as opposed to being stored in Rivery's Managed File Zone. This also enables organizations to use the Custom File Zone as a data lake, where raw data can be stored before it is loaded into a Target cloud data warehouse. Furthermore, organizations have the ability to define their own retention policies for data stored in the Custom File Zone. Rivery's Managed File Zone (default) retains data for a period of 48 hours.


Prerequisites

If you're new to Amazon S3 buckets, start with the S3 documentation.


Create Your S3 Bucket

  1. Sign in to the AWS Management Console and open the Amazon S3 console

  2. Click the Create Bucket button.

  3. Fill in a Bucket name.
    The bucket's name must include:

  • Be unique across all of Amazon S3.
  • The length should be between 3 and 63 characters.
  • Uppercase characters are not allowed.
  • Begin with a lowercase letter or a numerical value.

Note:
You can't change the bucket's name once it's been created. See Bucket Naming Rules for more information on bucket naming.

  1. Choose an AWS Region , the same region where your S3 resides.

Note:
To reduce latency and costs while meeting regulatory requirements, choose a Region close to you.

  1. Select Next.
    image.png

  2. Choose your preferred settings by following the on-screen instructions on the console.

  3. Click Create Bucket.

Upload an object to your bucket

Follow the Amazon S3 documentation to upload an object to your newly created bucket.

Download an Object

To download an object from your bucket, refer to the Amazon S3 documentation.



Create a User Policy

To use the bucket you just created, you must configure a User Policy with the specific bucket in Amazon Platform Console. To do so, follow the steps below:

  1. Go to Identity Access Managment (IAM) in the AWS Console.
  2. Select Policies.

image.png

  1. In the upper left corner of the screen, click the Create Policy button.

  2. Navigate to the JSON tab.

image.png

  1. Copy and paste the following policy:
    Note:
    Replace <RiveryFileZoneBucket> with the name of the S3 bucket you created earlier.
{
 "Version":"2012-10-17",
 "Statement":[
   {
    "Sid":"RiveryManageFZBucket",
    "Effect":"Allow",
    "Action":[
    "s3:GetBucketCORS",
    "s3:ListBucket",
    "s3:GetBucketLocation"
     ],
    "Resource":"arn:aws:s3:::<RiveryFileZoneBucket>"
   },
   {
    "Sid":"RiveryManageFZObjects",
    "Effect":"Allow",
    "Action":[
      "s3:ReplicateObject",
      "s3:PutObject",
      "s3:GetObjectAcl",
      "s3:GetObject",
      "s3:PutObjectVersionAcl",
      "s3:PutObjectAcl",
      "s3:ListMultipartUploadParts"],
    "Resource":"arn:aws:s3:::<RiveryFileZoneBucket>/*"
  },
  {
     "Sid":"RiveryHeadBucketsAndGetLists",
     "Effect":"Allow",
     "Action":"s3:ListAllMyBuckets",
     "Resource":"*"
  }
 ]
}
  1. Select Review Policy.

  2. Give the Policy a name and click Create Policy.


Was this article helpful?