Amazon S3 Destination

Amazon S3 Destination Documentation

s3 logo

How to use the Amazon S3 Destination.

This destination syncs your data to an S3 bucket in real time. A file is written per event received. Files are written using the date and time when of insertion.

Connector guide.

Follow one of these next steps to allow MovingLake to connect to your bucket:

Set-up S3 Bucket

  1. Log-in to your AWS Account.
  2. Go to the IAM view.
  3. Generate new or get existing Access Key for a role which will have access to the bucket. See this link for more information.
  4. Make sure the user or role has the right policies to write to the S3 Bucket. See this link for more information.
  5. You will also need an S3 Bucket. See this link for more information.
  6. Finally take a note of your bucket’s region (e.g. us-east-1).

Create the connector

  1. With this information you can go now to your MovingLake account and create an S3 destination.
  2. Fill in all the blanks with the information from the steps above.
  3. Also configure optionally a subpath where the files will be written to.
  4. That’s it! You should be able to use this destination to receive events in the form of files in the bucket.