How to use the Redshift Destination.
This destination syncs your data to your Redshift instance in real time and in Relational Table format. Following the ELT way of loading data MovingLake will sync raw JSONs into tables with _raw suffixes. JSON tables are also appended with the time it the row was loaded as well as appending a unique identifier and a SHA-256 HASH of the raw JSON payload. These last two fields are quite important not just for locating rows but also when doing joins across related tables as it is not common for these to natively have an ID which relates them.
After syncing the raw JSONs, MovingLake automatically transforms the data into relational tables using our Automatic Transformer. These tables are named the same as the JSON tables but without the _raw suffix. Also one raw table might generate more than one transformed table.
Connector guide.
Follow the next steps to allow MovingLake to connect to your instance:
- Gather all of your instance data such as:
- Host URL
- Database Name
- Database Port
- Schema
- User Name
- User Password
- Head over to MovingLake, create a new Redshift credential using this data.
- That’s it! You are ready to use your Redshift destination.