RVR-DTF-500

1. Issue Summary

   • The error "General error while trying to copy parquet to Redshift" with Error Code: RVR-DTF-500 occurs during a data transfer process in Rivery from Parquet files to Amazon Redshift. This problem usually arises due to configuration issues, permissions problems, or data format inconsistencies between the Parquet files and Redshift's expected input.

2. Action Steps:

   • Check Permissions: Ensure that the IAM role associated with Rivery has the necessary permissions to access both the source (S3) and target (Redshift) services. This includes permissions for reading Parquet files from S3 and writing them to Redshift.

   • Validate Data Format: Verify that the Parquet file format is compatible with Redshift. Ensure that the schema and data types in Parquet are supported by Redshift according to AWS documentation on supported data types in Redshift.

   • Configure Redshift Correctly: Make sure that the Redshift cluster is properly configured to accept the data. Check that the table and schema being targeted exist and that the Redshift COPY command is correctly configured in the Rivery process.

   • Inspect Rivery Setup: Confirm that the data pipeline in Rivery is set up to handle Parquet files. This includes checking the settings under the 'Target' configuration to ensure all selections correspond to Redshift's requirements.

   • Review Error Details: Look at any additional logs or error details provided by Rivery during the transfer, which could indicate more specifically where the problem is occurring.

3. External References:

   • For more information on configuring Amazon Redshift as a target in Rivery, you can consult the Rivery documentation: Amazon Redshift as a Target Connection
   • For details on Parquet file compatibility and configurations: AWS Redshift Supported Data Types
   • General guidance on permissions for cross-service data movement: AWS Identity and Access Management (IAM) Documentation

If the issue persists or you need further assistance, please open a ticket with Rivery support.