apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chaitanya (JIRA)" <j...@apache.org>
Subject [jira] [Created] (APEXMALHAR-2416) Development of Redshift Output Module
Date Tue, 21 Feb 2017 06:55:44 GMT
Chaitanya created APEXMALHAR-2416:
-------------------------------------

             Summary: Development of Redshift Output Module
                 Key: APEXMALHAR-2416
                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2416
             Project: Apache Apex Malhar
          Issue Type: Task
            Reporter: Chaitanya
            Assignee: Chaitanya


Primary functionality of this module is load data into Redshift tables from data files using
copy command. Refer the below link about the copy command:
http://docs.aws.amazon.com/redshift/latest/dg/r_COPY.html

Input type to this module is byte[].

Design of this Module:
1) Write the tuples into EMR/S3. By default, it writes to S3.
2) Once the file is rolled, upload the file into Redshift using copy command.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message