hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1017) Compression and output splitting for Sqoop
Date Tue, 22 Sep 2009 00:31:16 GMT
Compression and output splitting for Sqoop
------------------------------------------

                 Key: MAPREDUCE-1017
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1017
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: contrib/sqoop
            Reporter: Aaron Kimball
            Assignee: Aaron Kimball


Sqoop "direct mode" writing will generate a single large text file in HDFS. It is important
to be able to compress this data before it reaches HDFS. Due to the difficulty in splitting
compressed files in HDFS for use by MapReduce jobs, data should also be split at compression
time.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message