sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jarek Cecho" <jar...@apache.org>
Subject Review Request: SQOOP-721 Duplicating rows on export when exporting from compressed files.
Date Fri, 23 Nov 2012 18:59:10 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/8195/
-----------------------------------------------------------

Review request for Sqoop.


Description
-------

I've ported newest implementation of CombineFileInputFormat from Hadoop 2.0.2-alpha.


This addresses bug SQOOP-721.
    https://issues.apache.org/jira/browse/SQOOP-721


Diffs
-----

  src/java/org/apache/sqoop/mapreduce/CombineFileInputFormat.java 4f58d7d89cfc2827f9f50e169751cc3cdaf52308

  src/java/org/apache/sqoop/mapreduce/CombineFileRecordReader.java 6f9864b8bcfb28121dc432e62197f259650eceb0

  src/java/org/apache/sqoop/mapreduce/CombineFileSplit.java 8cf4d54cc3a2e77de37734bf4f687f31c32b6e85


Diff: https://reviews.apache.org/r/8195/diff/


Testing
-------

I've done extensive testing on Hadoop 1.x, 2.x and 0.20.


Thanks,

Jarek Cecho


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message