hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ranadip (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-9188) FileUtil.CopyMerge can support optional headers and footers when merging files
Date Tue, 08 Jan 2013 11:18:12 GMT
Ranadip created HADOOP-9188:
-------------------------------

             Summary: FileUtil.CopyMerge can support optional headers and footers when merging
files
                 Key: HADOOP-9188
                 URL: https://issues.apache.org/jira/browse/HADOOP-9188
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Ranadip


Similar to addString - which is added at the end of each merged file - there should be the
option to add some rows of header strings and footer strings globally at the beginning and
end of the single merged file.


Background: My experience has been that this method is mostly used to aggregate part-files
into a single file that can be sent, for example, as a data feed file or a report to business
customers. In such cases there is often a requirement to provide header and footer rows -
with headers describing the schema of the data and the footers (or even headers in some cases)
containing stats like total counts, bad record counts, etc. Along with [#HADOOP-9187], I have
found myself replicating this method to add these features at least in 3 different use cases.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message