hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8060) org.apache.hadoop.fs.FileUtil.copyMerge should merge all files in recursive sub directories
Date Fri, 03 Apr 2015 15:45:54 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394591#comment-14394591
] 

Chris Nauroth commented on HDFS-8060:
-------------------------------------

Hello, [~kachau].  Thank you for filing the issue, and welcome to the community!  You can
find more details on how the contribution process works here:

https://wiki.apache.org/hadoop/HowToContribute

In HADOOP-11661, I proposed deprecating and eventually removing {{FileUtil#copyMerge}}.  It
is currently unused within the Hadoop source tree, and the only downstream project reference
to it I've found so far is one call site in Mahout.

Can you post more details on how you're using this method?  Is this a custom application you
wrote that calls {{FileUtil#copyMerge}} directly?

> org.apache.hadoop.fs.FileUtil.copyMerge should merge all files in recursive sub directories
> -------------------------------------------------------------------------------------------
>
>                 Key: HDFS-8060
>                 URL: https://issues.apache.org/jira/browse/HDFS-8060
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Umesh Kacha
>
> org.apache.hadoop.fs.FileUtil.copyMerge does not find all the files recursively in sub
directories. I am ready to push the code for the same. This is my first JIRA so dont know
much the process. Please validate I feel this feature is very helpful. Since copyMerge does
not support recursive finding in sub directories I need to copy files from thousands of directories
first and then move into one directory and give that directory to copyMerge.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message