hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Templeton (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6734) Add option to distcp to preserve file path structure of source files at the destination
Date Wed, 07 Dec 2016 23:41:58 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730316#comment-15730316
] 

Daniel Templeton commented on MAPREDUCE-6734:
---------------------------------------------

Thanks, [~fctucker], for the patch.  I'm taking a look at it now.  In the meantime, can we
drop this to Important?

> Add option to distcp to preserve file path structure of source files at the destination
> ---------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6734
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6734
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: distcp
>    Affects Versions: 3.0.0-alpha2
>         Environment: Software platform
>            Reporter: Frederick Tucker
>            Priority: Critical
>              Labels: distcp, newbie, patch
>             Fix For: 3.0.0-alpha2
>
>         Attachments: MAPREDUCE-6734.3.0.0-alpha2.patch, MAPREDUCE-6734.3.0.0-alpha2.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> When copying files using distcp with globbed source files, all the matched files in the
glob are copied in a single flat directory.  This causes problems when the file structure
at the source is important.  It also is an issue when there are two files matched in the glob
with the same name because it causes a duplicate file error at the target.  I'd like to have
an option to preserve the file structure of the source files when globbing inputs.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message