hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2984) Distcp should have forrest documentation
Date Fri, 13 Jun 2008 23:01:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605001#action_12605001

Koji Noguchi commented on HADOOP-2984:


bq. It's also worth noting that if another client is still writing to a source file, the copy
will likely fail.

Maybe also mention, 
* if any source files are deleted after distcp has started, mappers would fail (with file
not  found).
* If speculative execution is turned on as 'final', behavior of distcp is undefined.

bq. It's worth giving some examples of -update and -overwrite. 

I always had trouble with these options.
Could you show how the target directory structures look like after the distcp?
(with and without -update/overwrite option)

> Distcp should have forrest documentation
> ----------------------------------------
>                 Key: HADOOP-2984
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2984
>             Project: Hadoop Core
>          Issue Type: Task
>          Components: util
>            Reporter: Owen O'Malley
>            Assignee: Chris Douglas
>            Priority: Blocker
>             Fix For: 0.18.0
>         Attachments: 2984-0.patch, 2984-1.patch, 2984-2.patch
> We really should have a page on how to use distcp.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message