hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daisuke Kobayashi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure
Date Tue, 05 Jan 2016 06:56:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082528#comment-15082528

Daisuke Kobayashi commented on HDFS-9455:

Thanks. Hmm, with which scenario does it occur? I've just tried to reproduce the issue with
the scenarios, but couldn't...
- target NameNode to be down
- target NameNode to be safemode
- wrong hostname to target NameNode
- wrong path to target 

In which version of Hadoop are you using, [~archanat]? Mine is as follows:

# hadoop version
Hadoop 2.6.0-cdh5.5.1

> In distcp, Invalid Argument Error thrown in case of filesystem operation failure
> --------------------------------------------------------------------------------
>                 Key: HDFS-9455
>                 URL: https://issues.apache.org/jira/browse/HDFS-9455
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: distcp
>            Reporter: Archana T
>            Assignee: Archana T
>            Priority: Minor
> When Filesystem Operation failure happens during discp, 
> Wrong exception : Invalid Argument thrown along with distcp command Usage.
> {color:red} 
> hadoop distcp webhdfs://IP:25003/test/testfile webhdfs://IP:25003/myp
> Invalid arguments: Unexpected end of file from server
> usage: distcp OPTIONS [source_path...] <target_path>
>               OPTIONS
>  -append                       Reuse existing data in target files and
>                                append new data to them if possible
>  -async                        Should distcp execution be blocking
>  -atomic                       Commit all changes or none
>  -bandwidth <arg>              Specify bandwidth per map in MB
>  -delete                       Delete from target, files missing in source
>  -diff <arg>                   Use snapshot diff report to identify the
>                                difference between source and target
>  -f <arg>                      List of files that need to be copied
>  -filelimit <arg>              (Deprecated!) Limit number of files copied
>                                to <= n
>  -i                            Ignore failures during copy
> .....
> {color} 
> Instead Proper Exception has to be thrown.

This message was sent by Atlassian JIRA

View raw message