hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjun Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure
Date Tue, 05 Jan 2016 17:24:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083400#comment-15083400

Yongjun Zhang commented on HDFS-9455:

Hi Guys,

Thanks for reporting the issue and the work here. [~daisuke.kobayashi], Per Archana's description
The command line is "hadoop distcp webhdfs://IP:25003/test/testfile webhdfs://IP:25003/myp"
in a secured cluster with ssl enabled (both src and tgt are the same cluster).
Would you please try it out in your env?

The "Invalid argument" msg is not very clear, when ssl is enabled, if we are using webhdfs
instead of swebhdfs, possibly we can improve the message to indicate that.


> In distcp, Invalid Argument Error thrown in case of filesystem operation failure
> --------------------------------------------------------------------------------
>                 Key: HDFS-9455
>                 URL: https://issues.apache.org/jira/browse/HDFS-9455
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: distcp, security
>            Reporter: Archana T
>            Assignee: Archana T
>            Priority: Minor
> When Filesystem Operation failure happens during discp, 
> Wrong exception : Invalid Argument thrown along with distcp command Usage.
> {color:red} 
> hadoop distcp webhdfs://IP:25003/test/testfile webhdfs://IP:25003/myp
> Invalid arguments: Unexpected end of file from server
> usage: distcp OPTIONS [source_path...] <target_path>
>               OPTIONS
>  -append                       Reuse existing data in target files and
>                                append new data to them if possible
>  -async                        Should distcp execution be blocking
>  -atomic                       Commit all changes or none
>  -bandwidth <arg>              Specify bandwidth per map in MB
>  -delete                       Delete from target, files missing in source
>  -diff <arg>                   Use snapshot diff report to identify the
>                                difference between source and target
>  -f <arg>                      List of files that need to be copied
>  -filelimit <arg>              (Deprecated!) Limit number of files copied
>                                to <= n
>  -i                            Ignore failures during copy
> .....
> {color} 
> Instead Proper Exception has to be thrown.

This message was sent by Atlassian JIRA

View raw message