hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "DuRuiling (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.
Date Fri, 22 Jan 2016 02:38:40 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111820#comment-15111820

DuRuiling commented on HDFS-9676:

Ok, I execute command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath >>
$logfile 2>&1”to catch possible error. I checked $logfile when I found $hdfsPath
is empty, but I found nothing. I think the return value of the command has already shown that
the command is executed successfully, actually it's failed.

> “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.
> ----------------------------------------------------------------------
>                 Key: HDFS-9676
>                 URL: https://issues.apache.org/jira/browse/HDFS-9676
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: auto-failover, datanode, hdfs-client
>    Affects Versions: 2.5.0
>         Environment: Linux version 3.0.101
> 2 namenode, 54 datanode
>            Reporter: DuRuiling
>            Assignee: DuRuiling
>   Original Estimate: 168h
>  Remaining Estimate: 168h
> I find the bug when I backup about 240T data from local file system to HDFS, I use command
“hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath” to backup each file one by one,
the return value of this command is 0, then illustrate the command execute right, I find file
path is right, but the size of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce
the bug when I backup data again.
> I write a bash shell to backup all data, according to the $? of the command to judge
the file is backup success and record a detailed log.

This message was sent by Atlassian JIRA

View raw message