Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Fri, 2 Jun 2017 17:33:04 +0000 (UTC)
From: "Wei-Chiu Chuang (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.13076753.1496388276000.354112.1496424784201@Atlassian.JIRA>
In-Reply-To: <JIRA.13076753.1496388276000@Atlassian.JIRA>
References: <JIRA.13076753.1496388276000@Atlassian.JIRA> <JIRA.13076753.1496388276655@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage
 transfer failure.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Fri, 02 Jun 2017 17:33:09 -0000


    [ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035093#comment-16035093 ] 

Wei-Chiu Chuang commented on HDFS-11914:
----------------------------------------

Hi [~yzhangal]
I reviewed the patch and mostly good. I suggest improve the readability of the log a little bit:
in {{copyFileToStream}}:
"Connection closed by client. Sent total=". add " bytes." at the end.
" Size of last segment possibly sent=" can be rephrased as " Size of last segment intended to send="

Could you also explain why use String.valueOf() to print fsImageName, a String?

Thanks!

> Add more diagnosis info for fsimage transfer failure.
> -----------------------------------------------------
>
>                 Key: HDFS-11914
>                 URL: https://issues.apache.org/jira/browse/HDFS-11914
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Yongjun Zhang
>            Assignee: Yongjun Zhang
>              Labels: supportability
>         Attachments: HDFS-11914.001.patch, HDFS-11914.002.patch
>
>
> Hit a fsimage download problem:
> Client tries to download fsimage, and got:
>  WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:SIMPLE) cause:java.io.IOException: File http://x.y.z:50070/imagetransfer?getimage=1&txid=latest received length xyz is not of the advertised size abc.
> Basically client does not get enough fsimage data and finished prematurely without any exception thrown, until it finds the size of data received is smaller than expected. The client then closed the conenction to NN, that caused NN to report
> INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Connection closed by client
> This jira is to add some more information in logs to help debugging the sitaution. Specifically, report the stack trace when the connection is closed. And how much data has been sent at that point. etc.
>  


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org