hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10822) Log DataNodes in the write pipeline
Date Wed, 31 Aug 2016 20:17:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453244#comment-15453244

Kihwal Lee commented on HDFS-10822:

bq. Trying to diagnose a slow HDFS flush, taking longer than 10 second...
It might not be relevant in your case, but we've seen a lot of such problems with 2.6, which
mostly disappeared after applying HDFS-8791 internally.

In any case, adding the debug log line seems reasonable.

> Log DataNodes in the write pipeline
> -----------------------------------
>                 Key: HDFS-10822
>                 URL: https://issues.apache.org/jira/browse/HDFS-10822
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs-client
>    Affects Versions: 2.6.0
>            Reporter: John Zhuge
>            Assignee: John Zhuge
>            Priority: Trivial
>              Labels: supportability
> Trying to diagnose a slow HDFS flush, taking longer than 10 seconds, but did not know
which DNs were involved in the write pipeline. Of course, I could search NN log for the list
of DNs, but it might not be possible sometimes or convenient.
> Propose to add a DEBUG trace to DataStreamer#setPipeline to print the list of DNs in
the pipeline.
> BTW, we do print the list of DNs during pipeline recovery.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message