hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang Xie (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-6110) adding more slow action log in critical write path
Date Tue, 18 Mar 2014 06:03:44 GMT

     [ https://issues.apache.org/jira/browse/HDFS-6110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Liang Xie updated HDFS-6110:
----------------------------

    Attachment: HDFS-6110.txt

Here is the patch, extracted from my code, it's pretty simple, but extremely useful for my
investigation on HBase write outlier these days:) [~saint.ack@gmail.com]

DFSOutputStream was modified as well, then a HBase ops could be alerted by warning log easier.

> adding more slow action log in critical write path
> --------------------------------------------------
>
>                 Key: HDFS-6110
>                 URL: https://issues.apache.org/jira/browse/HDFS-6110
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 3.0.0, 2.3.0
>            Reporter: Liang Xie
>            Assignee: Liang Xie
>         Attachments: HDFS-6110.txt
>
>
> After digging a HBase write spike issue caused by slow buffer io in our cluster, just
realize we'd better to add more abnormal latency warning log in write flow, such that if other
guys hit HLog sync spike, we could know more detail info from HDFS side at the same time.
> Patch will be uploaded soon.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message