hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liu (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-8088) Reduce the number of HTrace spans generated by HDFS reads
Date Thu, 09 Apr 2015 02:53:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486605#comment-14486605
] 

Yi Liu edited comment on HDFS-8088 at 4/9/15 2:53 AM:
------------------------------------------------------

Colin, thanks for working on this,  I have not gone through HDFS-8069, does it really degrade
the performance of DFSInputStream a lot?  If so, I think this is a block issue and let's make
it in ASAP.


was (Author: hitliuyi):
Colin, seems today is the deadline of 2.7 release? I have not gone through HDFS-8069, does
it really degrade the performance of DFSInputStream a lot?  If so, I think this is a block
issue and we should make this in today.
let me look at the patch now.

> Reduce the number of HTrace spans generated by HDFS reads
> ---------------------------------------------------------
>
>                 Key: HDFS-8088
>                 URL: https://issues.apache.org/jira/browse/HDFS-8088
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Colin Patrick McCabe
>            Assignee: Colin Patrick McCabe
>         Attachments: HDFS-8088.001.patch
>
>
> HDFS generates too many trace spans on read right now.  Every call to read() we make
generates its own span, which is not very practical for things like HBase or Accumulo that
do many such reads as part of a single operation.  Instead of tracing every call to read(),
we should only trace the cases where we refill the buffer inside a BlockReader.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message