htrace-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lewis John Mcgibbney <>
Subject Re: state of the htrace
Date Wed, 03 Feb 2016 02:05:34 GMT
Hi Colin,
Really cool. I was in Pasadena and sadly missed you and your presentation.
Maybe next time, please post here if you are presenting on HTrace again.
I wonder if anyone is planning on taking HTrace talks to ApacheCon?

On Tue, Feb 2, 2016 at 4:51 PM, <
> wrote:

> Subject: state of the htrace
> Hi all,
> Happy (belated) New Year.  I've been a bit quiet since I went on
> vacation for a few weeks recently, and since I have some other
> projects going on.  But today I wanted to highlight some really cool
> stuff that's been happening in the HTrace and broader tracing
> community recently.
> Last weekend, I gave an "intro to htrace" talk this weekend at the
> Scale 14x Linux conference.  See
> .  Also there is a video here:
>  It starts at 6:50, since
> the first few minutes of the recording are just me setting up the VGA
> connection and microphone :P  I thought this one went really well
> (especially the demo), and hopefully will get the word out to even
> more people.
> In HDFS, we've been exploring adding annotations to certain trace
> spans to collect even more useful information.  For example, Zhe Zhang
> posted a patch to HDFS-9576 to add "position" and "length" annotations
> to DFSInputStream#byteArrayRead, etc. spans.  This should give us data
> on things like the average and median read length in a set of HDFS
> requests.  Similarly, I posted HDFS-9674 which adds the "maximum write
> latency" to OpWriteBlock spans generated by the DataNode.  This is
> very handy when analyzing HDFS write pipelines.  I think we will see
> more of these really helpful annotations, and they will expand our
> ideas about what HTrace can do.
> A few weeks back, I wrote a blog post for my employer, Cloudera.  It
> talks about setting up HTrace and htraced on a CDH5.5 cluster.  See
>  Hopefully HTrace can "bridge the chasm" between being a developer
> tool, and being a trusted ops tool.  We have some ways to go, but
> having these precompiled packages for CDH5.5 is a big step forward.
> (OK, I'll shut up about vendor stuff now...)
> Another really cool thing is that Sean Busbey and others in the YCSB
> community are working on integrating HTrace.  YCSB is a very popular
> benchmark for big data / Hadoopy workloads.  The github issue is here:
> cheers,
> Colin

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message