Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: jira@apache.org
Date: Wed, 25 Sep 2013 16:44:04 +0000 (UTC)
From: "Jared Winick (JIRA)" <jira@apache.org>
To: notifications@accumulo.apache.org
Message-ID: <JIRA.12638552.1363974534691.17456.1380127444317@arcas>
In-Reply-To: <JIRA.12638552.1363974534691@arcas>
References: <JIRA.12638552.1363974534691@arcas>
Subject: [jira] [Commented] (ACCUMULO-1197) Pass Accumulo trace
 functionality through the DFSClient
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/ACCUMULO-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777721#comment-13777721 ] 

Jared Winick commented on ACCUMULO-1197:
----------------------------------------

In a informal exchange with Todd Lipcon he says they would like to get Dapper-like tracing into HDFS for the next major release as he thinks it is a critical feature for low-latency workloads. For this to all work though I guess everyone's take on "Dapper-like" needs to be similar. 
                
> Pass Accumulo trace functionality through the DFSClient
> -------------------------------------------------------
>
>                 Key: ACCUMULO-1197
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1197
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: trace
>            Reporter: Josh Elser
>              Labels: gsoc2013, mentor
>
> The tracing functionality used by Accumulo provides nested regions of timing information for regular operations occurring inside of Accumulo, e.g. scans and compactions. There is basic functionality to view this information through the Accumulo monitor. This can be thought of as a distributed timing infrastructure for Accumulo which uses Accumulo to store its data.
> Currently, this tracing doesn't fall through into HDFS. It would be awesome to actually introspect through the DFSClient, all the way down to the datanode writing to local disk. A large portion of the task would be investigating ways to inject the ability for calling applications (Accumulo, in this case) to provide the trace client through the Hadoop datanode code and record the necessary timings
> Skills required would be a good understanding of Java. Some basic knowledge about Apache Hadoop would also be helpful.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira