hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10728) Metrics system for Windows Azure Storage Filesystem
Date Fri, 20 Jun 2014 16:32:25 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14038997#comment-14038997
] 

Chris Nauroth commented on HADOOP-10728:
----------------------------------------

Hi, [~stevel@apache.org].  The hadoop-azure module contains both unit tests that can run in
isolation via mocks and integration tests that must connect to the service.  The integration
tests don't run unless you configure it to connect to the Azure storage emulator, which is
something you can run local on your machine, or connect it to Azure for real using your own
storage credentials.  This is documented in the README.txt file.

For at least one of the test failures, I suspect HADOOP-9559 is the root cause.  I'm planning
to commit that one soon.

> Metrics system for Windows Azure Storage Filesystem
> ---------------------------------------------------
>
>                 Key: HADOOP-10728
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10728
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: tools
>            Reporter: Mike Liddell
>            Assignee: Mike Liddell
>         Attachments: HADOOP-10728.1.patch
>
>
> Add a metrics2 source for the Windows Azure Filesystem driver that was introduced with
HADOOP-9629.
> AzureFileSystemInstrumentation is the new MetricsSource.  
> AzureNativeFilesystemStore and NativeAzureFilesystem have been modified to record statistics
and some machinery is added for the accumulation of 'rolling average' statistics.
> Primary new code appears in org.apache.hadoop.fs.azure.metrics namespace.
> h2. Credits and history
> Credit for this work goes to the early team: [~minwei], [~davidlao], [~lengningliu] and
[~stojanovic] as well as multiple people who have taken over this work since then (hope I
don't forget anyone): [~dexterb], Johannes Klein, [~ivanmi], Michael Rys, [~mostafae], [~brian_swan],
[~mikelid], [~xifang], and [~chuanliu].



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message