hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2136) 1073: Fault injection for StorageDirectory failures during read/write of FSImage/Edits files
Date Thu, 14 Jul 2011 19:47:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13065497#comment-13065497
] 

Todd Lipcon commented on HDFS-2136:
-----------------------------------

bq. Do you have any hard data to back this? I would love to see how much slower an FI based
test is compared to non-FI one?

I can run a non-FI test in eclipse in <0.2seconds for a true unit test. Maybe I'm just
dense at Eclipse (you know this is true ;-) ) but I don't know of any way to run a test with
aspects woven inside Eclipse nearly that fast. From the command line, if I want to run a single
AOP test, it takes 1m12s from starting ant to actually executing an FI test (this is _without_
ant clean first). In comparison it taks about 15s to get to a non-AOP test.

> 1073: Fault injection for StorageDirectory failures during read/write of FSImage/Edits
files
> --------------------------------------------------------------------------------------------
>
>                 Key: HDFS-2136
>                 URL: https://issues.apache.org/jira/browse/HDFS-2136
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Matt Foley
>
> Both HDFS-1955 and HDFS-2135 have observed that it is difficult to unit test such failures.
 As a result, regression of HDFS-1955 was only found by careful manual review (thanks, atm!).
 Since 1073 is making broad changes to the way these files are read and written, and appropriately
putting effort into correct error handling, I propose we make also make it possible to auto-test
that error handling.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message