hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Foley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2136) 1073: Fault injection for StorageDirectory failures during read/write of FSImage/Edits files
Date Thu, 14 Jul 2011 17:41:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13065408#comment-13065408
] 

Matt Foley commented on HDFS-2136:
----------------------------------

Eli or Cos, re:
bq. the code contains hooks for generating a fault/behavior and the test code triggers the
hooks
For this to work during DFSMiniCluster startup, it seems to me there has to be something in
the environment (eg, config or something in the File System) that the hook code can pick up,
since there's no other way the hooks can interact with the test code between the time of SD
object creation and the desired time of failure.

Since that's an ugly solution, I'm thinking AspectJ instead.  Am I missing an easy way to
do the above?  The issue is specifically testing startup code; I understand this approach
is easy to use once the cluster is in steady state.  Thanks.

> 1073: Fault injection for StorageDirectory failures during read/write of FSImage/Edits
files
> --------------------------------------------------------------------------------------------
>
>                 Key: HDFS-2136
>                 URL: https://issues.apache.org/jira/browse/HDFS-2136
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Matt Foley
>
> Both HDFS-1955 and HDFS-2135 have observed that it is difficult to unit test such failures.
 As a result, regression of HDFS-1955 was only found by careful manual review (thanks, atm!).
 Since 1073 is making broad changes to the way these files are read and written, and appropriately
putting effort into correct error handling, I propose we make also make it possible to auto-test
that error handling.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message