hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jim Kellerman (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-498) Use an external DFS instead of spinning up a MiniDFS for every test
Date Fri, 07 Mar 2008 19:59:49 GMT

    [ https://issues.apache.org/jira/browse/HBASE-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12576352#action_12576352
] 

Jim Kellerman commented on HBASE-498:
-------------------------------------

FsShell has a special version of delete that works recursively. FileSystem.delete is not recursive.
It works on unix because you can remove a directory if it is not empty. No so on Windows.

However, when we delete directories, we might want to use FileUtil.fullyDelete instead of
FileSystem.delete and that should solve the problem.

> Use an external DFS instead of spinning up a MiniDFS for every test
> -------------------------------------------------------------------
>
>                 Key: HBASE-498
>                 URL: https://issues.apache.org/jira/browse/HBASE-498
>             Project: Hadoop HBase
>          Issue Type: Sub-task
>          Components: test
>            Reporter: Bryan Duxbury
>             Fix For: 0.2.0
>
>
> My testing suggests that we could shave about a minute off the entire suite if we only
had to start up a single DFS instance instead of a new one for each test. Stack has investigated
using ant to perform this initialization task, but come up empty handed.
> I propose that we should expect the developer running the test suite to start a DFS before
running "ant test". We could provide a bin/hbase command that does specifically that in order
to make it easy. This would save not only the initial start up time but all the startup time
of all tests and test suite runs you execute in a session of development and testing. 
> Do people think that an extra step to testing would be too hard for new (or lazy existing)
developers?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message