hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject Re: How to configure the testing data dir for maven
Date Sat, 03 Jan 2015 00:20:44 GMT
Hi Ted,
  Also on macOs.  I am running within a completely different project
(spark).  Is there something else particular to the hbase testing env
(workspace) that needs to be replicated to the spark maven build to have
this work properly?

thx!

2015-01-02 16:11 GMT-08:00 Ted Yu <yuzhihong@gmail.com>:

> I was running test on Macbook.
> What OS do you use ?
>
> Were you running in workspace based in master branch ?
>
> Cheers
>
>
>
> On Fri, Jan 2, 2015 at 4:03 PM, Stephen Boesch <javadba@gmail.com> wrote:
>
> > Hi Ted,
> >
> > I can not get the same behavior.
> >
> > The command line includes:
> >
> > -Dtest.build.data.basedirectory=/tmp/minihbase
> >
> > And then I have also tried to set the System property directly:
> >
> >   val WorkDirProperty = "test.build.data.basedirectory"
> >   val DefaultWorkDir = "/tmp/minihbase"
> >
> >     System.setProperty(WorkDirProperty, workDir)
> >
> >       testUtil = new HBaseTestingUtility
> >       cluster = testUtil.startMiniCluster(nMasters, nRegionServers,
> > nDataNodes)
> >
> > It is not clear to me why we see different behaviors.
> >
> > 2015-01-02 14:43 GMT-08:00 Ted Yu <yuzhihong@gmail.com>:
> >
> > > Here is the command I used (in workspace corresponding to master
> branch):
> > >
> > > mvn test -PrunAllTests
> > > -DfailIfNoTests=false -Dtest.build.data.basedirectory=/tmp/ted/
> > > -Dtest=TestHFileOutputFormat2#testExcludeMinorCompaction
> > >
> > > Under /tmp/ted, I have:
> > > $ ls e47ced18-e1f8-4310-bbed-4684d401982c/
> > > cache_data hadoop_logs mapred_local
> > > dfscluster_b2dbb460-3735-4813-a1d1-f18e082ee89b hadoop_tmp
> > >
> > > FYI
> > >
> > > On Fri, Jan 2, 2015 at 2:13 PM, Stephen Boesch <javadba@gmail.com>
> > wrote:
> > >
> > > > We are experiencing an issue that the MiniHBase cluster is creating
> > temp
> > > > directories/data under the same directory as the tests are run:
> > > >
> > > > Upon doing some research it appears there is a system property to
> > control
> > > > that temp dir:
> > > >
> > > >    test.build.data.basedirectory
> > > >
> > > > Also there is in the doc a command to set it:
> > > >
> > > >   <command>mvn test -P runAllTests
> -Dsurefire.secondPartThreadCount=12
> > -
> > > >  Dtest.build.data.basedirectory=/ram2G</command>
> > > >
> > > > However, we find that does NOT work unless the following additional
> > maven
> > > > parameter is set:
> > > >
> > > >    -DforkMode=never
> > > >
> > > > But that flag causes other testing issues and we would not be able to
> > go
> > > > that route.
> > > >
> > > > How then can we redirect that testing data directory without setting
> > the
> > > > System property?
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message