Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
From: "Parsian, Mahmoud" <mparsian@illumina.com>
To: Nkechi Achara <nkachara@googlemail.com>, "user@hbase.apache.org"
	<user@hbase.apache.org>
Subject: Re: Example of spinning up a Hbase mock style test for integration
 testing in scala
Thread-Topic: Example of spinning up a Hbase mock style test for integration
 testing in scala
Thread-Index: AQHRfb4aCRPXMXZjoEasWYAIZYY+2Z9ZLTqAgAB2ioD//44YAA==
Date: Mon, 14 Mar 2016 17:26:40 +0000
Message-ID: <D30C420A.16F02%mparsian@illumina.com>
References: 
 <CAJF+B4veoEcoGF-TrzxVMnO=BCZgbcw59skNTqcYqjG+2LmA_Q@mail.gmail.com>
 <D30C3DFA.16EFA%mparsian@illumina.com>
 <CAJF+B4u1p21hCuo_VxApzgcCAn3DDSTc2Xe9xUSkeqGNf_a=uw@mail.gmail.com>
In-Reply-To: 
 <CAJF+B4u1p21hCuo_VxApzgcCAn3DDSTc2Xe9xUSkeqGNf_a=uw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_D30C420A16F02mparsianilluminacom_"
MIME-Version: 1.0

--_000_D30C420A16F02mparsianilluminacom_
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable

Hi Keech,

Please post your sample test, its run log, version of Hbase , hadoop, =85
And make sure that hadoop-core-1.2.1.jar is not your classpath (causes many=
 errors!).

Best,
Mahmoud
From: Nkechi Achara <nkachara@googlemail.com<mailto:nkachara@googlemail.com=
>>
Date: Monday, March 14, 2016 at 10:14 AM
To: "user@hbase.apache.org<mailto:user@hbase.apache.org>" <user@hbase.apach=
e.org<mailto:user@hbase.apache.org>>, Mahmoud Parsian <mparsian@illumina.co=
m<mailto:mparsian@illumina.com>>
Subject: Re: Example of spinning up a Hbase mock style test for integration=
 testing in scala


Thanks Mahmoud,

This is what I am using,  but as the previous reply stated, I  receiving an=
 exception when starting the cluster.
Thinking about it, it looks to be more of a build problem of my hbase mini =
cluster,  as I am receiving the following error:

16/03/14 12:29:00 WARN datanode.DataNode: IOException in BlockReceiver.run(=
):

java.io.IOException: Failed to move meta file for ReplicaBeingWritten, blk_=
1073741825_1001, RBW

  getNumBytes()     =3D 7

  getBytesOnDisk()  =3D 7

  getVisibleLength()=3D 7

  getVolume()       =3D C:\Users\unknown\Documents\trs\target\test-data\780=
d11ca-27b8-4004-bed8-480bc9903125\dfscluster_d292c05b-0190-43b1-83b2-bebf48=
3c8b3c\dfs\data\data1\current

  getBlockFile()    =3D C:\Users\unknown\Documents\trs\target\test-data\780=
d11ca-27b8-4004-bed8-480bc9903125\dfscluster_d292c05b-0190-43b1-83b2-bebf48=
3c8b3c\dfs\data\data1\current\BP-1081755239-10.66.90.86-1457954925705\curre=
nt\rbw\blk_1073741825

  bytesAcked=3D7

  bytesOnDisk=3D7 from C:\Users\unknown\Documents\trs\target\test-data\780d=
11ca-27b8-4004-bed8-480bc9903125\dfscluster_d292c05b-0190-43b1-83b2-bebf483=
c8b3c\dfs\data\data1\current\BP-1081755239-10.66.90.86-1457954925705\curren=
t\rbw\blk_1073741825_1001.meta to C:\Users\unknown\Documents\trs\target\tes=
t-data\780d11ca-27b8-4004-bed8-480bc9903125\dfscluster_d292c05b-0190-43b1-8=
3b2-bebf483c8b3c\dfs\data\data1\current\BP-1081755239-10.66.90.86-145795492=
5705\current\finalized\subdir0\subdir0\blk_1073741825_1001.meta

at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.move=
BlockFiles(FsDatasetImpl.java:615)

at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.BlockPoolSlice.add=
Block(BlockPoolSlice.java:250)

at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.addBl=
ock(FsVolumeImpl.java:229)

at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.fina=
lizeReplica(FsDatasetImpl.java:1119)

at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.fina=
lizeBlock(FsDatasetImpl.java:1100)

at org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.fin=
alizeBlock(BlockReceiver.java:1293)

at org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run=
(BlockReceiver.java:1233)

at java.lang.Thread.run(Thread.java:745)

Caused by: 3: The system cannot find the path specified.

at org.apache.hadoop.io.nativeio.NativeIO.renameTo0(Native Method)

at org.apache.hadoop.io.nativeio.NativeIO.renameTo(NativeIO.java:830)

at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.move=
BlockFiles(FsDatasetImpl.java:613)

... 7 more

16/03/14 12:29:00 INFO datanode.DataNode: Starting CheckDiskError Thread

Thanks,

Keech

On 14 Mar 2016 6:10 pm, "Parsian, Mahmoud" <mparsian@illumina.com<mailto:mp=
arsian@illumina.com>> wrote:
Hi Keech,

You may use the org.apache.hadoop.hbase.HBaseCommonTestingUtility class to
start a ZK, and an HBase cluster and then do your unit tests and
integration.
I am using this with junit and it works very well. But I am using Java
only.

Best regards,
Mahmoud Parsian


On 3/13/16, 11:52 PM, "Nkechi Achara" <nkachara@googlemail.com<mailto:nkach=
ara@googlemail.com>> wrote:

>Hi,
>
>I am trying to find an example of how to spin up a Hbase server in a mock
>or integration style, so I can test my code locally in my IDE.
>I have tried fake-hbase and hbase testing utility and receive errors
>especially when trying to start the cluster.
>Has anyone got any examples in scala to do this?
>
>Thanks,
>
>Keech


--_000_D30C420A16F02mparsianilluminacom_--