hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shankar hiremath <shankar.hirem...@huawei.com>
Subject RE: flush table with AES encryption enabled for CF, randomly wrapException observed
Date Fri, 08 Aug 2014 09:16:38 GMT
Hi Anoop/Esteban,

I verified it, it not a problem.

After the analysis we found that when our Hbase test client was trying to connect to Hmaster
at that time file descriptors in the 
Hmaster side exhausted and it failed, after providing the sufficient file descriptors to Hmaster
it worked fine.

Thanks
-Shankar


This e-mail and its attachments contain confidential information from HUAWEI, which is intended
only for the person or entity whose address is listed above. Any use of the information contained
herein in any way (including, but not limited to, total or partial disclosure, reproduction,
or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive
this e-mail in error, please notify the sender by phone or email immediately and delete it!




-----Original Message-----
From: Shankar hiremath [mailto:shankar.hiremath@huawei.com] 
Sent: 08 August 2014 PM 01:00
To: Anoop John; esteban@cloudera.com
Cc: user@hbase.apache.org
Subject: RE: flush table with AES encryption enabled for CF, randomly wrapException observed

Hi Anoop/ Esteban,

I will check it, as per your below suggestions, And I will update you the result.

Thanks
-Shankar

________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended
only for the person or entity whose address is listed above. Any use of the information contained
herein in any way (including, but not limited to, total or partial disclosure, reproduction,
or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive
this e-mail in error, please notify the sender by phone or email immediately and delete it!
________________________________



From: Anoop John [mailto:anoop.hbase@gmail.com]
Sent: 08 August 2014 PM 12:08
To: user@hbase.apache.org
Cc: Shankar hiremath
Subject: Re: flush table with AES encryption enabled for CF, randomly wrapException observed

Shankar
    You are getting this only when the HFile encryption is enabled?  Seeing the exception
dont think it is directly related to Encryption or so.  Suggest test with out encryption multiple
times and see any time you get the same in that also

-Anoop-
On Fri, Aug 8, 2014 at 11:29 AM, Esteban Gutierrez <esteban@cloudera.com<mailto:esteban@cloudera.com>>
wrote:
Hi Shankar,

Seems that your unit test is connecting to a HBase cluster and not using the HBaseTestingUtility,
is that correct? since the exception is local and not remote probably the master went down
at the time your test tried to flush the region and that would explain the EOF.

regards,
esteban.



--
Cloudera, Inc.



On Thu, Aug 7, 2014 at 10:43 PM, Shankar hiremath < shankar.hiremath@huawei.com<mailto:shankar.hiremath@huawei.com>>
wrote:

> Hbase 0.98.3
> Hadoop 2.4.1
>
> [X]
> This e-mail and its attachments contain confidential information from 
> HUAWEI, which is intended only for the person or entity whose address 
> is listed above. Any use of the information contained herein in any 
> way (including, but not limited to, total or partial disclosure, 
> reproduction, or dissemination) by persons other than the intended 
> recipient(s) is prohibited. If you receive this e-mail in error, 
> please notify the sender by phone or email immediately and delete it!
> [X]
>
>
>
>
> _____________________________________________
> From: Shankar hiremath
> Sent: 08 August 2014 AM 11:06
> To: 'user@hbase.apache.org<mailto:user@hbase.apache.org>'
> Subject: flush table with AES encryption enabled for CF, randomly 
> wrapException observed
>
>
> I am getting the below exception during 'flush table' operation (when 
> the table with column families are AES encrypted) And it is randomly 
> coming, not always.
>
> Is it a bug, or any thing I missed in my test/config setup.
>
> java.io.IOException: Call to host1/hos1:60020 failed on local exception:
> java.io.EOFException
>         at
> org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1485)
>         at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1457)
>         at
> org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1657)
>         at
> org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1715)
>         at
> org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.flushRegion(AdminProtos.java:21705)
>         at
> org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1507)
>         at
> org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1487)
>         at
> org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1454)
>         at
> com.huawei.csi.test.datasight.hadoop.hbase.HBase_limitConnection_DML.t
> estForMultiplePutTableWithMultipleColumnHFileEncryption(HBase_limitCon
> nection_DML.java:731) ==> our test case performing 'flush table' 
> operation
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at junit.framework.TestCase.runTest(TestCase.java:168)
>         at junit.framework.TestCase.runBare(TestCase.java:134)
>         at junit.framework.TestResult$1.protect(TestResult.java:110)
>         at junit.framework.TestResult.runProtected(TestResult.java:128)
>         at junit.framework.TestResult.run(TestResult.java:113)
>         at junit.framework.TestCase.run(TestCase.java:124)
>         at junit.framework.TestSuite.runTest(TestSuite.java:232)
>         at junit.framework.TestSuite.run(TestSuite.java:227)
>         at
> org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
>         at
> org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
>         at
> org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
>         at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
>         at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
>         at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
>         at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTest
> Runner.java:197)
> Caused by: java.io.EOFException
>         at java.io.DataInputStream.readInt(DataInputStream.java:375)
>         at
> org.apache.hadoop.hbase.ipc.RpcClient$Connection.readResponse(RpcClient.java:1072)
>         at
> org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:72
> 8)
>
>
>
> [X]
> This e-mail and its attachments contain confidential information from 
> HUAWEI, which is intended only for the person or entity whose address 
> is listed above. Any use of the information contained herein in any 
> way (including, but not limited to, total or partial disclosure, 
> reproduction, or dissemination) by persons other than the intended 
> recipient(s) is prohibited. If you receive this e-mail in error, 
> please notify the sender by phone or email immediately and delete it!
> [X]
>
>
>
>
>
>

Mime
View raw message