hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Esteban Gutierrez <este...@cloudera.com>
Subject Re: flush table with AES encryption enabled for CF, randomly wrapException observed
Date Fri, 08 Aug 2014 09:24:11 GMT
Good to know Shankar! that would also explain getting an EOF in the client.

cheers,
esteban.


--
Cloudera, Inc.



On Fri, Aug 8, 2014 at 2:16 AM, Shankar hiremath <
shankar.hiremath@huawei.com> wrote:

> Hi Anoop/Esteban,
>
> I verified it, it not a problem.
>
> After the analysis we found that when our Hbase test client was trying to
> connect to Hmaster at that time file descriptors in the
> Hmaster side exhausted and it failed, after providing the sufficient file
> descriptors to Hmaster it worked fine.
>
> Thanks
> -Shankar
>
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
>
>
> -----Original Message-----
> From: Shankar hiremath [mailto:shankar.hiremath@huawei.com]
> Sent: 08 August 2014 PM 01:00
> To: Anoop John; esteban@cloudera.com
> Cc: user@hbase.apache.org
> Subject: RE: flush table with AES encryption enabled for CF, randomly
> wrapException observed
>
> Hi Anoop/ Esteban,
>
> I will check it, as per your below suggestions, And I will update you the
> result.
>
> Thanks
> -Shankar
>
> ________________________________
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
> ________________________________
>
>
>
> From: Anoop John [mailto:anoop.hbase@gmail.com]
> Sent: 08 August 2014 PM 12:08
> To: user@hbase.apache.org
> Cc: Shankar hiremath
> Subject: Re: flush table with AES encryption enabled for CF, randomly
> wrapException observed
>
> Shankar
>     You are getting this only when the HFile encryption is enabled?
>  Seeing the exception dont think it is directly related to Encryption or
> so.  Suggest test with out encryption multiple times and see any time you
> get the same in that also
>
> -Anoop-
> On Fri, Aug 8, 2014 at 11:29 AM, Esteban Gutierrez <esteban@cloudera.com
> <mailto:esteban@cloudera.com>> wrote:
> Hi Shankar,
>
> Seems that your unit test is connecting to a HBase cluster and not using
> the HBaseTestingUtility, is that correct? since the exception is local and
> not remote probably the master went down at the time your test tried to
> flush the region and that would explain the EOF.
>
> regards,
> esteban.
>
>
>
> --
> Cloudera, Inc.
>
>
>
> On Thu, Aug 7, 2014 at 10:43 PM, Shankar hiremath <
> shankar.hiremath@huawei.com<mailto:shankar.hiremath@huawei.com>> wrote:
>
> > Hbase 0.98.3
> > Hadoop 2.4.1
> >
> > [X]
> > This e-mail and its attachments contain confidential information from
> > HUAWEI, which is intended only for the person or entity whose address
> > is listed above. Any use of the information contained herein in any
> > way (including, but not limited to, total or partial disclosure,
> > reproduction, or dissemination) by persons other than the intended
> > recipient(s) is prohibited. If you receive this e-mail in error,
> > please notify the sender by phone or email immediately and delete it!
> > [X]
> >
> >
> >
> >
> > _____________________________________________
> > From: Shankar hiremath
> > Sent: 08 August 2014 AM 11:06
> > To: 'user@hbase.apache.org<mailto:user@hbase.apache.org>'
> > Subject: flush table with AES encryption enabled for CF, randomly
> > wrapException observed
> >
> >
> > I am getting the below exception during 'flush table' operation (when
> > the table with column families are AES encrypted) And it is randomly
> > coming, not always.
> >
> > Is it a bug, or any thing I missed in my test/config setup.
> >
> > java.io.IOException: Call to host1/hos1:60020 failed on local exception:
> > java.io.EOFException
> >         at
> > org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1485)
> >         at
> org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1457)
> >         at
> >
> org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1657)
> >         at
> >
> org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1715)
> >         at
> >
> org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.flushRegion(AdminProtos.java:21705)
> >         at
> > org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1507)
> >         at
> > org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1487)
> >         at
> > org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1454)
> >         at
> > com.huawei.csi.test.datasight.hadoop.hbase.HBase_limitConnection_DML.t
> > estForMultiplePutTableWithMultipleColumnHFileEncryption(HBase_limitCon
> > nection_DML.java:731) ==> our test case performing 'flush table'
> > operation
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >         at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >         at junit.framework.TestCase.runTest(TestCase.java:168)
> >         at junit.framework.TestCase.runBare(TestCase.java:134)
> >         at junit.framework.TestResult$1.protect(TestResult.java:110)
> >         at junit.framework.TestResult.runProtected(TestResult.java:128)
> >         at junit.framework.TestResult.run(TestResult.java:113)
> >         at junit.framework.TestCase.run(TestCase.java:124)
> >         at junit.framework.TestSuite.runTest(TestSuite.java:232)
> >         at junit.framework.TestSuite.run(TestSuite.java:227)
> >         at
> >
> org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
> >         at
> >
> org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
> >         at
> >
> org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
> >         at
> >
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
> >         at
> >
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
> >         at
> >
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
> >         at
> > org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTest
> > Runner.java:197)
> > Caused by: java.io.EOFException
> >         at java.io.DataInputStream.readInt(DataInputStream.java:375)
> >         at
> >
> org.apache.hadoop.hbase.ipc.RpcClient$Connection.readResponse(RpcClient.java:1072)
> >         at
> > org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:72
> > 8)
> >
> >
> >
> > [X]
> > This e-mail and its attachments contain confidential information from
> > HUAWEI, which is intended only for the person or entity whose address
> > is listed above. Any use of the information contained herein in any
> > way (including, but not limited to, total or partial disclosure,
> > reproduction, or dissemination) by persons other than the intended
> > recipient(s) is prohibited. If you receive this e-mail in error,
> > please notify the sender by phone or email immediately and delete it!
> > [X]
> >
> >
> >
> >
> >
> >
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message