Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D37241198E for ; Wed, 30 Jul 2014 19:57:28 +0000 (UTC) Received: (qmail 77274 invoked by uid 500); 30 Jul 2014 19:57:27 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 77221 invoked by uid 500); 30 Jul 2014 19:57:27 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 77209 invoked by uid 99); 30 Jul 2014 19:57:26 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jul 2014 19:57:26 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of andrew.purtell@gmail.com designates 209.85.216.48 as permitted sender) Received: from [209.85.216.48] (HELO mail-qa0-f48.google.com) (209.85.216.48) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jul 2014 19:57:22 +0000 Received: by mail-qa0-f48.google.com with SMTP id m5so1406801qaj.21 for ; Wed, 30 Jul 2014 12:56:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=tOw1IX4hyhCm8kotsLYlpKl9wzICfG7Uuyi0S4GOe70=; b=tf/lhQXCmlqOjV4WD6xO+Me9ehPmWo2MHcR79HjMy3IdqWzUMgMUj1lqIhxNXZ8Ozb Wmf27l7Q6ZGiYNGmoNrLiK+WijneLrn63eCDHE+ef2OC/YFBoT/rDAaXVRVIoXRGam0f r2g/EZROnbiboBt8K1vWZtjeQnYrQs7/AfWi0VlsOCPGrqqGy2IqoH2abCgmNPkkliJg zZCMSkec71dM7fe4rQMkorwQycaPvgbtQsU4fHxBQpYs0IWfcXezSFibzwIyLSFGnp1J Q5BJxAPG6cM5bxhtc3oUZMFG/e7Aph0ojkkW6pvXzmeqnzttYws8TUet/ljn6wOJbUyW UnRg== X-Received: by 10.229.235.133 with SMTP id kg5mr10552967qcb.24.1406750218953; Wed, 30 Jul 2014 12:56:58 -0700 (PDT) MIME-Version: 1.0 Sender: andrew.purtell@gmail.com Received: by 10.96.81.227 with HTTP; Wed, 30 Jul 2014 12:56:18 -0700 (PDT) In-Reply-To: References: <75E9B3D687D9BA43A99B7097A074C5B52975A7B1@szxeml501-mbx.china.huawei.com> From: Andrew Purtell Date: Wed, 30 Jul 2014 12:56:18 -0700 X-Google-Sender-Auth: 4iDf5kFxIRfeqexZag2BfjF4E9w Message-ID: Subject: Re: HBase file encryption, inconsistencies observed and data loss To: "user@hbase.apache.org" Content-Type: multipart/alternative; boundary=001a1134a0c816bc6c04ff6e8fbb X-Virus-Checked: Checked by ClamAV on apache.org --001a1134a0c816bc6c04ff6e8fbb Content-Type: text/plain; charset=UTF-8 Let's take this to JIRA On Wed, Jul 30, 2014 at 12:50 PM, Ted Yu wrote: > In BaseDecoder#rethrowEofException() : > > if (!isEof) throw ioEx; > > LOG.error("Partial cell read caused by EOF: " + ioEx); > > EOFException eofEx = new EOFException("Partial cell read"); > > eofEx.initCause(ioEx); > > throw eofEx; > > throwing EOFException would not propagate the "Partial cell read" condition > to HLogSplitter which doesn't treat EOFException as an error. > > I think a new exception type (DecoderException e.g.) should be used above. > > Cheers > > > On Wed, Jul 30, 2014 at 10:22 AM, Ted Yu wrote: > > > Looking at HLogSplitter#getNextLogLine() : > > > > try { > > > > return in.next(); > > > > } catch (EOFException eof) { > > > > // truncated files are expected if a RS crashes (see HBASE-2643) > > > > LOG.info("EOF from hlog " + path + ". continuing"); > > > > return null; > > > > The EOFException is not treated as an error. But the posted log doesn't > > contain "EOF from hlog " - there may be other code path leading to > > codec.BaseDecoder > > > > Cheers > > > > > > On Wed, Jul 30, 2014 at 9:20 AM, Kiran Kumar.M.R < > > Kiran.Kumar.MR@huawei.com> wrote: > > > >> Hi, > >> > >> After step 4 ( i.e disabling of WAL encryption, removing > >> SecureProtobufReader/Writer and restart), read of encrypted WAL fails > >> mainly due to EOF exception at Basedecoder. This is not considered as > error > >> and these WAL are being moved to /oldWALs. > >> > >> Following is observed in log files: > >> 2014-07-30 19:44:29,254 INFO [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> wal.HLogSplitter: Splitting hlog: > >> > hdfs://HOST-16:18020/hbase/WALs/HOST-16,15264,1406725441997-splitting/HOST-16%2C15264%2C1406725441997.1406725444017, > >> length=172 > >> 2014-07-30 19:44:29,254 INFO [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> wal.HLogSplitter: DistributedLogReplay = false > >> 2014-07-30 19:44:29,313 INFO [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> util.FSHDFSUtils: Recovering lease on dfs file > >> > hdfs://HOST-16:18020/hbase/WALs/HOST-16,15264,1406725441997-splitting/HOST-16%2C15264%2C1406725441997.1406725444017 > >> 2014-07-30 19:44:29,315 INFO [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> util.FSHDFSUtils: recoverLease=true, attempt=0 on > >> > file=hdfs://HOST-16:18020/hbase/WALs/HOST-16,15264,1406725441997-splitting/HOST-16%2C15264%2C1406725441997.1406725444017 > >> after 1ms > >> 2014-07-30 19:44:29,429 DEBUG > >> [RS_LOG_REPLAY_OPS-HOST-16:15264-1-Writer-0] wal.HLogSplitter: Writer > >> thread Thread[RS_LOG_REPLAY_OPS-HOST-16:15264-1-Writer-0,5,main]: > starting > >> 2014-07-30 19:44:29,429 DEBUG > >> [RS_LOG_REPLAY_OPS-HOST-16:15264-1-Writer-1] wal.HLogSplitter: Writer > >> thread Thread[RS_LOG_REPLAY_OPS-HOST-16:15264-1-Writer-1,5,main]: > starting > >> 2014-07-30 19:44:29,430 DEBUG > >> [RS_LOG_REPLAY_OPS-HOST-16:15264-1-Writer-2] wal.HLogSplitter: Writer > >> thread Thread[RS_LOG_REPLAY_OPS-HOST-16:15264-1-Writer-2,5,main]: > starting > >> 2014-07-30 19:44:29,591 ERROR [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> codec.BaseDecoder: Partial cell read caused by EOF: java.io.IOException: > >> Premature EOF from inputStream > >> 2014-07-30 19:44:29,592 INFO [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> wal.HLogSplitter: Finishing writing output logs and closing down. > >> 2014-07-30 19:44:29,592 INFO [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> wal.HLogSplitter: Waiting for split writer threads to finish > >> 2014-07-30 19:44:29,592 INFO [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> wal.HLogSplitter: Split writers finished > >> 2014-07-30 19:44:29,592 INFO [RS_LOG_REPLAY_OPS-HOST-16:15264-1] > >> wal.HLogSplitter: Processed 0 edits across 0 regions; log > >> > file=hdfs://HOST-16:18020/hbase/WALs/HOST-16,15264,1406725441997-splitting/HOST-16%2C15264%2C1406725441997.1406725444017 > >> is corrupted = false progress failed = false > >> > >> To fix this, we need to propagate EOF exception to HLogSplitter. Any > >> suggestions on the fix? > >> > >> > >> Regards, > >> Kiran > >> > >> > __________________________________________________________________________________________________________ > >> This e-mail and its attachments contain confidential information from > >> HUAWEI, which is intended only for the person or entity whose address is > >> listed above. Any use of the information contained herein in any way > >> (including, but not limited to, total or partial disclosure, > reproduction, > >> or dissemination) by persons other than the intended recipient(s) is > >> prohibited. If you receive this e-mail in error, please notify the > sender > >> by phone or email immediately and delete it! > >> > >> > __________________________________________________________________________________________________________ > >> > >> > >> > >> > >> > -----Original Message----- > >> > From: Shankar hiremath [mailto:shankar.hiremath@huawei.com] > >> > Sent: Friday, July 25, 2014 19:38 > >> > To: user@hbase.apache.org > >> > Subject: HBase file encryption, inconsistencies observed and data loss > >> > > >> > HBase file encryption some inconsistencies observed and data loss > >> > happens after running the hbck tool, > >> > the operation steps are as below. (one thing what I observed is, on > >> > startup of HMaster if it is not able to process the WAL file, then > also > >> > it moved to /oldWALs) > >> > > >> > Procedure: > >> > 1. Start the Hbase services (HMaster & region Server) 2. Enable HFile > >> > encryption and WAL file encryption as below, and perform 'table4-0' > put > >> > operations (100 records added) > >> > hbase.crypto.keyprovider > >> > org.apache.hadoop.hbase.io.crypto.KeyStoreKeyProvider > >> > > >> > > >> > hbase.crypto.keyprovider.parameters > >> > jceks:///opt/shankar1/kdc_keytab/hbase.jks?password=Hadoop@234 > >> > value> > >> > > >> > > >> > hbase.crypto.master.key.name > >> > hdfs > >> > > >> > > >> > hfile.format.version > >> > 3 > >> > > >> > > >> > hbase.regionserver.hlog.reader.impl > >> > > org.apache.hadoop.hbase.regionserver.wal.SecureProtobufLogReader > >> > > >> > > >> > > >> > hbase.regionserver.hlog.writer.impl > >> > > org.apache.hadoop.hbase.regionserver.wal.SecureProtobufLogWriter > >> > > >> > > >> > > >> > hbase.regionserver.wal.encryption > >> > true > >> > > >> > 3. Machine went down, so all process went down > >> > > >> > 4. We disabled the WAL file encryption for performance reason, and > keep > >> > encryption only for Hfile, as below > >> > hbase.crypto.keyprovider > >> > org.apache.hadoop.hbase.io.crypto.KeyStoreKeyProvider > >> > > >> > > >> > hbase.crypto.keyprovider.parameters > >> > jceks:///opt/shankar1/kdc_keytab/hbase.jks?password=Hadoop@234 > >> > value> > >> > > >> > > >> > hbase.crypto.master.key.name > >> > hdfs > >> > > >> > > >> > hfile.format.version > >> > 3 > >> > > >> > 5. Start the Region Server and query the 'table4-0' data > >> > hbase(main):003:0> count 'table4-0' > >> > ERROR: org.apache.hadoop.hbase.NotServingRegionException: Region > >> > table4-0,,1406207815456.fc10620a3dcc14e004ab034420f7d332. is not > online > >> > on XX-XX-XX-XX,60020,1406209023146 at > >> > > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedNa > >> > me(HRegionServer.java:2685) > >> > at > >> > > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionSer > >> > ver.java:4119) > >> > at > >> > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.j > >> > ava:3066) > >> > at > >> > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2 > >> > .callBlockingMethod(ClientProtos.java:29497) > >> > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2084) > >> > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) > >> > at > >> > > org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcSc > >> > heduler.java:168) > >> > at > >> > > org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcSche > >> > duler.java:39) > >> > at > >> > > org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler > >> > .java:111) > >> > at java.lang.Thread.run(Thread.java:662) > >> > 6. Not able to read the data, so we decided to revert back the > >> > configuration (as original) 7. Kill/Stop the Region Server, revert all > >> > the configurations as original, as below > >> > hbase.crypto.keyprovider > >> > org.apache.hadoop.hbase.io.crypto.KeyStoreKeyProvider > >> > > >> > > >> > hbase.crypto.keyprovider.parameters > >> > jceks:///opt/shankar1/kdc_keytab/hbase.jks?password=Hadoop@234 > >> > value> > >> > > >> > > >> > hbase.crypto.master.key.name > >> > hdfs > >> > > >> > > >> > hfile.format.version > >> > 3 > >> > > >> > > >> > hbase.regionserver.hlog.reader.impl > >> > > org.apache.hadoop.hbase.regionserver.wal.SecureProtobufLogReader > >> > > >> > > >> > > >> > hbase.regionserver.hlog.writer.impl > >> > > org.apache.hadoop.hbase.regionserver.wal.SecureProtobufLogWriter > >> > > >> > > >> > > >> > hbase.regionserver.wal.encryption > >> > true > >> > > >> > 7. Start the Region Server, and perform the 'table4-0' query > >> > hbase(main):003:0> count 'table4-0' > >> > ERROR: org.apache.hadoop.hbase.NotServingRegionException: Region > >> > table4-0,,1406207815456.fc10620a3dcc14e004ab034420f7d332. is not > online > >> > on XX-XX-XX-XX,60020,1406209023146 at > >> > > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedNa > >> > me(HRegionServer.java:2685) > >> > at > >> > > org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionSer > >> > ver.java:4119) > >> > at > >> > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.j > >> > ava:3066) > >> > at > >> > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2 > >> > .callBlockingMethod(ClientProtos.java:29497) > >> > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2084) > >> > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) > >> > at > >> > > org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcSc > >> > heduler.java:168) > >> > at > >> > > org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcSche > >> > duler.java:39) > >> > at > >> > > org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler > >> > .java:111) > >> > at java.lang.Thread.run(Thread.java:662) > >> > 8. Run the hbase hbck to repair, as below ./hbase hbck - > >> > details ......................... > >> > Summary: > >> > table1-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > table2-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > table3-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > table4-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > table5-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > table6-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > table7-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > table8-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > table9-0 is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > hbase:meta is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 hbase:acl is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > hbase:namespace is okay. > >> > Number of regions: 0 > >> > Deployed on: > >> > 22 inconsistencies detected. > >> > Status: INCONSISTENT > >> > 2014-07-24 19:13:05,532 INFO [main] > >> > client.HConnectionManager$HConnectionImplementation: Closing master > >> > protocol: MasterService > >> > 2014-07-24 19:13:05,533 INFO [main] > >> > client.HConnectionManager$HConnectionImplementation: Closing zookeeper > >> > sessionid=0x1475d1611611bcf > >> > 2014-07-24 19:13:05,533 DEBUG [main] zookeeper.ZooKeeper: Closing > >> > session: 0x1475d1611611bcf > >> > 2014-07-24 19:13:05,533 DEBUG [main] zookeeper.ClientCnxn: Closing > >> > client for session: 0x1475d1611611bcf > >> > 2014-07-24 19:13:05,546 DEBUG [main-SendThread(XX-XX-XX-XX:2181)] > >> > zookeeper.ClientCnxn: Reading reply sessionid:0x1475d1611611bcf, > >> > packet:: clientPath:null serverPath:null finished:false header:: 6,-11 > >> > replyHeader:: 6,4295102074,0 request:: null response:: null > >> > 2014-07-24 19:13:05,546 DEBUG [main] zookeeper.ClientCnxn: > >> > Disconnecting client for session: 0x1475d1611611bcf > >> > 2014-07-24 19:13:05,546 DEBUG [main-SendThread(XX-XX-XX-XX:2181)] > >> > zookeeper.ClientCnxn: An exception was thrown while closing send > thread > >> > for session 0x1475d1611611bcf : Unable to read additional data from > >> > server sessionid 0x1475d1611611bcf, likely server has closed socket > >> > 2014-07-24 19:13:05,546 INFO [main-EventThread] zookeeper.ClientCnxn: > >> > EventThread shut down > >> > 2014-07-24 19:13:05,546 INFO [main] zookeeper.ZooKeeper: Session: > >> > 0x1475d1611611bcf closed shankar1@XX-XX-XX-XX:~/DataSight/hbase/bin> > >> > 9. Fix the assignments as below > >> > ./hbase hbck -fixAssignments > >> > Summary: > >> > table1-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table2-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table3-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table4-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table5-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table6-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table7-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table8-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table9-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 hbase:meta is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 hbase:acl is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 hbase:namespace is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > 0 inconsistencies detected. > >> > Status: OK > >> > 2014-07-24 19:44:55,194 INFO [main] > >> > client.HConnectionManager$HConnectionImplementation: Closing master > >> > protocol: MasterService > >> > 2014-07-24 19:44:55,194 INFO [main] > >> > client.HConnectionManager$HConnectionImplementation: Closing zookeeper > >> > sessionid=0x2475d15f7b31b73 > >> > 2014-07-24 19:44:55,194 DEBUG [main] zookeeper.ZooKeeper: Closing > >> > session: 0x2475d15f7b31b73 > >> > 2014-07-24 19:44:55,194 DEBUG [main] zookeeper.ClientCnxn: Closing > >> > client for session: 0x2475d15f7b31b73 > >> > 2014-07-24 19:44:55,203 DEBUG [main-SendThread(XX-XX-XX-XX:2181)] > >> > zookeeper.ClientCnxn: Reading reply sessionid:0x2475d15f7b31b73, > >> > packet:: clientPath:null serverPath:null finished:false header:: 7,-11 > >> > replyHeader:: 7,4295102377,0 request:: null response:: null > >> > 2014-07-24 19:44:55,203 DEBUG [main] zookeeper.ClientCnxn: > >> > Disconnecting client for session: 0x2475d15f7b31b73 > >> > 2014-07-24 19:44:55,204 DEBUG [main-SendThread(XX-XX-XX-XX:2181)] > >> > zookeeper.ClientCnxn: An exception was thrown while closing send > thread > >> > for session 0x2475d15f7b31b73 : Unable to read additional data from > >> > server sessionid 0x2475d15f7b31b73, likely server has closed socket > >> > 2014-07-24 19:44:55,204 INFO [main] zookeeper.ZooKeeper: Session: > >> > 0x2475d15f7b31b73 closed > >> > 2014-07-24 19:44:55,204 INFO [main-EventThread] zookeeper.ClientCnxn: > >> > EventThread shut down 10. Fix the assignments as below ./hbase hbck - > >> > fixAssignments -fixMeta > >> > Summary: > >> > table1-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table2-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table3-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table4-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table5-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table6-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table7-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table8-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > table9-0 is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 hbase:meta is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 hbase:acl is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 hbase:namespace is okay. > >> > Number of regions: 1 > >> > Deployed on: XX-XX-XX-XX,60020,1406209023146 > >> > 0 inconsistencies detected. > >> > Status: OK > >> > 2014-07-24 19:46:16,290 INFO [main] > >> > client.HConnectionManager$HConnectionImplementation: Closing master > >> > protocol: MasterService > >> > 2014-07-24 19:46:16,290 INFO [main] > >> > client.HConnectionManager$HConnectionImplementation: Closing zookeeper > >> > sessionid=0x3475d1605321be9 > >> > 2014-07-24 19:46:16,290 DEBUG [main] zookeeper.ZooKeeper: Closing > >> > session: 0x3475d1605321be9 > >> > 2014-07-24 19:46:16,290 DEBUG [main] zookeeper.ClientCnxn: Closing > >> > client for session: 0x3475d1605321be9 > >> > 2014-07-24 19:46:16,300 DEBUG [main-SendThread(XX-XX-XX-XX:2181)] > >> > zookeeper.ClientCnxn: Reading reply sessionid:0x3475d1605321be9, > >> > packet:: clientPath:null serverPath:null finished:false header:: 6,-11 > >> > replyHeader:: 6,4295102397,0 request:: null response:: null > >> > 2014-07-24 19:46:16,300 DEBUG [main] zookeeper.ClientCnxn: > >> > Disconnecting client for session: 0x3475d1605321be9 > >> > 2014-07-24 19:46:16,300 DEBUG [main-SendThread(XX-XX-XX-XX:2181)] > >> > zookeeper.ClientCnxn: An exception was thrown while closing send > thread > >> > for session 0x3475d1605321be9 : Unable to read additional data from > >> > server sessionid 0x3475d1605321be9, likely server has closed socket > >> > 2014-07-24 19:46:16,300 INFO [main] zookeeper.ZooKeeper: Session: > >> > 0x3475d1605321be9 closed > >> > 2014-07-24 19:46:16,300 INFO [main-EventThread] zookeeper.ClientCnxn: > >> > EventThread shut down hbase(main):006:0> count 'table4-0' > >> > 0 row(s) in 0.0200 seconds > >> > => 0 > >> > hbase(main):007:0> > >> > Complete data loss happened, > >> > WALs, oldWALs & /hbase/data/default/table4-0/ does not have any data > >> > > >> > > >> > > >> > [X] > >> > This e-mail and its attachments contain confidential information from > >> > HUAWEI, which is intended only for the person or entity whose address > >> > is listed above. Any use of the information contained herein in any > way > >> > (including, but not limited to, total or partial disclosure, > >> > reproduction, or dissemination) by persons other than the intended > >> > recipient(s) is prohibited. If you receive this e-mail in error, > please > >> > notify the sender by phone or email immediately and delete it! > >> > [X] > >> > > >> > > >> > > >> > > >> > >> > > > -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White) --001a1134a0c816bc6c04ff6e8fbb--