Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B7A6710950 for ; Fri, 31 Jan 2014 15:11:15 +0000 (UTC) Received: (qmail 35684 invoked by uid 500); 31 Jan 2014 15:10:43 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 35293 invoked by uid 500); 31 Jan 2014 15:10:38 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 35281 invoked by uid 99); 31 Jan 2014 15:10:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Jan 2014 15:10:36 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ogdude@googlemail.com designates 209.85.220.47 as permitted sender) Received: from [209.85.220.47] (HELO mail-pa0-f47.google.com) (209.85.220.47) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Jan 2014 15:10:31 +0000 Received: by mail-pa0-f47.google.com with SMTP id kp14so4500295pab.34 for ; Fri, 31 Jan 2014 07:10:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=G/QIDSK6peSczPm5EwheJQfT9vrFd7DHsxhxO6WvPM8=; b=iyT75egmjTLtfAtBlUaICkKmEHKggsNcFhGzl2J+EcFjEf5DuBlvXJhq24k1f81oiD OWT60k4ir0qlr81i/vP8ufKPRUf3dkjfVPjCT70250NlLWx4w0vckyR4uHU22dLk4z2s 9jZ4jGNmaYNBlNn1fi4jOAsk8/l4M/rtURepOYwce+3eFT2xMg/YGSOfEu6/tYaE7KQS Z/cBwLjud1Di2s09o4fH0JWSq79z9ID0xLCBb9KaPvcsyLmdIMh0EBinuy2a5HiDdtDr SefiNJYdEOImNuBXNsnDM2IquUPlRgIprgjdCgkpsttD7+4mcmtMlxZpP3NZ0a1SUPKP qdNw== MIME-Version: 1.0 X-Received: by 10.66.232.40 with SMTP id tl8mr21429789pac.137.1391181010970; Fri, 31 Jan 2014 07:10:10 -0800 (PST) Received: by 10.70.81.33 with HTTP; Fri, 31 Jan 2014 07:10:10 -0800 (PST) In-Reply-To: References: Date: Fri, 31 Jan 2014 16:10:10 +0100 Message-ID: Subject: Re: Snapshot clone error From: David Koch To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=047d7b111b39fa306c04f145917c X-Virus-Checked: Checked by ClamAV on apache.org --047d7b111b39fa306c04f145917c Content-Type: text/plain; charset=ISO-8859-1 Matteo, Thank you for your reply. All clients, servers are using the same version: 14/01/31 16:06:20 INFO util.VersionInfo: HBase 0.94.6-cdh4.5.0 Also, the information generated by: hbase org.apache.hadoop.hbase.snapshot.SnapshotInfo -snapshot is identical for snapshots which I managed to clone and those for which the cloning/restoration failed. Would you advise re-trying snaphotting the table while it is disabled? Otherwise I'll go with old-fashioned CopyTable or re-import into HBase from HDFS files. Thank you, /David On Fri, Jan 31, 2014 at 2:42 PM, Matteo Bertozzi wrote: > the snapshot seems to be corrupted, which version are you running? > > Matteo > > > > On Fri, Jan 31, 2014 at 1:06 PM, David Koch wrote: > > > Hello, > > > > We export an online snapshot of a table to a different cluster, when > > attempting a clone on the destination cluster using: > > > > clone_snapshot 'table_source_snapshot', 'table_dest' > > > > it does not work. > > > > The operation times out after a a while > > > > ERROR: java.io.IOException: Table 'table_dest' not yet enabled, after > > 1996939ms. > > > > and I see only a fraction of the number of regions in the destination > > table. Table is indicated as "enabled" but I cannot perform any scans on > > it. > > > > The snapshot info returns the following: > > > > Snapshot Info > > ---------------------------------------- > > Name: table_source_snapshot > > Type: FLUSH > > Table: table_source > > Format: 0 > > Created: 2014-01-30T13:05:02 > > > > Snapshot seems to be intact. What could be the error? Should I take an > > offline snapshot instead? Going via restore/enable instead of clone does > > not seem to work either. > > > > Also, I see the following in the region servers: > > > > 2:24:35.807 PM ERROR > > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler > > Failed open of > > region= > > > table_source,\x82\x12Y\x00\xE98C\xEE\xBC\xCC\xE3h\xDAPt\xA6,1366259070788.63ca017ac7cd03e68c35a4da8b56421d., > > starting to roll back the global memstore size. > > java.io.IOException: java.io.IOException: java.io.FileNotFoundException: > > Unable to open link: org.apache.hadoop.hbase.io.HFileLink > > > > > locations=[hdfs://nameservice1/hbase/table_source/816bb88c6f3524a877f4cb7ce747fec1/t/c3b37dc11e684626a5b464a25a75735c, > > > > > hdfs://nameservice1/hbase/.tmp/table_source/816bb88c6f3524a877f4cb7ce747fec1/t/c3b37dc11e684626a5b464a25a75735c, > > > > > hdfs://nameservice1/hbase/.archive/table_source/816bb88c6f3524a877f4cb7ce747fec1/t/c3b37dc11e684626a5b464a25a75735c] > > > > None of these parts actually exist, however: > > > > > hdfs://nameservice1/hbase/.snapshot/table_source_snapshot/816bb88c6f3524a877f4cb7ce747fec1/t/c3b37dc11e684626a5b464a25a75735c > > does exist. > > > > I don't think that's the issue though, since I applied the same steps to > a > > smaller table and it worked. > > > > Any advice is appreciated, > > > > Regards, > > > > /David > > > --047d7b111b39fa306c04f145917c--