Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2166C1068A for ; Fri, 31 Jan 2014 13:43:31 +0000 (UTC) Received: (qmail 81226 invoked by uid 500); 31 Jan 2014 13:43:09 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 81147 invoked by uid 500); 31 Jan 2014 13:43:06 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 80498 invoked by uid 99); 31 Jan 2014 13:42:56 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Jan 2014 13:42:56 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of theo.bertozzi@gmail.com designates 74.125.82.50 as permitted sender) Received: from [74.125.82.50] (HELO mail-wg0-f50.google.com) (74.125.82.50) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Jan 2014 13:42:50 +0000 Received: by mail-wg0-f50.google.com with SMTP id l18so8896676wgh.29 for ; Fri, 31 Jan 2014 05:42:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=/LTIMe/lO/V9DNTGO19H6PKnwQt7eczq5IvEbVtdowI=; b=NNgvPVJnqQ6wuifBZwP4o6pFKjQhwLkZjzgfd64Futlg23tO7F9j3uQPoBIRszjbxM mrjEO/yprGGqY0zd+S0syZTDQVF+jvL4bmMWWNA7Qs81wYmdnWSTkMqGrltJxEHKGmcA JXW0tbS5Sb9rli9gJlIDJq/McwmI23bvqYLVksleAv0sUx1LVxe7eRiqfEE2VS37OA72 bOXm00JvvnujXdYymHcaRLOpPU4/WGwqX8ZqoO4BOE9k3dhfLSiTlvoKF+WBa2KLd/HC QUELbK+GBgVO+eQpAUinRGE7k5SnX90hK/GZBd8YjvXE+neB2TjlT66KSOiIa6y8Iuvo Y0WA== X-Received: by 10.180.73.19 with SMTP id h19mr13974711wiv.40.1391175750373; Fri, 31 Jan 2014 05:42:30 -0800 (PST) MIME-Version: 1.0 Received: by 10.194.32.165 with HTTP; Fri, 31 Jan 2014 05:42:10 -0800 (PST) In-Reply-To: References: From: Matteo Bertozzi Date: Fri, 31 Jan 2014 13:42:10 +0000 Message-ID: Subject: Re: Snapshot clone error To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=f46d0438959b6bd66e04f14458da X-Virus-Checked: Checked by ClamAV on apache.org --f46d0438959b6bd66e04f14458da Content-Type: text/plain; charset=ISO-8859-1 the snapshot seems to be corrupted, which version are you running? Matteo On Fri, Jan 31, 2014 at 1:06 PM, David Koch wrote: > Hello, > > We export an online snapshot of a table to a different cluster, when > attempting a clone on the destination cluster using: > > clone_snapshot 'table_source_snapshot', 'table_dest' > > it does not work. > > The operation times out after a a while > > ERROR: java.io.IOException: Table 'table_dest' not yet enabled, after > 1996939ms. > > and I see only a fraction of the number of regions in the destination > table. Table is indicated as "enabled" but I cannot perform any scans on > it. > > The snapshot info returns the following: > > Snapshot Info > ---------------------------------------- > Name: table_source_snapshot > Type: FLUSH > Table: table_source > Format: 0 > Created: 2014-01-30T13:05:02 > > Snapshot seems to be intact. What could be the error? Should I take an > offline snapshot instead? Going via restore/enable instead of clone does > not seem to work either. > > Also, I see the following in the region servers: > > 2:24:35.807 PM ERROR > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler > Failed open of > region= > table_source,\x82\x12Y\x00\xE98C\xEE\xBC\xCC\xE3h\xDAPt\xA6,1366259070788.63ca017ac7cd03e68c35a4da8b56421d., > starting to roll back the global memstore size. > java.io.IOException: java.io.IOException: java.io.FileNotFoundException: > Unable to open link: org.apache.hadoop.hbase.io.HFileLink > > locations=[hdfs://nameservice1/hbase/table_source/816bb88c6f3524a877f4cb7ce747fec1/t/c3b37dc11e684626a5b464a25a75735c, > > hdfs://nameservice1/hbase/.tmp/table_source/816bb88c6f3524a877f4cb7ce747fec1/t/c3b37dc11e684626a5b464a25a75735c, > > hdfs://nameservice1/hbase/.archive/table_source/816bb88c6f3524a877f4cb7ce747fec1/t/c3b37dc11e684626a5b464a25a75735c] > > None of these parts actually exist, however: > > hdfs://nameservice1/hbase/.snapshot/table_source_snapshot/816bb88c6f3524a877f4cb7ce747fec1/t/c3b37dc11e684626a5b464a25a75735c > does exist. > > I don't think that's the issue though, since I applied the same steps to a > smaller table and it worked. > > Any advice is appreciated, > > Regards, > > /David > --f46d0438959b6bd66e04f14458da--