Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4FC8DD14A for ; Fri, 10 Aug 2012 21:22:42 +0000 (UTC) Received: (qmail 22220 invoked by uid 500); 10 Aug 2012 21:22:40 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 22167 invoked by uid 500); 10 Aug 2012 21:22:40 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 22154 invoked by uid 99); 10 Aug 2012 21:22:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Aug 2012 21:22:40 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FSL_RCVD_USER,HS_INDEX_PARAM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.160.41] (HELO mail-pb0-f41.google.com) (209.85.160.41) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Aug 2012 21:22:33 +0000 Received: by pbbro12 with SMTP id ro12so3758312pbb.14 for ; Fri, 10 Aug 2012 14:22:12 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:to:message-id:subject:x-mailer:mime-version:content-type :x-gm-message-state; bh=US1XaQ1AWt+9gghDKAVlB4toPrWtjFgbLL7n/6OH2ns=; b=JVrqOf6K+Q93eXDYNIKud6N/8OSB94LDBQEB+Ij373Pp4zRDAuGC2RSIZwD4uJVbUS rXmXD46bNzV9mJxz8ufIHlYkmAqWR1vHrz50fuj22hy3ZxPtiVwNmoTKjtHhS8FwMrb4 kkaEzCJ5OFeniS/w+pN76vLhzA6t6KxOK0NIlQu5s85m4RaqW7yifehnGSxulqz2IvVD 10OOJ5v4gqh5zQMSIZ+f5/JXJdBIq2SJ7qwppGOk+LwFdV+Lz2xRgAo1qq/D4Q0jw9YF t2/p9DS1+7zAMc1/im/qo0gS+g64bXakvhYLzUxWVBs6prdT5ERpM1QRMpulUvl/2k6c 3oHw== Received: by 10.68.216.104 with SMTP id op8mr620040pbc.65.1344633731960; Fri, 10 Aug 2012 14:22:11 -0700 (PDT) Received: from [192.168.1.9] (c-98-248-222-154.hsd1.ca.comcast.net. [98.248.222.154]) by mx.google.com with ESMTPS id gf7sm4033961pbc.65.2012.08.10.14.22.08 (version=SSLv3 cipher=OTHER); Fri, 10 Aug 2012 14:22:09 -0700 (PDT) Date: Fri, 10 Aug 2012 14:22:07 -0700 From: Marco Gallotta To: user@hbase.apache.org Message-ID: <337C6F38C62740D5BB5893CA2B2F9D0A@gallotta.co.za> Subject: Table listed in "list", but not in .META. X-Mailer: sparrow 1.6.3 (build 1164) MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="50257b7f_2a487cb0_92" X-Gm-Message-State: ALoCoQkRAiGkGapr3/8QHBwvg0JZPLyUwZvDo8l0izytqaO/B1LS5hGwd6MTWyb9BNJGajSuBnrQ --50257b7f_2a487cb0_92 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi there I have a few tables which show up in a "list" in the shell, but produce "table not found" when performing any operation on them. There is no reference of them in the .META. table. It seems to be resulting in some of the hbase services being killed every so often. Here are some logs from master (foo is one of the tables not found): 2012-08-09 20:40:44,301 FATAL org.apache.hadoop.hbase.master.HMaster: Master server abort: loaded coprocessors are: [] 2012-08-09 20:40:44,301 FATAL org.apache.hadoop.hbase.master.HMaster: Unexpected state : foo,,1343175078663.527bb34f4bb5e40dd42e82054d7c5485. state=PENDING_OPEN, ts=1344570044277, server=ip-10-170-150-10.us-west-1.compute.internal,60020,1344559455110 .. Cannot transit it to OFFLINE. There are also a number of the following types of error logs: 2012-08-09 20:10:04,308 ERROR org.apache.hadoop.hbase.master.AssignmentManager: Failed assignment in: ip-10-170-150-10.us-west-1.compute.internal,60020,1344559455110 due to org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: Received:OPEN for the region:foo,,1343175078663.527bb34f4bb5e40dd42e82054d7c5485. ,which we are already trying to OPEN. Any ideas how to find and remove any references to these non-existent tables? -- Marco Gallotta | Mountain View, California Software Engineer, Infrastructure | Loki Studios fb.me/marco.gallotta | twitter.com/marcog marco@gallotta.co.za | +1 (650) 417-3313 Sent with Sparrow (http://www.sparrowmailapp.com/?sig) --50257b7f_2a487cb0_92--