Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id AC6A9200B43 for ; Tue, 19 Jul 2016 20:30:29 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id AB09A160A76; Tue, 19 Jul 2016 18:30:29 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id F2B11160A5C for ; Tue, 19 Jul 2016 20:30:28 +0200 (CEST) Received: (qmail 23497 invoked by uid 500); 19 Jul 2016 18:30:27 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 23476 invoked by uid 99); 19 Jul 2016 18:30:27 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Jul 2016 18:30:27 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id E3E3EC04FD for ; Tue, 19 Jul 2016 18:30:26 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.199 X-Spam-Level: * X-Spam-Status: No, score=1.199 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id F-fN674Lslzb for ; Tue, 19 Jul 2016 18:30:25 +0000 (UTC) Received: from mail-io0-f171.google.com (mail-io0-f171.google.com [209.85.223.171]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 4C1935FBE8 for ; Tue, 19 Jul 2016 18:30:24 +0000 (UTC) Received: by mail-io0-f171.google.com with SMTP id b62so26722329iod.3 for ; Tue, 19 Jul 2016 11:30:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to; bh=af65iMvjnLF+xLdU9xdIXtuI/5AII7u3v5Emefy3VLo=; b=hptEdDAV5W4iwHbaWdc11E4Po0KTuqPJ27IfC+0BkSU4SV74DmMAKdBTDS4Hi65waP kG3Arnqxxwfk8uGc27dBeR6DKhB0Sq85mNw/nvDUulwnY5sEwUAlmOhH+iYfif2n1Ixz Nr0lZq0NdfuLV8vB4AWn/0DgtWYtco3OBQRAJWTeRuDojxpFw4FoLkyDks0XACbvB+Dl +pqnzjAt+IvOYkmK+wojhAqBSNaFEkiS7cnQHfaSRpuTGk06mfavNS3O3SbOqs1AxLon j5ChOG4gAYXL7ag6zn/uHQpd5mcYRQg8FxHWqAtngn0bEtItDEHZR0KykmVExQF4AR/d 7xhg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=af65iMvjnLF+xLdU9xdIXtuI/5AII7u3v5Emefy3VLo=; b=mEptm+mtxZqZi1rIhpfMfqhY7HQnPsuOrd6CWUMoTr5rWtrOj1obQgogFp6ZxpdQru wRqp080qWKeXinKKuhUKsqbvM3S3opBzd9kOykodjoS+F+FBaSXwL5FNy9yL2evKXOXS hr+vdo2k/L76nIVXrbeUOKz6ijsbsr23GFGfthuNVMeWjrSsGX/H+UdqRs/Z4rUpnk09 UHTJQyeQ3gajMRC4WTgF+O1/kGsQSD0k38iAWDSBTL7eA2l9Hc62kHZ8WAjyBnsX05V6 OpdvPSmerx33ThvLitIGcQ/aEq/ORrlDrBBuVu9UkhV2AcE1wpmg3Bn0QeEay6rYrV/f gTkw== X-Gm-Message-State: ALyK8tIJ6JZ9RLJLKBYMnKAnEsFdH2b+JGFygcx/uiHqXu8Dxes7AKbQlqK0puPlOM9bbHNwaLn7jkBlwXWK5g== X-Received: by 10.107.3.65 with SMTP id 62mr46963851iod.140.1468953023057; Tue, 19 Jul 2016 11:30:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.64.60.199 with HTTP; Tue, 19 Jul 2016 11:30:22 -0700 (PDT) From: tombin Date: Tue, 19 Jul 2016 11:30:22 -0700 Message-ID: Subject: new base cluster help To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001a113fb55c2197fa05380147de archived-at: Tue, 19 Jul 2016 18:30:29 -0000 --001a113fb55c2197fa05380147de Content-Type: text/plain; charset=UTF-8 I am configuring a hbase cluster for the first time. The issue I am seeing is, when i setup a single server acting as master and region server, everything seems to be working fine. If i start region servers on 2 other boxes, in the base ui i see duplicate region servers. I have read that this can be normal, and base will eventually "sort things out". But this is showing the ip (with unknown version) and hostname (with correct base version), and showing an error of 2 nodes with inconsistent version. I also see an error on the UI that one of the regions is in transition and state=PENDING_OPEN. I looked at the logs files and see the following error: 2016-07-18 20:38:10,329 WARN [RS_OPEN_META-hb02:16020-0] zookeeper.ZKAssign: regionserver:16020-0x255e5cd7f190042, quorum= zk01.domain.com:2181,zk02.corp.lumsb.com:2181,zk03.domain.com:2181, baseZNode=/hbase Attempt to transition the unassigned node for 1588230740 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING failed, the server that tried to transition was 10.110.2.128,16020,1468874283476 not the expected hb02.domain.com,16020,1468874283476 This makes me think the duplicate error and the region transition errors may be related. I'm running the same hbase-site.xml on every node. I'm very confused why this just works with single server, but when i do extra servers, it fails. Any ideas? Thank you in advance. --001a113fb55c2197fa05380147de--