Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 900DA115B4 for ; Mon, 15 Sep 2014 23:29:03 +0000 (UTC) Received: (qmail 80428 invoked by uid 500); 15 Sep 2014 23:29:01 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 80357 invoked by uid 500); 15 Sep 2014 23:29:01 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 80345 invoked by uid 99); 15 Sep 2014 23:29:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Sep 2014 23:29:01 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.220.171] (HELO mail-vc0-f171.google.com) (209.85.220.171) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Sep 2014 23:28:57 +0000 Received: by mail-vc0-f171.google.com with SMTP id im17so4155223vcb.16 for ; Mon, 15 Sep 2014 16:28:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=ywNZzRHyJkSjNOWkbBC6pgnqGYK6rPDp5woqTmm3zrQ=; b=aG56UzdKOXluc1UF9+9m/i7LO+QJBywjKqUlnKH1NO3roLNZ4dvWlLU2n4vI1B5xtg H+tnUnYVXA4cksqpbJzEyvK0ahinan2BZJgqwCxhqLG0mZw+RlLOIwpt+3YOjWuspq25 jU8vJLFJRrM5ufnKvyYAb+muk3GklbcsBkzLyWdtLs9ram5Jdzken+plTpak8xkYg/hr HsjnLqcRmPJQFUT7lHtx+NngLr5tBpnUB0qzGmQqd5KtC7EUIjjmWxePE9cZCzD35pbT ewboUXZ7/JBm6MmoBFmGUnyHyzkYl6GhWWgDFEiDB2wCa9mWcBBj6/qfLfYZv8YYZXIH 0zyA== X-Gm-Message-State: ALoCoQlL0Kyp1+cXmDX8uAMTU4MorIPxdQrGvAd0HQ3N1ZvSUhvvdi6SwAOz4XzH3q/QcJXtmG/Q X-Received: by 10.52.83.227 with SMTP id t3mr21740820vdy.20.1410823716033; Mon, 15 Sep 2014 16:28:36 -0700 (PDT) MIME-Version: 1.0 Received: by 10.52.100.227 with HTTP; Mon, 15 Sep 2014 16:28:15 -0700 (PDT) In-Reply-To: References: From: Jean-Marc Spaggiari Date: Mon, 15 Sep 2014 19:28:15 -0400 Message-ID: Subject: Re: Adding 64-bit nodes to 32-bit cluster? To: user Content-Type: multipart/alternative; boundary=001a11368e806f7005050322fec6 X-Virus-Checked: Checked by ClamAV on apache.org --001a11368e806f7005050322fec6 Content-Type: text/plain; charset=UTF-8 Do we have kind of native compression in PB? Or not at all? Because if so, it might be an issue. I run a 0.94 cluster with a mix of 32 and 64 with Snappy enabled. But never tried 0.96 or more on it... 2014-09-15 18:36 GMT-04:00 Andrew Purtell : > Only where we touch the native Hadoop libraries I think. If you have > specified compression implemented with a Hadoop native library, like > snappy or lzo, and have forgotten to deploy 64 bit native libraries, > and move to this 64 bit environment, you won't be able to open the > affected table(s) until native link issues are resolved. > > > On Mon, Sep 15, 2014 at 2:27 PM, Otis Gospodnetic > wrote: > > Hi Esteban, > > > > Sorry, I meant to point that out in my original email - yeah, heap sizes, > > Xmx, and such will be different for 32-bit and 64-bit servers, but I was > > wondering if there is anything in HBase that could complain if, say, a > > region written on a 32-bit server moves to a 64-bit server.... or > anything > > else of that sort that is HBase (or Hadoop) specific. > > > > Thanks, > > Otis > > -- > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > > Solr & Elasticsearch Support * http://sematext.com/ > > > > > > > > On Mon, Sep 15, 2014 at 5:19 PM, Esteban Gutierrez > > > wrote: > > > >> Well, many HBase internal limits are based on the architecture so that > >> should impact you right away in resource utilization in the RSs, so a > heap > >> or a setting that worked fine for your 32-bit RSs might need to be tuned > >> for a 64-bit environment. Probably might be easier to run a 32-bit JVM > in > >> the 64-bit boxes and phase out the old 32-bit nodes after you test for a > >> while in a couple of the 64-bit nodes new settings. > >> > >> cheers, > >> esteban, > >> > >> > >> -- > >> Cloudera, Inc. > >> > >> > >> On Mon, Sep 15, 2014 at 1:37 PM, Otis Gospodnetic < > >> otis.gospodnetic@gmail.com> wrote: > >> > >> > Hi, > >> > > >> > We are thinking of adding some new 64-bit servers to run > RegionServers to > >> > our 32-bit HBase cluster. Anything we should worry about or pay extra > >> > attention to? > >> > > >> > Thanks, > >> > Otis > >> > -- > >> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > >> > Solr & Elasticsearch Support * http://sematext.com/ > >> > > >> > > > > -- > Best regards, > > - Andy > > Problems worthy of attack prove their worth by hitting back. - Piet > Hein (via Tom White) > --001a11368e806f7005050322fec6--