Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5D68111A2C for ; Sat, 14 Jun 2014 15:36:34 +0000 (UTC) Received: (qmail 19082 invoked by uid 500); 14 Jun 2014 15:36:32 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 19004 invoked by uid 500); 14 Jun 2014 15:36:32 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 18993 invoked by uid 99); 14 Jun 2014 15:36:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 14 Jun 2014 15:36:32 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of kevin.odell@cloudera.com designates 209.85.217.169 as permitted sender) Received: from [209.85.217.169] (HELO mail-lb0-f169.google.com) (209.85.217.169) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 14 Jun 2014 15:36:30 +0000 Received: by mail-lb0-f169.google.com with SMTP id l4so2193457lbv.0 for ; Sat, 14 Jun 2014 08:36:06 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=V0E+3tBhzX5HyupyCLS+e1Q4h/qhryfCC2UltgKXzvE=; b=JGOekFWjZIH53ZvBQE+UWjTEWCcMsTZhDvCcK4CIQ4QPvXg+zVgHnCT18HTtI6ute0 QPouiUFak1AW/v9ULCebs49g3VDSH9vvq3jOeJi4kEVFyno6Ev6h71yd0V6EXE1qclyL 6fJswExk+vmTkbWvyS4/Yc4P/4ILAfoCwhDDLCs5OmOjR2M7KcrIbRJwWZuRgBBvewW4 sPQzP4Xaij5yJdMhQEFgORiVvf10qQM7rNA6KDmI3pst1I0gfH4zhpvosSNczUAYwSXY AlP4RkIaU5JXt880oGZv2uWM3OWlbS2RKpWlAqxq/rwzzRgBG31PGI/mo+tx/yv1wXh1 GV0w== X-Gm-Message-State: ALoCoQk8n+mS5Df39AAgrnBJGtc70axAUPKKCm+oJxt8KTJ7hF+xi6FbCXTDDHwJKDWY7qJYP5YI MIME-Version: 1.0 X-Received: by 10.113.3.139 with SMTP id bw11mr1503130lbd.63.1402760165755; Sat, 14 Jun 2014 08:36:05 -0700 (PDT) Received: by 10.112.135.130 with HTTP; Sat, 14 Jun 2014 08:36:05 -0700 (PDT) Received: by 10.112.135.130 with HTTP; Sat, 14 Jun 2014 08:36:05 -0700 (PDT) In-Reply-To: References: Date: Sat, 14 Jun 2014 11:36:05 -0400 Message-ID: Subject: Re: Does compression ever improve performance? From: "Kevin O'dell" To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001a1134945462a1a704fbcd8d00 X-Virus-Checked: Checked by ClamAV on apache.org --001a1134945462a1a704fbcd8d00 Content-Type: text/plain; charset=UTF-8 Hi Jeremy, I always recommend turning on snappy compression, I have ~20% performance increases. On Jun 14, 2014 10:25 AM, "Ted Yu" wrote: > You may have read Doug Meil's writeup where he tried out different > ColumnFamily > compressions : > > https://blogs.apache.org/hbase/ > > Cheers > > > On Fri, Jun 13, 2014 at 11:33 AM, jeremy p > > wrote: > > > Thank you -- I'll go ahead and try compression. > > > > --Jeremy > > > > > > On Fri, Jun 13, 2014 at 10:59 AM, Dima Spivak > > wrote: > > > > > I'd highly recommend it. In general, compressing your column families > > will > > > improve performance by reducing the resources required to get data from > > > disk (even when taking into account the CPU overhead of compressing and > > > decompressing). > > > > > > -Dima > > > > > > > > > On Fri, Jun 13, 2014 at 10:35 AM, jeremy p < > > athomewithagroovebox@gmail.com > > > > > > > wrote: > > > > > > > Hey all, > > > > > > > > Right now, I'm not using compression on any of my tables, because our > > > data > > > > doesn't take up a huge amount of space. However, I would turn on > > > > compression if there was a chance it would improve HBase's > performance. > > > By > > > > performance, I'm talking about the speed with which HBase responds to > > > > requests and retrieves data. > > > > > > > > Should I turn compression on? > > > > > > > > --Jeremy > > > > > > > > > > --001a1134945462a1a704fbcd8d00--