Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1E87B10B5A for ; Sun, 20 Oct 2013 02:32:50 +0000 (UTC) Received: (qmail 27753 invoked by uid 500); 20 Oct 2013 02:32:47 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 27673 invoked by uid 500); 20 Oct 2013 02:32:46 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 27665 invoked by uid 99); 20 Oct 2013 02:32:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 20 Oct 2013 02:32:45 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of vladrodionov@gmail.com designates 209.85.128.42 as permitted sender) Received: from [209.85.128.42] (HELO mail-qe0-f42.google.com) (209.85.128.42) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 20 Oct 2013 02:32:38 +0000 Received: by mail-qe0-f42.google.com with SMTP id gc15so2982723qeb.29 for ; Sat, 19 Oct 2013 19:32:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=ZBMiTjcWcD3WIBmuKqeF2KcxS5CumAX180Lcz01qIt0=; b=asNNVlOkjf+7IFosreThYhTMDTQu0g3W8aRYWpbeDQ4vtL3Fclp6bPmc+ss6JDgm4j CFvR1mkZ7IwzcwG/1cXKEP40Uq50WMW0Qx5vC1pWhal1mOwBXQDr9+0QHfoxF6Pk7X34 cXHOkD7UT2g/9mGq7ajcIABAjFrUyxdgdXakSHSziAsbhBSPq8qBrIrEvmcMscOyFyvF lRZxrH2JASMt+vZ9JWV6iFnkJQP9ryJ/6ABL/mtkHKFIhEKbzDFm2dXohEZaZC3QfxmQ 50etFRUlPz8WHbA6Tg81IE2zmNKak3lSer5zyL2z7WQHl7FwHl7yLarFE/DxbcN1X+Og jRIg== MIME-Version: 1.0 X-Received: by 10.224.36.201 with SMTP id u9mr14410230qad.76.1382236337826; Sat, 19 Oct 2013 19:32:17 -0700 (PDT) Received: by 10.49.51.105 with HTTP; Sat, 19 Oct 2013 19:32:17 -0700 (PDT) Date: Sat, 19 Oct 2013 19:32:17 -0700 Message-ID: Subject: Beware of PREFIX_TREE block encoding From: Vladimir Rodionov To: "dev@hbase.apache.org" Content-Type: multipart/alternative; boundary=001a11c1bd5ee971ac04e922f9c5 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c1bd5ee971ac04e922f9c5 Content-Type: text/plain; charset=ISO-8859-1 The scan performance is bad. 10 x slower on my tests than for blocks with NONE encoding. I scan data directly from block cache through StoreFileScanner (bypassing all StoreScanner/KeyValueHeap stuff). It should be clearly stated that this encoding degrades overall performance significantly in favor of data size reduction and is suitable only for Gets - not for Scans. Best regards, -Vladimir Rodionov - --001a11c1bd5ee971ac04e922f9c5--