Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D27719AF0 for ; Tue, 31 Jan 2012 00:05:36 +0000 (UTC) Received: (qmail 10719 invoked by uid 500); 31 Jan 2012 00:05:36 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 10557 invoked by uid 500); 31 Jan 2012 00:05:36 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 10549 invoked by uid 99); 31 Jan 2012 00:05:35 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 31 Jan 2012 00:05:35 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 31 Jan 2012 00:05:33 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 8B10D16E9C1 for ; Tue, 31 Jan 2012 00:05:12 +0000 (UTC) Date: Tue, 31 Jan 2012 00:05:12 +0000 (UTC) From: "dhruba borthakur (Created) (JIRA)" To: issues@hbase.apache.org Message-ID: <1050025870.9834.1327968312571.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Created] (HBASE-5303) Separate out rows into multiple files during compaction for better block cache utilization MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Separate out rows into multiple files during compaction for better block cache utilization ------------------------------------------------------------------------------------------ Key: HBASE-5303 URL: https://issues.apache.org/jira/browse/HBASE-5303 Project: HBase Issue Type: Improvement Components: regionserver Reporter: dhruba borthakur Assignee: dhruba borthakur This seems odd at first sight, a compaction is supposed to reduce the number of files. But there is great advantage to creating hbase blocks where adjacent keys are accessed together. One approach would be to make compaction write out hot-rows into one file and the cold-rows into another file. This increases the efficiency of the block cache because only the blocks in the hot-rows file will most frequently be populated in the block cache. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira