Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E00E210536 for ; Wed, 12 Jun 2013 15:15:08 +0000 (UTC) Received: (qmail 86692 invoked by uid 500); 12 Jun 2013 15:15:06 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 86665 invoked by uid 500); 12 Jun 2013 15:15:05 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 86657 invoked by uid 99); 12 Jun 2013 15:15:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Jun 2013 15:15:05 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [72.30.238.202] (HELO nm37-vm2.bullet.mail.bf1.yahoo.com) (72.30.238.202) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Jun 2013 15:14:56 +0000 Received: from [98.139.212.151] by nm37.bullet.mail.bf1.yahoo.com with NNFMP; 12 Jun 2013 15:14:34 -0000 Received: from [98.139.215.228] by tm8.bullet.mail.bf1.yahoo.com with NNFMP; 12 Jun 2013 15:14:34 -0000 Received: from [127.0.0.1] by omp1068.mail.bf1.yahoo.com with NNFMP; 12 Jun 2013 15:14:34 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 349588.22721.bm@omp1068.mail.bf1.yahoo.com Received: (qmail 3187 invoked by uid 60001); 12 Jun 2013 15:14:34 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1371050074; bh=3T78pnjT2XKrEMLbhmmBCGDvJiWfpyXTm++51O8etbg=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type; b=V5pq2Ej1jYSntLUlrwhMVC06yv586lbAxXzR6TupNPPtx5hhxKOeFR4dFaMWEppD5gd6w1agt/rlAg9vHeZ/eNVGKIFLWbfIIwc5P4u8ChgverRsdAh3r7R9n63dvdKQ8Ne4jXZAWUvdMLAf1XfdZ6FEvsuZXBKx9OzJkb9yyvQ= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type; b=WXduwj1xIzTRLQy+af7RwO8ZU1NA1PNX0KsCGvZEMcA4cU60VAnA3Iw9thsfqO9ew07Ch/AgnMehdSRu8Cjet4HIT0KwdpayIeJeTR2XN+6WSBlyL/ErVNqE0Ex2XTnXXQs+kFvHqbFbS9KUpV9YhlkmYFgdx4Vr9SwKCfObaUc=; X-YMail-OSG: o7pSEF8VM1luMSr3xN1F.spvO_li282Q2EYjDBN7nFg7VlU w_H.bf8t44yBFCRpRV.eQ6C_eagcSGqrEicoPs_gVpF7I7sPoc64qJxzvwCw v_0KsjjbXZRcaTvPzV16qnvftwFjHfKUeGnzQdfqZR7sHwZGDupnzqcpYitA N2ltr4ruxmpx__WO6_Lv7p7TMTObwuNlKiIcAppzsNG5eGwGeMaTqxMG4T9d vNZf2suJFtyrLnT.jOtRXblRNEIsaTmQ3JykKR3JgDtkDb7TPsuvJ_9d0PKq a9U7o5vsY0KQ5uRV0_Y1Sz.E6aVT4Y2zf3ZBM76iqnkl94jBeZp0ZwxnQhqj yxV9prJ0_0iBHKZ7HpwKbeM_gP0Z05pNwFmJ60pAUSHH7Rvmfg.06SBm4Kxi JFjkHyS8KRrVEyuWk4Wg.qF4pGwUX05RoxBkvnSvO29EdaaDe2irc97LS6eY MwzsDI9DHxPSXshEpwonNB8df4kuWNHNiDrDOHUoL9HjHbU9y9zqrvWlp_uZ ro_4R8iWEC0bJk0XiTBWbkk9iFTzzBes- Received: from [24.5.86.198] by web162404.mail.bf1.yahoo.com via HTTP; Wed, 12 Jun 2013 08:14:34 PDT X-Rocket-MIMEInfo: 002.001,SGVsbG8sCkkgYW0gdHJ5aW5nIHRvIHVuZGVyc3RhbmQgdGhlIGRvd25zaWRlcyBvZiBoYXZpbmcgYSBsYXJnZSBudW1iZXIgb2YgaGZpbGVzIGJ5IGhhdmluZyBhIGxhcmdlwqBoYmFzZS5oc3RvcmUuY29tcGFjdGlvblRocmVzaG9sZAoKwqAgVGhpcyBkZWxheXMgbWFqb3IgY29tcGFjdGlvbi4gSG93ZXZlciwgdGhlIGFtb3VudCBvZiBkYXRhIHRoYXQgbmVlZHMgdG8gYmUgcmVhZCBhbmQgcmUtd3JpdHRlbiBhcyBhIHNpbmdsZSBoZmlsZSBkdXJpbmcgbWFqb3IgY29tcGFjdGlvbiB3aWxsIHJlbWFpbiB0aGUBMAEBAQE- X-Mailer: YahooMailWebService/0.8.146.552 Message-ID: <1371050074.79458.YahooMailNeo@web162404.mail.bf1.yahoo.com> Date: Wed, 12 Jun 2013 08:14:34 -0700 (PDT) From: Rahul Ravindran Reply-To: Rahul Ravindran Subject: Downside of too many HFiles To: "user@hbase.apache.org" MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="736800001-28581649-1371050074=:79458" X-Virus-Checked: Checked by ClamAV on apache.org --736800001-28581649-1371050074=:79458 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Hello,=0AI am trying to understand the downsides of having a large number o= f hfiles by having a large=A0hbase.hstore.compactionThreshold=0A=0A=A0 This= delays major compaction. However, the amount of data that needs to be read= and re-written as a single hfile during major compaction will remain the s= ame unless we have large number of deletes or expired rows=0A=0AI understan= d the random reads will be affected since each hfile may be a candidate for= the row, but is there any other downside I am missing?=0A=0A=0A~Rahul. --736800001-28581649-1371050074=:79458--