Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 76DED10EF8 for ; Tue, 25 Feb 2014 08:47:16 +0000 (UTC) Received: (qmail 86052 invoked by uid 500); 25 Feb 2014 08:47:12 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 85622 invoked by uid 500); 25 Feb 2014 08:47:11 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 85613 invoked by uid 99); 25 Feb 2014 08:47:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Feb 2014 08:47:10 +0000 X-ASF-Spam-Status: No, hits=3.1 required=5.0 tests=HTML_IMAGE_ONLY_24,HTML_MESSAGE,HTML_SHORT_LINK_IMG_3,RCVD_IN_DNSWL_LOW,SPF_PASS,T_REMOTE_IMAGE X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of bharathv@cloudera.com designates 74.125.82.47 as permitted sender) Received: from [74.125.82.47] (HELO mail-wg0-f47.google.com) (74.125.82.47) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Feb 2014 08:47:05 +0000 Received: by mail-wg0-f47.google.com with SMTP id n12so68350wgh.18 for ; Tue, 25 Feb 2014 00:46:44 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=pKatUpNvhazr0NkvEjWOxqsyfUWjvfh8UG3Db5F/WO4=; b=O3QzZVdMDdJNBvKpBELyi20mTxLarnG+9EL7INOJJD1QCubvEnXFROVlsZycG0IqvL ke+DoPpSKvzcWaPUtbCxVOsYjOZAAfExzXn0mHyBUSP1PFKCuQeQTgS47b3JRLroU5aC BXJSM9L9KS/gJiIlW2pHfTvT01Gqk8dusCTA2xwgBa87eCJvSrBsd9bAKCV1MG6qdaRz bFDIa0/ab3hbuVEiYqA7FnnOB2rbjtqM9S/p73/5FmlC9ZkRaJdyGUT1pifCVhbbXoAA ntYhE9nsE8IkiZ4q2M0dfIDIHEN2mcSKlThEj03xSLgVViTjxXw1YMEXVDYYO7FBwe26 qk+Q== X-Gm-Message-State: ALoCoQlipyK5aaWiaf3Zn5/el8/Wy3lozggsF5zst3g1uYHSL3HnbAB9MpWlBAniv+PJKNs2th5O X-Received: by 10.180.207.15 with SMTP id ls15mr1452738wic.50.1393318004662; Tue, 25 Feb 2014 00:46:44 -0800 (PST) MIME-Version: 1.0 Received: by 10.227.100.69 with HTTP; Tue, 25 Feb 2014 00:46:24 -0800 (PST) In-Reply-To: References: From: Bharath Vissapragada Date: Tue, 25 Feb 2014 14:16:24 +0530 Message-ID: Subject: Re: Is hbase call delete request for old hfile(storeFile) file if minor/major compaction happen for them To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001a11c33b66ba466904f3372013 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c33b66ba466904f3372013 Content-Type: text/plain; charset=ISO-8859-1 Not sure what you are asking but if you want to know the size of a store file, you can use this method, https://github.com/apache/hbase/blob/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java#L1440 One such usage is here, https://github.com/apache/hbase/blob/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/RatioBasedCompactionPolicy.java#L292 It gets the sizes of all the store files, I believe thats what you are asking! Please correct me if I'm wrong, On Tue, Feb 25, 2014 at 12:37 PM, Upendra Yadav wrote: > Is hbase call delete request for old hfile(storeFile) file if minor/major > compaction happen for them and generate new hfile and store it in hdfs. > > for minor compaction how it will get size of every hfile. lets we have 20 > no. of hfiles for a CF and minor compaction wants to perform. Will it > download all hfile and decide compaction have to do or not. Or it have > in-memory hfile's size information for all hfile. > -- Bharath Vissapragada --001a11c33b66ba466904f3372013--