hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jim Kellerman <...@powerset.com>
Subject RE: [jira] Created: (HADOOP-2616) hbase not spliting when the total size of region reaches max region size * 1.5
Date Tue, 15 Jan 2008 22:51:11 GMT
We do not need to split unless any one column is over the threshold.

---
Jim Kellerman, Senior Engineer; Powerset


> -----Original Message-----
> From: Billy Pearson (JIRA) [mailto:jira@apache.org]
> Sent: Tuesday, January 15, 2008 2:46 PM
> To: hadoop-dev@lucene.apache.org
> Subject: [jira] Created: (HADOOP-2616) hbase not spliting
> when the total size of region reaches max region size * 1.5
>
> hbase not spliting when the total size of region reaches max
> region size * 1.5
> --------------------------------------------------------------
> ----------------
>
>                  Key: HADOOP-2616
>                  URL:
> https://issues.apache.org/jira/browse/HADOOP-2616
>              Project: Hadoop
>           Issue Type: Bug
>           Components: contrib/hbase
>             Reporter: Billy Pearson
>             Priority: Minor
>              Fix For: 0.17.0
>
>
> right now a region may get larger then the max size set in the conf
>
> HRegion.needsSplit
>
> Checks the largest column to see if its larger then max
> region size * 1.5 and then desides to split or not
>
> But  if we have more then one column the region could be vary
> large example
>
> Say we have 10 columns all about the same size lets say 40MB
> and the max file size is 64MB we would not split even thought
> the region size is 400MB well over the 96MB needed to trip a
> split to happen.
>
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>
> No virus found in this incoming message.
> Checked by AVG Free Edition.
> Version: 7.5.516 / Virus Database: 269.19.2/1224 - Release
> Date: 1/14/2008 5:39 PM
>
>

No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.5.516 / Virus Database: 269.19.2/1224 - Release Date: 1/14/2008 5:39 PM


Mime
View raw message