hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Laurent H <laurent.hat...@gmail.com>
Subject Re: Compaction after bulk-load
Date Thu, 30 Jul 2015 13:52:50 GMT
It's a very big treatment "Major Compaction". We use bulk loading and we've
put one major at 2 A.M and it rocks !

--
Laurent HATIER - Consultant Big Data & Business Intelligence chez CapGemini
fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
<http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>

2015-07-30 10:51 GMT+02:00 奥伯莱恩 <flykos@163.com>:

> major compaction will cleanup deleted data and merge HFiles into one file
> . Maybe it's not needed .
> At 2015-07-30 07:23:02, "Krishna" <research800@gmail.com> wrote:
> >Hi,
> >
> >I am planning to bulk-load about 10 TB of data to a table pre-split with
> >30 regions with max region file size configured to 10 GB.
> >
> >Is it recommended that I run a major compaction when bulk-loading
> finishes? How
> >many HFiles does the reducer create?
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message