hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonal Goyal <sonalgoy...@gmail.com>
Subject Re: Hbase import Tsv performance (slow import)
Date Wed, 24 Oct 2012 11:18:17 GMT
Hi Nick,

Do you see anything in your tasktracker or datanode logs?

Best Regards,
Sonal
Crux: Reporting for HBase <https://github.com/sonalgoyal/crux>
Nube Technologies <http://www.nubetech.co>

<http://in.linkedin.com/in/sonalgoyal>





On Wed, Oct 24, 2012 at 3:45 PM, Nick maillard <
nicolas.maillard@fifty-five.com> wrote:

> As I have written in a reply above but that is kind of lost in the tread:
>
> I have set dfs.replication at 2 but this process time has not changed at
> all.
> How could I change my configuration to avoid this hotspot issue you have
> talked
> about.
>
> As Kevin has advised I have also upped:
> hbase.hstore.blockingStoreFiles to 100
> hbase.hregion.memstore.block.multiplier to 7
> hbase.hregion.memstore.flush.size to 256 MB
> hbase.regionserver.optionallogflushinterval to 30s
>
> These changes did not bring any significant evolution in speed.
>
> My cluster is 3 ubuntu machines:
>  2 cores 4 threads 3.4+ GHz with 16gb ram
>
> thanks for everyones help
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message