hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Bulk loading
Date Wed, 08 Apr 2015 15:00:29 GMT
You may have read http://hbase.apache.org/book.html#arch.bulk.load

bq. using TableOutputFormat from client makes my HBase stop working

Can you give us more information (hbase release, load on your cluster, log
snippet for crashed server, etc) ?

Thanks

On Wed, Apr 8, 2015 at 7:52 AM, Flavio Pompermaier <pompermaier@okkam.it>
wrote:

> Hi all,
>
> I have a non-mapreduce process  that produce a lot of data that I want to
> import into HBase through programmatically bulk loading because using
> TableOutputFormat from client makes my HBase stop working (too many writes
> in parallel I think).
>
> How can I create the necessary HFiles starting from my data (their name,
> size, etc) and then bulk load them into HBase programmatically? Do I need
> to use the ProtobufUtil.bulkLoadHFile or SecureBulkLoadClient, right?
>
> Best,
> Flavio
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message