hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: HBase bulk loader doing speculative execution when it set to false in mapred-site.xml
Date Fri, 30 Mar 2012 22:12:19 GMT
Well that's not an HBase configuration, that's Hadoop. I'm not sure if
this is listed anywhere, maybe in the book.

BTW usually HBase has a "client" somewhere in the same to indicate
it's client side.

J-D

On Fri, Mar 30, 2012 at 3:08 PM, anil gupta <anilgupt@buffalo.edu> wrote:
> Thanks for the quick reply, Jean. Is there any link where i can find the
> name of all client-side configuration for HBase?
>
> ~Anil
>
> On Fri, Mar 30, 2012 at 3:01 PM, Jean-Daniel Cryans <jdcryans@apache.org>wrote:
>
>> This is a client-side configuration so if your mapred-site.xml is
>> _not_ on your classpath when you start the bulk load, it's not going
>> to pick it up. So either have that file on your classpath, or put it
>> in whatever other configuration file you have.
>>
>> J-D
>>
>> On Fri, Mar 30, 2012 at 2:52 PM, anil gupta <anilgupta84@gmail.com> wrote:
>> > Hi All,
>> >
>> > I am using cdh3u2. I ran HBase bulk loading with property
>> > "mapred.reduce.tasks.speculative.execution" set to "false" in
>> > mapred-site.xml. Still, i can see 6 killed task in Bulk Loading job and
>> > after short analysis i realized that these jobs are killed because
>> another
>> > worker node completed the task, hence it means that speculative execution
>> > is still on. Why the HBase Bulk loader is doing speculative execution
>> when
>> > i have set it to false in mapred-site.xml? Please let me know if i am
>> > missing something over here.
>> >
>> > --
>> > Thanks & Regards,
>> > Anil Gupta
>>
>
>
>
> --
> Thanks & Regards,
> Anil Gupta

Mime
View raw message