hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Bishop <jbishop....@gmail.com>
Subject Re: What is the preferred way to pass a small number of configuration parameters to a mapper or reducer
Date Sun, 30 Dec 2012 19:08:54 GMT
Nagarjuna,

Can you explain in more detail - what is the cost of using hbase as a
configuration storage for MR jobs, say if there are many of them.

Jon


On Sun, Dec 30, 2012 at 11:02 AM, nagarjuna kanamarlapudi <
nagarjuna.kanamarlapudi@gmail.com> wrote:

> Only if u have few mappers and reducers
>
>
> On Monday, December 31, 2012, Jonathan Bishop wrote:
>
>> E. Store them in hbase...
>>
>>
>> On Sun, Dec 30, 2012 at 12:24 AM, Hemanth Yamijala <
>> yhemanth@thoughtworks.com> wrote:
>>
>> If it is a small number, A seems the best way to me.
>>
>> On Friday, December 28, 2012, Kshiva Kps wrote:
>>
>>
>> Which one is current ..
>>
>>
>> What is the preferred way to pass a small number of configuration
>> parameters to a mapper or reducer?
>>
>>
>>
>>
>>
>> *A.  *As key-value pairs in the jobconf object.
>>
>> * *
>>
>> *B.  *As a custom input key-value pair passed to each mapper or reducer.
>>
>> * *
>>
>> *C.  *
>>
>>
>
> --
> Sent from iPhone
>

Mime
View raw message