hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yih Sun Khoo" <ysk...@gmail.com>
Subject Re: Passing Constants from One Job to the Next
Date Wed, 22 Oct 2008 22:03:33 GMT
Are you saying that I can pass, say, a single integer constant with either
of these three: JobConf? A HDFS file? DistributedCache?
Or are you asking if I can pass given the context of: JobConf? A HDFS file?
I'm thinking of how to pass a single int so from one Jobconf to the next

On Wed, Oct 22, 2008 at 2:57 PM, Arun C Murthy <acm@yahoo-inc.com> wrote:

> On Oct 22, 2008, at 2:52 PM, Yih Sun Khoo wrote:
>  I like to hear some good ways of passing constants from one job to the
>> next.
> Unless I'm missing something: JobConf? A HDFS file? DistributedCache?
> Arun
>> These are some ways that I can think of:
>> 1)  The obvious solution is to carry the constant as part of your value
>> from
>> one job to the next, but that would mean every value would hold that
>> constant
>> 2)  Use the reporter as a hack so that you can set the status message and
>> then get the status message back when u need the constant
>> Any other ideas?  (Also please do not include code)

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message