hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marco Nicosia <ma...@yahoo-inc.com>
Subject Re: How do people keep their client configurations in sync with the remote cluster(s)
Date Thu, 15 May 2008 15:40:31 GMT
On 5/15/08 08:35, "Allen Wittenauer" <aw@yahoo-inc.com> wrote:
>> I'm thinking of looking at what it would take for a job submitter to ask
>> the tracker for its config data, to get things like the various
>> directory bases from the cluster, instead of being compiled into the
>> client. Then the management problem becomes one of keeping the cluster
>> configuration under control, which is a much easier proposition.
>     But I like this idea a lot.  The tricky part comes when clients really
> do need to modify something (# of mappers, heap size, whatever).

It may be too late in the process, but all of this configuration could be
included as fields in the job config?

   Marco Nicosia - Grid Services Ops
   Systems, Tools, and Services Group

View raw message