hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: Which config parameters are node-specific?
Date Wed, 20 Jan 2010 20:37:37 GMT

On 1/19/10 7:54 PM, "Amareshwari Sri Ramadasu" <amarsri@yahoo-inc.com>

> Hi Zhang,
> The following parameters are node specific.
>    mapred.tasktracker.map.tasks.maximum
>    mapred.tasktracker.reduce.tasks.maximum
>    tasktracker.http.threads
>    dfs.datanode.handler.count
> The rest of the parameters are Job-specific.

... Except for the ones that are namenode and jobtracker specific.


Hadoop configuration sucks greatly, and the lack of real documentation on
what parameters exist (it seems like every month there is a "new" hidden
param) and what actually uses them (i.e., where is final actually taking
into account?) doesn't help.

[ and no, *-default.xml and/or "read the source!" is not good enough.]

View raw message