hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Kendall <mkend...@justin.tv>
Subject Re: fair scheduler making jobs fail?
Date Mon, 30 Nov 2009 23:49:43 GMT
no dice...  and the default configuration from
http://hadoop.apache.org/common/docs/current/fair_scheduler.html
didn't work either.

On Mon, Nov 30, 2009 at 3:04 PM, Allen Wittenauer
<awittenauer@linkedin.com> wrote:
>
>
>
> On 11/30/09 2:59 PM, "Mike Kendall" <mkendall@justin.tv> wrote:
>
>> so i'm working on a cluster with one other guy and we decided to try
>> the fair scheduler but found that it caused all of our jobs to fail.
>>
>> has anyone else had this issue?  is there something more to the
>> configuration other than:
>
> You probably need:
>
> <property>
>  <name>mapred.fairscheduler.allocation.file</name>
>  <value>/some/path/fairshare-pools.xml</value>
> </property>
>
> ... and then put ...
>
> <?xml version="1.0"?>
> <allocations>
> </allocations>
>
>
> in fairshare-pools.xml.
>
>

Mime
View raw message