On Nov 22, 2013 12:54 AM, "anurag tangri&qu= ot; <anurag_tangri@yahoo.com<= /a>> wrote:

Here's step-by-step on how to= do this:
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

Here&#= 39;s step by step on how to do this:

1. Add following in mapred-site.xml:

=A0 <property>=A0=A0=A0 <name>mapred.fairscheduler.preemption</name>
=A0= =A0=A0 <final>true</final>
=A0=A0=A0 <value>true</v= alue>
=A0 </property>
=A0 <property>
=A0=A0=A0 <name>mapred.jobtracker.taskSchedul= er</name>=A0=A0
=A0=A0=A0 <final>true</final>
=A0= =A0=A0 <value>org.apache.hadoop.mapred.FairScheduler</value>=A0 </property>
=A0 <property>
=A0=A0=A0 <name>mapred.acls.enabled</name&= gt;
=A0=A0=A0 <final>true</final>
=A0=A0=A0 <value>true</value&g= t;
=A0 </property>
=A0=A0=A0 <property>
=A0=A0=A0 <= name>mapred.fairscheduler.allow.undeclared.pools</name>
=A0=A0= =A0 <final>true</final>
=A0=A0=A0 <value>false</value>
=A0 </property>
=A0 = <property>
=A0=A0=A0 <name>mapred.fairscheduler.poolnameprop= erty</name>
=A0=A0=A0 <final>true</final>
=A0=A0=A0= <value>ma= pred.job.queue.name</value>
=A0 </property>
=A0 <property>
=A0=A0=A0 <name>mapr= ed.fairscheduler.allocation.file</name>
=A0=A0=A0 <final>tru= e</final>
=A0=A0=A0 <value>/etc/hadoop/conf/allocations.xml&= lt;/value>
=A0 </property>
=A0 <property>
=A0=A0=A0 <name>mapred.queue.names</name><= br>=A0=A0=A0 <final>true</final>
=A0=A0=A0 <value>sqoo= p,default</value>
=A0 </property>
=A0 <property>=A0=A0=A0 <name>mapreduce.job.acl-view-job</name>
=A0=A0=A0 <final>true</final>
=A0=A0=A0 <value>*</v= alue>
=A0 </property>

2. Create mapred-queue-acls.xm= l in same dir as mapred-site.xml where you define all the queues:

&l= t;configuration>
=A0 <property>
=A0=A0=A0 <name>mapred.queue.sqoop.acl-submit= -job</name>
=A0=A0=A0 <value>usera, userb</value>
= =A0 </property>
=A0 <property>
=A0=A0=A0 <name>mapr= ed.queue.sqoop.acl-administer-jobs</name>
=A0=A0=A0 <value>usera, userc</value>
=A0 </property>
<! above two properties= for every queue defined in mapred-site.xml -->
</configuration>= ;

3. Define fair scheduler allocations file (location specified = in maped-site.xml) to use the queues defined and assign resources to them:<= br>
<?xml version=3D"1.0"?>
<allocations>
=A0 &= lt;defaultMinSharePreemptionTimeout>300</defaultMinSharePreemptionTim= eout>
=A0 <pool name=3D"sqoop">
=A0=A0=A0 <minM= aps>700</minMaps>
=A0=A0=A0 <minReduces>175</minReduces>
=A0=A0=A0 <maxRunn= ingJobs>25</maxRunningJobs>
=A0 </pool>
=A0 <pool n= ame=3D"default">
=A0=A0=A0 <minMaps>120</minMaps&g= t;
=A0=A0=A0 <minReduces>40</minReduces>
=A0=A0=A0 <maxRunningJobs>40</maxRunningJobs>
=A0 </pool&= gt;
=A0 <fairSharePreemptionTimeout>600</fairSharePreemptionTimeout></allocations>

4. After this, restart job tracker.

And your queues should be in place. You can then submit job to right = queue using
-Dmapred.job.qu= eue.name=3Dsqoop or default

And check the job going to actual q= ueue at the link:
http://<job tracker hostname>:50030/scheduler

Look at the property mapreduce.job.acl-view-job in mapred-site. Mea= ns anyone can view the jobs.

Try above and let us know any issue= s you still face.

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

=A0
Anurag Tangri

= Never wear your best trousers when you go out to fight for freedom and
t= ruth.- Henrik Ibsen

On Thursday, November 21, 2013 11:21 AM, anurag tangri <anurag_tangri@yahoo.com> wrote:

Hi Vis= wanathan,
What steps have you followed to set = fair scheduler ?

Thanks,
=A0Anurag Tangri

Never wear your best tro= users when you go out to fight for freedom and
truth.- He= nrik Ibsen

=

On Thursday, November 21, 2013 10:= 25 AM, Viswanathan J <jayamviswanathan@gmail.com> wrote:
=

Hi,

I'm running hadoop with 1.2.1, all my jobs are running in single q= ueue (Queue 1) only all the time. But I have configured default, queue 1&am= p;2.

Why jobs are not scheduled to all the queues.

Please help. Running like this will be any issue?

Thanks,