Mailing-List: contact user-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@crunch.apache.org
MIME-Version: 1.0
References: 
 <CAC+Ajq0DbA9yoL-G9wXCajuWJd_3yp4XXK-E=eDEomqenetscA@mail.gmail.com>
 <CAH29n6Pq3Zmzxoewz42N7kjYPc2WD3tmWODzEtiOiGCcnHLLYg@mail.gmail.com>
In-Reply-To: 
 <CAH29n6Pq3Zmzxoewz42N7kjYPc2WD3tmWODzEtiOiGCcnHLLYg@mail.gmail.com>
From: David Ortiz <dpo5003@gmail.com>
Date: Thu, 24 Sep 2015 19:12:15 +0000
Message-ID: 
 <CAC79LcZ5jJZ4DF7JX4dZZSPHqoJx0SCrD4BaVhspTXGfiBrZXg@mail.gmail.com>
Subject: Re: how to submit a crunch job to a specific queue
To: user@crunch.apache.org
Content-Type: multipart/alternative; boundary=001a113776b8de7ec205208302b8

--001a113776b8de7ec205208302b8
Content-Type: text/plain; charset=UTF-8

I find it easiest to set that parameter in the pipeline code, and make the
name a command line arg for my app

On Thu, Sep 24, 2015, 2:50 PM Josh Wills <jwills@cloudera.com> wrote:

> Lucy,
>
> Does your classname extend the CrunchTool abstract class or implement the
> Hadoop Tool interface and use ToolRunner.run(new Configuration(), new
> ClassName(), args) to execute the job in the main method? That's how those
> commandline args get parsed and passed in to the Configuration object.
>
> J
>
> On Thu, Sep 24, 2015 at 11:42 AM, Lucy Chen <lucychen2014fall@gmail.com>
> wrote:
>
>> Hi,
>>
>>     I am trying to configure my crunch job with a specific queue as
>> following:
>>
>>    hadoop jar my-crunch-app.jar classname
>> -Dmapreduce.job.queuename=queue_name
>>
>>    but it did not work, and the job was still submitted to the default
>> queue.
>>
>>     How can I change the queue name in either command line way or by
>> setting the job conf in my crunch codes?
>>
>>    Thanks!
>>
>> Lucy
>>
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>

--001a113776b8de7ec205208302b8
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">I find it easiest to set that parameter in the pipeline code=
, and make the name a command line arg for my app</p>
<br><div class=3D"gmail_quote"><div dir=3D"ltr">On Thu, Sep 24, 2015, 2:50 =
PM=C2=A0Josh Wills &lt;<a href=3D"mailto:jwills@cloudera.com">jwills@cloude=
ra.com</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"m=
argin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"l=
tr">Lucy,<div><br></div><div>Does your classname extend the CrunchTool abst=
ract class or implement the Hadoop Tool interface and use ToolRunner.run(ne=
w Configuration(), new ClassName(), args) to execute the job in the main me=
thod? That&#39;s how those commandline args get parsed and passed in to the=
 Configuration object.</div><div><br></div><div>J</div></div><div class=3D"=
gmail_extra"></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote=
">On Thu, Sep 24, 2015 at 11:42 AM, Lucy Chen <span dir=3D"ltr">&lt;<a href=
=3D"mailto:lucychen2014fall@gmail.com" target=3D"_blank">lucychen2014fall@g=
mail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=
=3D"ltr">Hi,<div><br></div><div>=C2=A0 =C2=A0 I am trying to configure my c=
runch job with a specific queue as following:</div><div><br></div><div>=C2=
=A0 =C2=A0hadoop jar my-crunch-app.jar classname -Dmapreduce.job.queuename=
=3Dqueue_name</div><div><br></div><div>=C2=A0 =C2=A0but it did not work, an=
d the job was still submitted to the default queue.</div><div><br></div><di=
v>=C2=A0 =C2=A0 How can I change the queue name in either command line way =
or by setting the job conf in my crunch codes?</div><div><br></div><div>=C2=
=A0 =C2=A0Thanks!</div><span><font color=3D"#888888"><div><br></div><div>Lu=
cy</div></font></span></div>
</blockquote></div><br><br clear=3D"all"><div><br></div></div><div class=3D=
"gmail_extra">-- <br><div><div>Director of Data Science</div><div><a href=
=3D"http://www.cloudera.com" target=3D"_blank">Cloudera</a></div><div>Twitt=
er: <a href=3D"http://twitter.com/josh_wills" target=3D"_blank">@josh_wills=
</a></div></div>
</div></blockquote></div>

--001a113776b8de7ec205208302b8--