crunch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Ortiz <dpo5...@gmail.com>
Subject Re: how to submit a crunch job to a specific queue
Date Thu, 24 Sep 2015 19:12:15 GMT
I find it easiest to set that parameter in the pipeline code, and make the
name a command line arg for my app

On Thu, Sep 24, 2015, 2:50 PM Josh Wills <jwills@cloudera.com> wrote:

> Lucy,
>
> Does your classname extend the CrunchTool abstract class or implement the
> Hadoop Tool interface and use ToolRunner.run(new Configuration(), new
> ClassName(), args) to execute the job in the main method? That's how those
> commandline args get parsed and passed in to the Configuration object.
>
> J
>
> On Thu, Sep 24, 2015 at 11:42 AM, Lucy Chen <lucychen2014fall@gmail.com>
> wrote:
>
>> Hi,
>>
>>     I am trying to configure my crunch job with a specific queue as
>> following:
>>
>>    hadoop jar my-crunch-app.jar classname
>> -Dmapreduce.job.queuename=queue_name
>>
>>    but it did not work, and the job was still submitted to the default
>> queue.
>>
>>     How can I change the queue name in either command line way or by
>> setting the job conf in my crunch codes?
>>
>>    Thanks!
>>
>> Lucy
>>
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>

Mime
View raw message