hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Niv Mizrahi <n...@taykey.com>
Subject Re: How do i customize the name of the job during submission?
Date Thu, 05 Jan 2012 18:06:50 GMT
just set the "mapred.*job*.*name*" in any config file.
but dont set it in the job.
many of the hadoop runners, receive as an argument

 -D mapred.*job*.*name=your-job*-name

Niv

On Thu, Jan 5, 2012 at 10:38 AM, ArunKumar <arunk786@gmail.com> wrote:

> Harsh,
>
> I need to run some set of jobs(with same input size and from same
> application) periodically say job1: Wordcount on 10 Gb, job2: Pi with 10000
> samples , job3 : Wordcount on 40 GB, etc.. and i want to analyze some
> things.
> For that i need to identify the job the consecutive time. It would be
> better if i had same ID irrespective of iteration for a particular job.
>
> If i have to specify a custom job 'name' via the regular JobConf/Job APIs i
> need to modify the example source code of Wordcount, Pi etc.in my case. I
> think it doesn't suite my needs.
>
> Can i do that setting job name part while submitting the job at terminal ?
> (or) Is there any alternative ?
>
>
> Arun
>
>
> On Wed, Jan 4, 2012 at 9:35 PM, Harsh J-2 [via Lucene] <
> ml-node+s472066n3632243h12@n3.nabble.com> wrote:
>
> > Arun,
> >
> > You can't change the job IDs. Why do you seek to do this though?
> >
> > You can, however, specify a custom job 'name' via the regular JobConf/Job
> > APIs.
> >
> > On 04-Jan-2012, at 9:31 PM, ArunKumar wrote:
> >
> > > Hi guys !
> > >
> > > When a Job is submitted it is given an ID say job_200904211745_0018 in
> > > Hadoop.
> > >
> > > But for some reason i want to submit it with ID say "job1". How can i
> do
> > > that ?
> > >
> > > Arun
> > >
> > > --
> > > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/How-do-i-customize-the-name-of-the-job-during-submission-tp3632228p3632228.html
> > > Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
> >
> >
> >
> > ------------------------------
> >  If you reply to this email, your message will be added to the discussion
> > below:
> >
> >
> http://lucene.472066.n3.nabble.com/How-do-i-customize-the-name-of-the-job-during-submission-tp3632228p3632243.html
> >  To unsubscribe from How do i customize the name of the job during
> > submission?, click here<
> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=3632228&code=YXJ1bms3ODZAZ21haWwuY29tfDM2MzIyMjh8NzA5NTc4MTY3
> >
> > .
> > NAML<
> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.InstantMailNamespace&breadcrumbs=instant+emails%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml
> >
> >
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/How-do-i-customize-the-name-of-the-job-during-submission-tp3632228p3634215.html
> Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
>



-- 
*Niv Mizrahi*
Taykey | www.taykey.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message