hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bharath vissapragada <bharathvissapragada1...@gmail.com>
Subject Re: Some issues!
Date Sat, 05 Sep 2009 02:29:10 GMT
Amogh , thanks for yout reply.

I will make my question more clear ,

Suppose I have an array and it got updated in the MRjob1 . and i want to
access it in MRjob2 . This is what i intended in my previous question . I
have gone through the JobConf class , but i haven't found anything useful .
If  Iam wrong , kindly point me to the correct methods. .

Thanks

On Fri, Sep 4, 2009 at 9:26 PM, Amogh Vasekar <amogh@yahoo-inc.com> wrote:

> Have a look at jobclient, it should suffice.
>
> Cheers!
> Amogh
>
> -----Original Message-----
> From: bharath vissapragada [mailto:bharathvissapragada1990@gmail.com]
> Sent: Friday, September 04, 2009 9:15 PM
> To: common-user@hadoop.apache.org
> Subject: Re: Some issues!
>
> Hey ,
>
> I have one more doubt , Suppose I have some cascading mapred jobs and
> suppose some data which was collected in
> MRjob1 is to be used in MRjob2 m is there any way?
>
> Thanks
>
> On Fri, Sep 4, 2009 at 1:54 PM, Amandeep Khurana <amansk@gmail.com> wrote:
>
> > Or you can output the data in the keys and NullWritable as the value.
> > That ways you'll get only unique data...
> >
> > On 9/4/09, zhang jianfeng <zjffdu@gmail.com> wrote:
> > > Hi Sugandha ,
> > >
> > > If you only want to the value, you need to set the key as NullWritable
> in
> > > reduce.
> > >
> > > e.g.
> > > output.collect(NullWritable.get(), value);
> > >
> > >
> > >
> > > On Fri, Sep 4, 2009 at 12:46 AM, Sugandha Naolekar
> > > <sugandha.n87@gmail.com>wrote:
> > >
> > >> Hello!
> > >>
> > >>        Running a simple MR job, and setting a replication factor of 2.
> > >> Now,
> > >> after its execution, the output is split in files named as part-00000
> > and
> > >> so
> > >> on. I want to ask is, can't we avoid these keys or key values to get
> > >> printed
> > >> in output files? I mean, I am getting the output in the files in
> > key-value
> > >> pair. I want just the data and not the keys(integers) in it.
> > >>
> > >>
> > >>
> > >>
> > >> --
> > >> Regards!
> > >> Sugandha
> > >>
> > >
> >
> >
> > --
> >
> >
> > Amandeep Khurana
> > Computer Science Graduate Student
> > University of California, Santa Cruz
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message