Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of markq2011@gmail.com designates
 209.85.220.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=jFz8PnYoB2rzTrewN9Xw8nyzAFNZ5BL9c4GddiPlxbYQHcuvuPM/+kILuowXPC+YNx
         fP00SgSc42H3ycKrKz80ZGTOHFbM5/0B5FsU7YA3emCbZl4lDPSvCRJFETFID1/ccbGw
         2QymZSzNPkWZEbmROG67rSOfxVfwhQZmvYGxM=
MIME-Version: 1.0
In-Reply-To: <BANLkTinQaOMO=kQ5kmmRHq4=RLe6U=FObw@mail.gmail.com>
References: <BANLkTi=BBbm31LdV4Zbz3pmXK=2rTFC05Q@mail.gmail.com>
	<BANLkTikuiAB=sRc6nP2N0SL2BzeWbC_xkQ@mail.gmail.com>
	<BANLkTinQaOMO=kQ5kmmRHq4=RLe6U=FObw@mail.gmail.com>
Date: Wed, 8 Jun 2011 09:13:35 -0700
Message-ID: <BANLkTikDbdiCe6sDqDS78jA__mcZT7U=uA@mail.gmail.com>
Subject: Re: re-reading
From: Mark question <markq2011@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=90e6ba53aa1c56274404a5359e43

--90e6ba53aa1c56274404a5359e43
Content-Type: text/plain; charset=ISO-8859-1

Thanks for the replies, but input doesn't have 'clone' I don't know why ...
so I'll have to write my custom inputFormat ... I was hoping for an easier
way though.

Thank you,
Mark

On Wed, Jun 8, 2011 at 1:58 AM, Harsh J <harsh@cloudera.com> wrote:

> Or if that does not work for any reason (haven't tried it really), try
> writing your own InputFormat wrapper where in you can have direct
> access to the InputSplit object to do what you want to (open two
> record readers, and manage them separately).
>
> On Wed, Jun 8, 2011 at 1:48 PM, Stefan Wienert <stefan@wienert.cc> wrote:
> > Try input.clone()...
> >
> > 2011/6/8 Mark question <markq2011@gmail.com>:
> >> Hi,
> >>
> >>   I'm trying to read the inputSplit over and over using following
> function
> >> in MapperRunner:
> >>
> >> @Override
> >>    public void run(RecordReader input, OutputCollector output, Reporter
> >> reporter) throws IOException {
> >>
> >>   RecordReader copyInput = input;
> >>
> >>  //First read
> >>   while(input.next(key,value));
> >>
> >>  //Second read
> >>  while(copyInput.next(key,value));
> >>   }
> >>
> >> It can clearly be seen that this won't work because both RecordReaders
> are
> >> actually the same. I'm trying to find a way for the second reader to
> start
> >> reading the split again from beginning ... How can I do that?
> >>
> >> Thanks,
> >> Mark
> >>
> >
> >
> >
> > --
> > Stefan Wienert
> >
> > http://www.wienert.cc
> > stefan@wienert.cc
> >
> > Telefon: +495251-2026838
> > Mobil: +49176-40170270
> >
>
>
>
> --
> Harsh J
>

--90e6ba53aa1c56274404a5359e43--