Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@accumulo.apache.org
Received-SPF: pass (nike.apache.org: domain of cjnolet@gmail.com designates
 209.85.223.177 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAJbywzkXW8Z=pGtF6bDYE2AQHEAOobN1ztt1ZAR6KMRBNxSdCw@mail.gmail.com>
References: 
 <CAJbywzkXW8Z=pGtF6bDYE2AQHEAOobN1ztt1ZAR6KMRBNxSdCw@mail.gmail.com>
Date: Mon, 16 Sep 2013 15:55:23 -0400
Message-ID: 
 <CAOHP_tGe7gF306y2te_RA9-sr_1=5NX4DEwhxqbvq1ftZehydw@mail.gmail.com>
Subject: Re: Using Hadoop's MulitpleInputs with AccumuloInputFormat in a MR
 job
From: Corey Nolet <cjnolet@gmail.com>
To: user@accumulo.apache.org
Content-Type: multipart/alternative; boundary=047d7bd75920b478a204e68595a8

--047d7bd75920b478a204e68595a8
Content-Type: text/plain; charset=ISO-8859-1

Aaron,

We are currently re-working the AccumuloInputFormat for Accumulo 1.6 to
provide inputs from multiple tables (each with their own set of configured
iterators, ranges, columns). Check out ACCUMULO-391.


On Mon, Sep 16, 2013 at 11:41 AM, Aaron <aarongmldt@gmail.com> wrote:

> I was curious if this is possible (i am thinking it isn't):  from the Java
> API, Accumulo 1.5, Hadoop 1.2.1
>
> Want to set 2 different iterators on a scan, and send those results to 2
> different Mappers.
>
> So, how'd i do this with files as inputs, is just to use MultipleInputs
> class, with 2 different Path, and 2 different Mapper Classes, maybe the
> same InputFormat (e.g Text or Sequence)
>
> Since I'm using AccumulInputFormat, I would think I'd be ok..maybe with a
> null Path in the MulitpleInputs.addInputPath(), but it's the static
> addIterator() on the AccumuloInputFormat that I think is where I lose.
>
> Can I have 2 different AccumuloInputFormats, with different iterators?  I
> think the answer is no, and briefly looking at the source, believe that to
> be correct..but, was curious if others have done have done something.
>
> Cheers,
> Aaron
>

--047d7bd75920b478a204e68595a8
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Aaron,<br><br></div>We are currently re-working the A=
ccumuloInputFormat for Accumulo 1.6 to provide inputs from multiple tables =
(each with their own set of configured iterators, ranges, columns). Check o=
ut ACCUMULO-391.<br>
<br><br></div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote"=
>On Mon, Sep 16, 2013 at 11:41 AM, Aaron <span dir=3D"ltr">&lt;<a href=3D"m=
ailto:aarongmldt@gmail.com" target=3D"_blank">aarongmldt@gmail.com</a>&gt;<=
/span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">I was curious if this is po=
ssible (i am thinking it isn&#39;t): =A0from the Java API, Accumulo 1.5, Ha=
doop 1.2.1<div>
<br></div><div>Want to set 2 different iterators on a scan, and send those =
results to 2 different Mappers.</div>
<div><br></div><div>So, how&#39;d i do this with files as inputs, is just t=
o use MultipleInputs class, with 2 different Path, and 2 different Mapper C=
lasses, maybe the same InputFormat (e.g Text or Sequence)</div><div><br>

</div><div>Since I&#39;m using AccumulInputFormat, I would think I&#39;d be=
 ok..maybe with a null Path in the MulitpleInputs.addInputPath(), but it=
9;s the static addIterator() on the AccumuloInputFormat that I think is whe=
re I lose.</div>

<div><br></div><div>Can I have 2 different AccumuloInputFormats, with diffe=
rent iterators? =A0I think the answer is no, and briefly looking at the sou=
rce, believe that to be correct..but, was curious if others have done have =
done something.</div>

<div><br></div><div>Cheers,<br>Aaron</div></div>
</blockquote></div><br></div>

--047d7bd75920b478a204e68595a8--