Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of markq2011@gmail.com designates
 209.85.212.182 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOcnVr3LqyUu_NTvhRzRE2HfT6FKU6hjg8jvj3nNhR8W7-Q_ng@mail.gmail.com>
References: 
 <CALR_EGKVZGdXnpkCPTxeuijZT0g6JjjBdT_rh1e80jyMMKh5vg@mail.gmail.com>
	<CAOcnVr3LqyUu_NTvhRzRE2HfT6FKU6hjg8jvj3nNhR8W7-Q_ng@mail.gmail.com>
Date: Thu, 11 Oct 2012 12:53:00 -0700
Message-ID: 
 <CALR_EGJj7Lmfyb8pCf2e=NesX0eHDXNP=OhOH6pd9OjrH4MHRg@mail.gmail.com>
Subject: Re: Reading Sequence File from Hadoop Distributed Cache ..
From: Mark Olimpiati <markq2011@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d04428dc02692ec04cbcdebdc

--f46d04428dc02692ec04cbcdebdc
Content-Type: text/plain; charset=ISO-8859-1

Thanks for the reply Harsh, but as I said I tried locally too by using the
following:

     FileSystem localFs = cachedFiles[0].getFileSystem(new
Configuration());


Isn't the above supposed to give me the local file system ?? If yes, I
tried that but didn't work, if not, can you show one example?

Thank you,
Mark

On Wed, Oct 10, 2012 at 7:33 PM, Harsh J <harsh@cloudera.com> wrote:

> Hi Mark,
>
> DistributedCache files, when accessed from a Task, exist on the local
> file system. You should make sure the SequenceFile.Reader tries to
> read it with a LocalFS than a HDFS instance.
>
> On Thu, Oct 11, 2012 at 5:15 AM, Mark Olimpiati <markq2011@gmail.com>
> wrote:
> > Hi,
> >
> >   I'm storing sequence files in the distributed cache which seems to be
> > stored somewher under each node's /tmp .../local/archive/ ... path.
> >
> > In mapper code, I tried using SequenceFile.Reader with all possible
> > configurations (locally, distribtued) however, it can't find it. Are
> > sequence files supported in the distribued cache??
> >
> > Thank you,
> > Mark
>
>
>
> --
> Harsh J
>

--f46d04428dc02692ec04cbcdebdc
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Thanks for the reply Harsh, but as I said I tried locally too by using the =
following:<br><br>=A0=A0=A0=A0 FileSystem localFs =3D cachedFiles[0].getFil=
eSystem(new Configuration()); <br><br><br>Isn&#39;t the above supposed to g=
ive me the local file system ?? If yes, I tried that but didn&#39;t work, i=
f not, can you show one example?<br>
<br>Thank you,<br>Mark<br><br><div class=3D"gmail_quote">On Wed, Oct 10, 20=
12 at 7:33 PM, Harsh J <span dir=3D"ltr">&lt;<a href=3D"mailto:harsh@cloude=
ra.com" target=3D"_blank">harsh@cloudera.com</a>&gt;</span> wrote:<br><bloc=
kquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #cc=
c solid;padding-left:1ex">
Hi Mark,<br>
<br>
DistributedCache files, when accessed from a Task, exist on the local<br>
file system. You should make sure the SequenceFile.Reader tries to<br>
read it with a LocalFS than a HDFS instance.<br>
<div class=3D"HOEnZb"><div class=3D"h5"><br>
On Thu, Oct 11, 2012 at 5:15 AM, Mark Olimpiati &lt;<a href=3D"mailto:markq=
2011@gmail.com">markq2011@gmail.com</a>&gt; wrote:<br>
&gt; Hi,<br>
&gt;<br>
&gt; =A0 I&#39;m storing sequence files in the distributed cache which seem=
s to be<br>
&gt; stored somewher under each node&#39;s /tmp .../local/archive/ ... path=
.<br>
&gt;<br>
&gt; In mapper code, I tried using SequenceFile.Reader with all possible<br=
>
&gt; configurations (locally, distribtued) however, it can&#39;t find it. A=
re<br>
&gt; sequence files supported in the distribued cache??<br>
&gt;<br>
&gt; Thank you,<br>
&gt; Mark<br>
<br>
<br>
<br>
</div></div><span class=3D"HOEnZb"><font color=3D"#888888">--<br>
Harsh J<br>
</font></span></blockquote></div><br>

--f46d04428dc02692ec04cbcdebdc--