Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of thamizhannal.p@gmail.com
 designates 209.85.214.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOcnVr1HZup9GhryDiny3nM3hpJ_tW1O_a5beW2eKMPFsHEPoA@mail.gmail.com>
References: 
 <CAOjF3bFnKYKtpqRaK3yioyV3e8h5yhgcD8aeY8GG1TkoPrQ=nQ@mail.gmail.com>
	<CAOcnVr1HZup9GhryDiny3nM3hpJ_tW1O_a5beW2eKMPFsHEPoA@mail.gmail.com>
Date: Thu, 22 Mar 2012 12:43:50 +0530
Message-ID: 
 <CAOjF3bEGqcEgfA30pZ1fff4gkV9GtF0sNsTfkh7rCJzzSGmjyQ@mail.gmail.com>
Subject: Re: HDFS Path with special char
From: Thamizhannal Paramasivam <thamizhannal.p@gmail.com>
To: mapreduce-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d044518a15b763504bbcfa685

--f46d044518a15b763504bbcfa685
Content-Type: text/plain; charset=ISO-8859-1

Thanks a lot Harish. This is what I am looking for.

On Wed, Mar 21, 2012 at 4:46 PM, Harsh J <harsh@cloudera.com> wrote:

> Seems to me like you are looking for globbing your path results out.
> This is possible, just pass your pattern to this API call
> (FileSystem.globStatus instead of FileSystem.listStatus) and then
> iterate over the returned listing:
>
> http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/fs/FileSystem.html#globStatus(org.apache.hadoop.fs.Path)
>
> On Wed, Mar 21, 2012 at 4:01 PM, Thamizhannal Paramasivam
> <thamizhannal.p@gmail.com> wrote:
> > Hi All,
> >
> > Can n't we use special character to get paths in HDFS using Hadoop API.
> >
> > E.g. Path path = new Path("/data/input/20120321*");
> > I have files  /data/input/20120321000000/a.txt ,
> > /data/input/20120321010000/b.txt and /data/input/20120321020000/c.txt
> under
> > "/data/input/" folder.
> >
> > I wanted to all the files correponding to a single day. E.g. File:
> > /data/input date: 20120321
> >
> > How can I do that using Hadoop API.
> >
> > Any help would be appreciated.
> >
> > Thanks,
> > Thamizh
>
>
>
> --
> Harsh J
>

--f46d044518a15b763504bbcfa685
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Thanks a lot Harish. This is what I am looking for.<br><br><div class=3D"gm=
ail_quote">On Wed, Mar 21, 2012 at 4:46 PM, Harsh J <span dir=3D"ltr">&lt;<=
a href=3D"mailto:harsh@cloudera.com">harsh@cloudera.com</a>&gt;</span> wrot=
e:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Seems to me like you are looking for globbin=
g your path results out.<br>
This is possible, just pass your pattern to this API call<br>
(FileSystem.globStatus instead of FileSystem.listStatus) and then<br>
iterate over the returned listing:<br>
<a href=3D"http://hadoop.apache.org/common/docs/current/api/org/apache/hado=
op/fs/FileSystem.html#globStatus%28org.apache.hadoop.fs.Path%29" target=3D"=
_blank">http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/=
fs/FileSystem.html#globStatus(org.apache.hadoop.fs.Path)</a><br>

<div><div></div><div class=3D"h5"><br>
On Wed, Mar 21, 2012 at 4:01 PM, Thamizhannal Paramasivam<br>
&lt;<a href=3D"mailto:thamizhannal.p@gmail.com">thamizhannal.p@gmail.com</a=
>&gt; wrote:<br>
&gt; Hi All,<br>
&gt;<br>
&gt; Can n&#39;t we use special character to get paths in HDFS using Hadoop=
 API.<br>
&gt;<br>
&gt; E.g. Path path =3D new Path(&quot;/data/input/20120321*&quot;);<br>
&gt; I have files=A0 /data/input/20120321000000/a.txt ,<br>
&gt; /data/input/20120321010000/b.txt and /data/input/20120321020000/c.txt =
under<br>
&gt; &quot;/data/input/&quot; folder.<br>
&gt;<br>
&gt; I wanted to all the files correponding to a single day. E.g. File:<br>
&gt; /data/input date: 20120321<br>
&gt;<br>
&gt; How can I do that using Hadoop API.<br>
&gt;<br>
&gt; Any help would be appreciated.<br>
&gt;<br>
&gt; Thanks,<br>
&gt; Thamizh<br>
<br>
<br>
<br>
</div></div><font color=3D"#888888">--<br>
Harsh J<br>
</font></blockquote></div><br>

--f46d044518a15b763504bbcfa685--