hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From prashant ullegaddi <prashullega...@gmail.com>
Subject Re: Reading GZIP input files.
Date Fri, 31 Jul 2009 15:21:58 GMT
Yes, files do end with .gz. Will TextInputFormat work?

On Fri, Jul 31, 2009 at 8:35 PM, Jason Venner <jason.hadoop@gmail.com>wrote:

> If the file names end in .gz, 18.3 will just work, you will get 1 map task
> per file.
>
> On Fri, Jul 31, 2009 at 8:01 AM, prashant ullegaddi <
> prashullegaddi@gmail.com> wrote:
>
> > Hi guys,
> >
> > I have a set of 1000 gzipped plain text files. How to read them in
> Hadoop?
> > Is there any built-in class available for it?
> >
> > Btw, I'm using hadoop-0.18.3.
> >
> > Regards,
> > Prashant.
> >
>
>
>
> --
> Pro Hadoop, a book to guide you from beginner to hadoop mastery,
> http://www.amazon.com/dp/1430219424?tag=jewlerymall
> www.prohadoopbook.com a community for Hadoop Professionals
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message