drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Altekruse <altekruseja...@gmail.com>
Subject Re: Drill plugin for zipped files
Date Fri, 12 Dec 2014 21:21:52 GMT
Is this feature documented? A quick search of the drill wiki for
'compressed', 'zip' and 'gzip' does not seem to show any useful results.

- Jason

On Fri, Dec 12, 2014 at 10:36 AM, Steven Phillips <sphillips@maprtech.com>
wrote:
>
> You want to keep the .gz extension:
>
> 0: jdbc:drill:zk=local> select * from dfs.`/drill/nation.csv.gz` limit 2;
> +------------+
> |  columns   |
> +------------+
> | ["0","ALGERIA","0"," haggle. carefully final deposits detect slyly agai"]
> |
> | ["1","ARGENTINA","1","al foxes promise slyly according to the regular
> accounts. bold requests alon"] |
> +------------+
>
> bzip2 is also supported:
>
> 0: jdbc:drill:zk=local> select * from dfs.`/drill/nation.csv.bz2` limit 2;
> +------------+
> |  columns   |
> +------------+
> | ["0","ALGERIA","0"," haggle. carefully final deposits detect slyly agai"]
> |
> | ["1","ARGENTINA","1","al foxes promise slyly according to the regular
> accounts. bold requests alon"] |
> +------------+
>
> On Fri, Dec 12, 2014 at 6:01 AM, Hmxxyy <hmxxyy@gmail.com> wrote:
> >
> > Could you please show an example for that? Especially how to define the
> > file suffix, should I renamed the data files from .csv.gz to .csv? Does
> it
> > support bz2 as well?
> >
> > Thanks.
> >
> > Sent from my iPhone
> >
> > > On Dec 12, 2014, at 5:49 AM, Jim Scott <jscott@maprtech.com> wrote:
> > >
> > > With csv files (as an example) it will automatically decompress them.
> > >
> > >> On Thu, Dec 11, 2014 at 1:12 AM, ДП <dimapl@yandex.ru> wrote:
> > >>
> > >> Hi!
> > >> Apache Drill is most interesting project!
> > >> I think, Apache Drill is best project for view and analyze logs by
> > >> sql-developers and managers!
> > >> But I have some disappointment. =(
> > >> Most logs are stored in zip, gzip, tar or other archive and packed
> > formats.
> > >> How I can to config dfs storage to use unzip/gunzip command before get
> > >> data?
> > >> Or can you add plugin for zipped files?
> > >> ---------------
> > >> Best regards,
> > >> Dima Pl
> > >
> > >
> > > --
> > > *Jim Scott*
> > > Director, Enterprise Strategy & Architecture
> > > +1 (347) 746-9281
> > >
> > > <http://www.mapr.com/>
> > > [image: MapR Technologies] <http://www.mapr.com>
> >
>
>
> --
>  Steven Phillips
>  Software Engineer
>
>  mapr.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message