Mailing-List: contact dev-help@drill.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@drill.apache.org
Received-SPF: pass (nike.apache.org: domain of altekrusejason@gmail.com
 designates 209.85.216.49 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAA_-67c8LYLr7AFsjKuciee8ARKe2zZdmiseLUwPscFFkYCsbA@mail.gmail.com>
References: <820771418220593@web15o.yandex.ru>
 <4675141418281959@web18g.yandex.ru>
 <CAPehdad5VdgeFgOEi3PJ=2N8JQvGjHun98Up-LGdZ2y2onTgwA@mail.gmail.com>
 <C05307EB-CDE1-4378-95F7-E15878346511@gmail.com>
 <CAA_-67c8LYLr7AFsjKuciee8ARKe2zZdmiseLUwPscFFkYCsbA@mail.gmail.com>
From: Jason Altekruse <altekrusejason@gmail.com>
Date: Fri, 12 Dec 2014 13:21:52 -0800
Message-ID: 
 <CAMpYv7By21Rj1nW5KUhbwN-19mZjPE4Np3Kzzu294tExR96hSQ@mail.gmail.com>
Subject: Re: Drill plugin for zipped files
To: dev@drill.apache.org
Content-Type: multipart/alternative; boundary=001a11c0013e731b56050a0b7cdc

--001a11c0013e731b56050a0b7cdc
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Is this feature documented? A quick search of the drill wiki for
'compressed', 'zip' and 'gzip' does not seem to show any useful results.

- Jason

On Fri, Dec 12, 2014 at 10:36 AM, Steven Phillips <sphillips@maprtech.com>
wrote:
>
> You want to keep the .gz extension:
>
> 0: jdbc:drill:zk=3Dlocal> select * from dfs.`/drill/nation.csv.gz` limit =
2;
> +------------+
> |  columns   |
> +------------+
> | ["0","ALGERIA","0"," haggle. carefully final deposits detect slyly agai=
"]
> |
> | ["1","ARGENTINA","1","al foxes promise slyly according to the regular
> accounts. bold requests alon"] |
> +------------+
>
> bzip2 is also supported:
>
> 0: jdbc:drill:zk=3Dlocal> select * from dfs.`/drill/nation.csv.bz2` limit=
 2;
> +------------+
> |  columns   |
> +------------+
> | ["0","ALGERIA","0"," haggle. carefully final deposits detect slyly agai=
"]
> |
> | ["1","ARGENTINA","1","al foxes promise slyly according to the regular
> accounts. bold requests alon"] |
> +------------+
>
> On Fri, Dec 12, 2014 at 6:01 AM, Hmxxyy <hmxxyy@gmail.com> wrote:
> >
> > Could you please show an example for that? Especially how to define the
> > file suffix, should I renamed the data files from .csv.gz to .csv? Does
> it
> > support bz2 as well?
> >
> > Thanks.
> >
> > Sent from my iPhone
> >
> > > On Dec 12, 2014, at 5:49 AM, Jim Scott <jscott@maprtech.com> wrote:
> > >
> > > With csv files (as an example) it will automatically decompress them.
> > >
> > >> On Thu, Dec 11, 2014 at 1:12 AM, =D0=94=D0=9F <dimapl@yandex.ru> wro=
te:
> > >>
> > >> Hi!
> > >> Apache Drill is most interesting project!
> > >> I think, Apache Drill is best project for view and analyze logs by
> > >> sql-developers and managers!
> > >> But I have some disappointment. =3D(
> > >> Most logs are stored in zip, gzip, tar or other archive and packed
> > formats.
> > >> How I can to config dfs storage to use unzip/gunzip command before g=
et
> > >> data?
> > >> Or can you add plugin for zipped files?
> > >> ---------------
> > >> Best regards,
> > >> Dima Pl
> > >
> > >
> > > --
> > > *Jim Scott*
> > > Director, Enterprise Strategy & Architecture
> > > +1 (347) 746-9281
> > >
> > > <http://www.mapr.com/>
> > > [image: MapR Technologies] <http://www.mapr.com>
> >
>
>
> --
>  Steven Phillips
>  Software Engineer
>
>  mapr.com
>

--001a11c0013e731b56050a0b7cdc--