Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAGSm+-tuQxpundw0OLzj_1q3W6j2VmoMDLh14qv7=cA8x9h5Dg@mail.gmail.com>
References: 
 <CAGSm+-tuQxpundw0OLzj_1q3W6j2VmoMDLh14qv7=cA8x9h5Dg@mail.gmail.com>
Date: Wed, 29 Jul 2015 15:40:38 -0700
Message-ID: 
 <CALte62zexy2nBiUzzpMzF6Y8fy4md87tTN9FZHC-A1nVHihxqA@mail.gmail.com>
Subject: Re: Need command to compress the files
From: Ted Yu <yuzhihong@gmail.com>
To: "common-user@hadoop.apache.org" <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=001a1139fab09a3894051c0b46ff

--001a1139fab09a3894051c0b46ff
Content-Type: text/plain; charset=UTF-8

You can use the following command to see options for gzip:
gzip -h

For snappy, see:
https://github.com/kubo/snzip
https://code.google.com/p/snappy/issues/detail?id=34

FYI

On Wed, Jul 29, 2015 at 3:34 PM, SP <sajidmca@gmail.com> wrote:

> Hi All,
>
> I am working on comparing different compression ratios.
>
> I have these files in AVRO format. How can I compress them using snappy or
> gzip.
>
> -rw-r--r--   3 hdfs supergroup 3080866838 2015-07-29 18:16
> /tmp/fact_splitby_date_id/part-m-00000.avro
> -rw-r--r--   3 hdfs supergroup 3021258762 2015-07-29 18:15
> /tmp/fact_splitby_date_id/part-m-00001.avro
> -rw-r--r--   3 hdfs supergroup 3164101762 2015-07-29 18:17
> /tmp/fact_splitby_date_id/part-m-00002.avro
> -rw-r--r--   3 hdfs supergroup 3251578205 2015-07-29 18:16
> /tmp/fact_splitby_date_id/part-m-00003.avro
>
>
>
>
> Thanks
> Sp
>

--001a1139fab09a3894051c0b46ff
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">You can use the following command to see options for gzip:=
<br><div>gzip -h<br></div><div><br></div><div>For snappy, see:</div><div><a=
 href=3D"https://github.com/kubo/snzip">https://github.com/kubo/snzip</a><b=
r></div><div><a href=3D"https://code.google.com/p/snappy/issues/detail?id=
=3D34">https://code.google.com/p/snappy/issues/detail?id=3D34</a></div><div=
><br></div><div>FYI</div></div><div class=3D"gmail_extra"><br><div class=3D=
"gmail_quote">On Wed, Jul 29, 2015 at 3:34 PM, SP <span dir=3D"ltr">&lt;<a =
href=3D"mailto:sajidmca@gmail.com" target=3D"_blank">sajidmca@gmail.com</a>=
&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0=
 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi Al=
l,<div><br></div><div>I am working on comparing different compression ratio=
s.=C2=A0</div><div><br></div><div>I have these files in AVRO format. How ca=
n I compress them using snappy or gzip.</div><div><br></div><div><div>-rw-r=
--r-- =C2=A0 3 hdfs supergroup 3080866838 2015-07-29 18:16 /tmp/fact_splitb=
y_date_id/part-m-00000.avro</div><div>-rw-r--r-- =C2=A0 3 hdfs supergroup 3=
021258762 2015-07-29 18:15 /tmp/fact_splitby_date_id/part-m-00001.avro</div=
><div>-rw-r--r-- =C2=A0 3 hdfs supergroup 3164101762 2015-07-29 18:17 /tmp/=
fact_splitby_date_id/part-m-00002.avro</div><div>-rw-r--r-- =C2=A0 3 hdfs s=
upergroup 3251578205 2015-07-29 18:16 /tmp/fact_splitby_date_id/part-m-0000=
3.avro</div></div><div><br></div><div><br></div><div><br></div><div><br></d=
iv><div>Thanks</div><span class=3D"HOEnZb"><font color=3D"#888888"><div>Sp<=
/div></font></span></div>
</blockquote></div><br></div>

--001a1139fab09a3894051c0b46ff--