hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From alex bohr <alexjb...@gmail.com>
Subject Check compression codec of an HDFS file
Date Wed, 04 Dec 2013 23:40:08 GMT
What's the best way to check the compression codec that an HDFS file was
written with?

We use both Gzip and Snappy compression so I want a way to determine how a
specific file is compressed.

The closest I found is the *getCodec
that relies on the file name suffix ... which don't exist since Reducers
typically don't add a suffix to the filenames they create.


View raw message