Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates
 209.85.160.47 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <1370242987.4980.YahooMailNeo@web142401.mail.bf1.yahoo.com>
References: <1370242987.4980.YahooMailNeo@web142401.mail.bf1.yahoo.com>
From: Harsh J <harsh@cloudera.com>
Date: Mon, 3 Jun 2013 15:57:07 +0530
Message-ID: 
 <CAOcnVr3+tYX0pLiKOU_71U7g4Rb8sLJtF3Kf8X1Smu9ho-aOsw@mail.gmail.com>
Subject: Re: Does libhdfs c/c++ api support read/write compressed file
To: "<user@hadoop.apache.org>" <user@hadoop.apache.org>,
 Xu Haiti <xuhaiti@yahoo.com>
Content-Type: text/plain; charset=ISO-8859-1

Hi Xu,

HDFS is data agnostic. It does not currently care about what form the
data of the files are in - whether they are compressed, encrypted,
serialized in format-x, etc..

There are hadoop-common APIs that support decompressing of supported
codecs, but there are no C/C++ level implementations of these (though
you may use JNI). You will have to write/use your own
decompress/compress code for files.

On Mon, Jun 3, 2013 at 12:33 PM, Xu Haiti <xuhaiti@yahoo.com> wrote:
>
> I have found somebody talks libhdfs does not support read/write gzip file at
> about 2010.
>
> I download the newest hadoop-2.0.4 and read hdfs.h. There is also no
> compressing arguments.
>
> Now I am wondering if it supports reading compressed file now?
>
> If it not, how can I make a patch for the libhdfs and make it work?
>
> Thanks in advance.
>
> Best Regards
> Haiti


-- 
Harsh J