Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates
 209.85.223.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOT3TWoq7HHYjkPjW37aS8qD78xbqmUPgdhCy=bJdg=sU+5OjQ@mail.gmail.com>
References: 
 <CAOT3TWpRqFz14y0Y_BkW6C7H+B8G6x7JYMuy+jEpmSF5QDCieQ@mail.gmail.com>
 <CAOT3TWoq7HHYjkPjW37aS8qD78xbqmUPgdhCy=bJdg=sU+5OjQ@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Tue, 13 Nov 2012 18:26:43 +0530
Message-ID: 
 <CAOcnVr3xxgvLW0S_5NdFWOyu8QfM_FRZQBQMXkpdh267iiSTvg@mail.gmail.com>
Subject: Re: Reading from sequence file using java FS api
To: user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1

Yes, the codec information is stored in the file's header.

Same goes for Avro where even the deserialization schema logic is
stored in addition, so you can just directly read into usable
primitive/compound objects and not have to do manual transformation
work.

On Tue, Nov 13, 2012 at 6:07 AM, Mohit Anchlia <mohitanchlia@gmail.com> wrote:
> I was simple able to read using below code. Didn't have to decompress. It
> looks like reader automatically knows and decompresses the file before
> returning it to the user.
>
>
> On Mon, Nov 12, 2012 at 3:16 PM, Mohit Anchlia <mohitanchlia@gmail.com>
> wrote:
>>
>> I am looking for an example that read snappy compressed snappy file. Could
>> someone point me to it? What I have so far is this:
>>
>>
>> Configuration conf =
>>
>> new Configuration();
>>
>> FileSystem fs = FileSystem.get(URI.create(uri), conf);
>>
>> Path path =
>>
>> new Path(uri);
>>
>> SequenceFile.Reader reader =
>>
>> null;
>>
>> org.apache.hadoop.io.LongWritable key =
>>
>> new org.apache.hadoop.io.LongWritable();
>>
>> org.apache.hadoop.io.Text value =
>>
>> new org.apache.hadoop.io.Text();
>>
>> try {
>>
>> reader = new SequenceFile.Reader(fs, path, conf);
>
>


-- 
Harsh J