hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Justin Coffey (JIRA)" <>
Subject [jira] [Commented] (HIVE-5783) Native Parquet Support in Hive
Date Fri, 17 Jan 2014 10:27:20 GMT


Justin Coffey commented on HIVE-5783:

After much delay, here is the patch.  This integrates the former "parquet-hive" project directly

There is a qtest file (modeled on that of ORC) and unit tests for much of the code.

This applies cleanly to the commit 3a7cea58ababfbbbdb6eac97fefa4298337b7c06 on the branch-0.11.

Comments welcome :).

> Native Parquet Support in Hive
> ------------------------------
>                 Key: HIVE-5783
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>          Components: Serializers/Deserializers
>            Reporter: Justin Coffey
>            Assignee: Justin Coffey
>            Priority: Minor
>         Attachments: HIVE-5783.patch, hive-0.11-parquet.patch, parquet-hive.patch
> Problem Statement:
> Hive would be easier to use if it had native Parquet support. Our organization, Criteo,
uses Hive extensively. Therefore we built the Parquet Hive integration and would like to now
contribute that integration to Hive.
> About Parquet:
> Parquet is a columnar storage format for Hadoop and integrates with many Hadoop ecosystem
tools such as Thrift, Avro, Hadoop MapReduce, Cascading, Pig, Drill, Crunch, and Hive. Pig,
Crunch, and Drill all contain native Parquet integration.
> Changes Details:
> Parquet was built with dependency management in mind and therefore only a single Parquet
jar will be added as a dependency.

This message was sent by Atlassian JIRA

View raw message