pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1331) Owl Hadoop Table Management Service
Date Thu, 01 Apr 2010 01:08:27 GMT

    [ https://issues.apache.org/jira/browse/PIG-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852207#action_12852207
] 

Alan Gates commented on PIG-1331:
---------------------------------

After applying the ivy_version patch and removing my cached version of ivy from ~/.ant/lib
the patch compiles.

> Owl Hadoop Table Management Service
> -----------------------------------
>
>                 Key: PIG-1331
>                 URL: https://issues.apache.org/jira/browse/PIG-1331
>             Project: Pig
>          Issue Type: New Feature
>    Affects Versions: 0.8.0
>            Reporter: Jay Tang
>         Attachments: build.log, ivy_version.patch, owl.contrib.3.tgz
>
>
> This JIRA is a proposal to create a Hadoop table management service: Owl. Today, MapReduce
and Pig applications interacts directly with HDFS directories and files and must deal with
low level data management issues such as storage format, serialization/compression schemes,
data layout, and efficient data accesses, etc, often with different solutions. Owl aims to
provide a standard way to addresses this issue and abstracts away the complexities of reading/writing
huge amount of data from/to HDFS.
> Owl has a data access API that is modeled after the traditional Hadoop !InputFormt and
a management API to manipulate Owl objects.  This JIRA is related to Pig-823 (Hadoop Metadata
Service) as Owl has an internal metadata store.  Owl integrates with different storage module
like Zebra with a pluggable architecture.
>  Initially, the proposal is to submit Owl as a Pig contrib project.  Over time, it makes
sense to move it to a Hadoop subproject.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message