pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1331) Owl Hadoop Table Management Service
Date Mon, 12 Apr 2010 22:30:50 GMT

    [ https://issues.apache.org/jira/browse/PIG-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856208#action_12856208
] 

Alan Gates commented on PIG-1331:
---------------------------------

Now that I've figured out how to read directions I've run the tests on the new patch and they
pass.

I've also run javadocs and findbugs and all looks good.

I'll start a vote on whether to accept this as a contrib.

> Owl Hadoop Table Management Service
> -----------------------------------
>
>                 Key: PIG-1331
>                 URL: https://issues.apache.org/jira/browse/PIG-1331
>             Project: Pig
>          Issue Type: New Feature
>    Affects Versions: 0.8.0
>            Reporter: Jay Tang
>         Attachments: anttestoutput.tgz, build.log, ivy_version.patch, owl.contrib.3.tgz,
owl.contrib.4.tar.gz
>
>
> This JIRA is a proposal to create a Hadoop table management service: Owl. Today, MapReduce
and Pig applications interacts directly with HDFS directories and files and must deal with
low level data management issues such as storage format, serialization/compression schemes,
data layout, and efficient data accesses, etc, often with different solutions. Owl aims to
provide a standard way to addresses this issue and abstracts away the complexities of reading/writing
huge amount of data from/to HDFS.
> Owl has a data access API that is modeled after the traditional Hadoop !InputFormt and
a management API to manipulate Owl objects.  This JIRA is related to Pig-823 (Hadoop Metadata
Service) as Owl has an internal metadata store.  Owl integrates with different storage module
like Zebra with a pluggable architecture.
>  Initially, the proposal is to submit Owl as a Pig contrib project.  Over time, it makes
sense to move it to a Hadoop subproject.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message