hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jay Tang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1331) Owl Hadoop Table Management Service
Date Tue, 04 May 2010 15:09:00 GMT

    [ https://issues.apache.org/jira/browse/PIG-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12863835#action_12863835
] 

Jay Tang commented on PIG-1331:
-------------------------------

Yes, Jeff.  Owl, as a table management service, has a metadata module. Please see http://wiki.apache.org/pig/owl
for more information.

> Owl Hadoop Table Management Service
> -----------------------------------
>
>                 Key: PIG-1331
>                 URL: https://issues.apache.org/jira/browse/PIG-1331
>             Project: Pig
>          Issue Type: New Feature
>    Affects Versions: 0.8.0
>            Reporter: Jay Tang
>            Assignee: Ajay Kidave
>             Fix For: 0.8.0
>
>         Attachments: anttestoutput.tgz, build.log, ivy_version.patch, owl.contrib.3.tgz,
owl.contrib.4.tar.gz
>
>
> This JIRA is a proposal to create a Hadoop table management service: Owl. Today, MapReduce
and Pig applications interacts directly with HDFS directories and files and must deal with
low level data management issues such as storage format, serialization/compression schemes,
data layout, and efficient data accesses, etc, often with different solutions. Owl aims to
provide a standard way to addresses this issue and abstracts away the complexities of reading/writing
huge amount of data from/to HDFS.
> Owl has a data access API that is modeled after the traditional Hadoop !InputFormt and
a management API to manipulate Owl objects.  This JIRA is related to Pig-823 (Hadoop Metadata
Service) as Owl has an internal metadata store.  Owl integrates with different storage module
like Zebra with a pluggable architecture.
>  Initially, the proposal is to submit Owl as a Pig contrib project.  Over time, it makes
sense to move it to a Hadoop subproject.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message