incubator-hcatalog-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ranjit Mathew (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HCATALOG-36) Support Writing Out to Multiple Tables in HCatOutputFormat
Date Thu, 02 Jun 2011 03:40:47 GMT

    [ https://issues.apache.org/jira/browse/HCATALOG-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042593#comment-13042593
] 

Ranjit Mathew commented on HCATALOG-36:
---------------------------------------

Yes, writing to multiple partitions is a sorely-needed feature that we're looking forward
to in HCatalog 0.2.

We process several logs in a MapReduce Job and write out the processed data into various
tables managed by HCatalog. There are multiple tables even for a single log-type, to separate
out the "core" data required in most queries from the "peripheral" data required only in some
queries, not to mention to keep the schema for each table relatively simple.

> Support Writing Out to Multiple Tables in HCatOutputFormat
> ----------------------------------------------------------
>
>                 Key: HCATALOG-36
>                 URL: https://issues.apache.org/jira/browse/HCATALOG-36
>             Project: HCatalog
>          Issue Type: Improvement
>            Reporter: Ranjit Mathew
>         Attachments: multihcat.tgz
>
>
> HCatOutputFormat does not support writing out to multiple tables (or partitions for that
matter).
> Add this support to HCatalog.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message