incubator-hcatalog-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HCATALOG-36) Support Writing Out to Multiple Tables in HCatOutputFormat
Date Wed, 01 Jun 2011 15:32:47 GMT

    [ https://issues.apache.org/jira/browse/HCATALOG-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042235#comment-13042235
] 

Alan Gates commented on HCATALOG-36:
------------------------------------

Writing to multiple partitions is slated for 0.2, see https://cwiki.apache.org/confluence/display/HCATALOG/HCatalogJournal
 

I'd like to understand the use case for writing to multiple tables.  You want to be able to
split the output stream to different tables as it's being written?  How would the split be
determined?  Can you give me an example of a job that would want to do this?  Also, using
Pig's split operator and HCatStorer this should already work in Pig.  Would an extending MultipleOutputFormat
do what you want?

> Support Writing Out to Multiple Tables in HCatOutputFormat
> ----------------------------------------------------------
>
>                 Key: HCATALOG-36
>                 URL: https://issues.apache.org/jira/browse/HCATALOG-36
>             Project: HCatalog
>          Issue Type: Improvement
>            Reporter: Ranjit Mathew
>         Attachments: multihcat.tgz
>
>
> HCatOutputFormat does not support writing out to multiple tables (or partitions for that
matter).
> Add this support to HCatalog.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message