hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gaurav Jain (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1111) [Zebra] multiple outputs support
Date Thu, 03 Dec 2009 16:57:29 GMT

    [ https://issues.apache.org/jira/browse/PIG-1111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785396#action_12785396
] 

Gaurav Jain commented on PIG-1111:
----------------------------------


In response to feedback:

1) build.xml has tags to run multiple outputs tests

2) Changed to package scope

3) Change has been made

4) Throws IOException now

5) Was done as part of code cleaning. Null'ness check is done in getOuputPaths() now

6) This variable is taken out

7) Since ZebraOutputPartittion implements Configurable interface. setConf and getConf are
interface methods

> [Zebra] multiple outputs support
> --------------------------------
>
>                 Key: PIG-1111
>                 URL: https://issues.apache.org/jira/browse/PIG-1111
>             Project: Pig
>          Issue Type: New Feature
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Gaurav Jain
>            Assignee: Gaurav Jain
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: PIG-1111.patch, PIG-1111.patch
>
>
> Zebra enables application to stream data into different zebra table instances.
> New Interface added:
> setMultipleOutputs( JobConf jobconf, String commaSeparatedLocation, Class<? extends
ZebraOutputPartitioner> theClass.
> Zebra maintains a list of tables instances based on commaseparatedlocations ( in that
order )
> ZebraOutputPartitioner interface has getOutputPartition method which is implemented by
the application. It will return an index into the list. Zebra will write to that instance
> We also introduce a new mapred property for setting multiple outputs.
> mapred.lib.table.multi.output.dirs
>  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message