hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shravan Matthur Narayanamurthy (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-162) Rework mapreduce submission and monitoring
Date Fri, 16 May 2008 15:51:55 GMT

     [ https://issues.apache.org/jira/browse/PIG-162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shravan Matthur Narayanamurthy updated PIG-162:
-----------------------------------------------

    Attachment: incr8.patch

Progress Reporter + Support for PODistinct
reporter changes as outlined in the wiki. However, I decided to not report any progress from
inside expression operators like arithmetic and comparison ops. Their parent operators will
anyways be reporting progress.

PODistinct was relatively easy. Just added a visitDistinct method which adds a group by *
+ foreach generate $0 to the plan appropriately based on whether we are processing a mapplan
or a reduceplan. Test case for the same has been added to TestMRCompiler.

> Rework mapreduce submission and monitoring
> ------------------------------------------
>
>                 Key: PIG-162
>                 URL: https://issues.apache.org/jira/browse/PIG-162
>             Project: Pig
>          Issue Type: Sub-task
>         Environment: This bug tracks works to rework the submission and monitoring interface
to map reduce as described in  http://wiki.apache.org/pig/PigTypesFunctionalSpec
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>         Attachments: incr7.patch, incr8.patch, mapreduceJumbo.patch, mapreduceJumboWithComInc.patch,
modJumbo.patch, split.png, TEST-org.apache.pig.test.TestMRCompiler.txt, TEST-org.apache.pig.test.TestMRCompiler.txt,
TEST-org.apache.pig.test.TestUnion.txt
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message