hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pi Song (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-262) Pig needs an optimizer
Date Thu, 10 Jul 2008 13:26:31 GMT

    [ https://issues.apache.org/jira/browse/PIG-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12612486#action_12612486
] 

Pi Song commented on PIG-262:
-----------------------------

Comments:-
1. LogicalTransformer.removeFromChain() seems to duplicate the code in insertBetween. It also
doesn't handle internal links within LOCOGroup.
2. We've got DependencyOrderWalker and DFSWalker implementation classes available. Isn't it
better to reuse them?

> Pig needs an optimizer
> ----------------------
>
>                 Key: PIG-262
>                 URL: https://issues.apache.org/jira/browse/PIG-262
>             Project: Pig
>          Issue Type: Sub-task
>          Components: impl
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>         Attachments: optimizer.patch, optimizer2.patch
>
>
> We need to add an optimizer to pig.  This will enable us to do some traditional optimizations,
such as filter and projection pushing, join order and execution choices, etc.  It will also
enable optimizations specific to map/reduce (such as using the combiner).
> The optimizer will need to operate at various levels, including the logical, physical,
and possibly map/reduce plan levels.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message