hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-777) Code refactoring: Create optimization out of store/load post processing code
Date Thu, 14 May 2009 21:09:45 GMT

    [ https://issues.apache.org/jira/browse/PIG-777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709590#action_12709590
] 

Olga Natkovich commented on PIG-777:
------------------------------------

Looks like the patch does more than just log message. I think you need to add a unit test
for why this is needed:

store.setInputSpec(load.getInputFile());

> Code refactoring: Create optimization out of store/load post processing code
> ----------------------------------------------------------------------------
>
>                 Key: PIG-777
>                 URL: https://issues.apache.org/jira/browse/PIG-777
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Gunther Hagleitner
>         Attachments: log_message.patch
>
>
> The postProcessing method in the pig server checks whether a logical graph contains stores
to and loads from the same location. If so, it will either connect the store and load, or
optimize by throwing out the load and connecting the store predecessor with the successor
of the load.
> Ideally the introduction of the store and load connection should happen in the query
compiler, while the optimization should then happen in an separate optimizer step as part
of the optimizer framework.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message