pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-1270) Push limit into loader
Date Mon, 13 Feb 2012 08:25:00 GMT

    [ https://issues.apache.org/jira/browse/PIG-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206748#comment-13206748

Daniel Dai commented on PIG-1270:

For the patch itself, I would like to commit it into trunk soon. For the direct hdfs access
you mention, it will probably be part of the backend rework we planned, but I am not sure
at the moment.
> Push limit into loader
> ----------------------
>                 Key: PIG-1270
>                 URL: https://issues.apache.org/jira/browse/PIG-1270
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: PIG-1270-1.patch, PIG-1270-2.patch, PIG-1270-3.patch
> We can optimize limit operation by stopping early in PigRecordReader. In general, we
need a way to communicate between PigRecordReader and execution pipeline. POLimit could instruct
PigRecordReader that we have already had enough records and stop feeding more data.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message