pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (PIG-1270) Push limit into loader
Date Fri, 23 Mar 2012 01:04:22 GMT

     [ https://issues.apache.org/jira/browse/PIG-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Daniel Dai resolved PIG-1270.

      Resolution: Fixed
    Hadoop Flags: Reviewed

Patch committed to 0.10/trunk. Thanks Thejas and Min for testing!
> Push limit into loader
> ----------------------
>                 Key: PIG-1270
>                 URL: https://issues.apache.org/jira/browse/PIG-1270
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.10
>         Attachments: PIG-1270-1.patch, PIG-1270-2.patch, PIG-1270-3.patch, PIG-1270-4.patch
> We can optimize limit operation by stopping early in PigRecordReader. In general, we
need a way to communicate between PigRecordReader and execution pipeline. POLimit could instruct
PigRecordReader that we have already had enough records and stop feeding more data.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message