pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2666) LoadFunc.setLocation() is not called when pig script only has Order By
Date Tue, 24 Apr 2012 22:12:06 GMT

    [ https://issues.apache.org/jira/browse/PIG-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13261078#comment-13261078
] 

Daniel Dai commented on PIG-2666:
---------------------------------

Yes, we does not call setLocation in some cases. Specifically in JobControlCompiler:
{code}
LoadFunc lf = ld.getLoadFunc();
if (lf !=null) {
    lf.setLocation(ld.getLFile().getFileName(), nwJob);
}
{code}
It can be null when doing sampler job and order by job. we can solve it by forcing getLoadFunc()
instantiate LoadFunc.

Note in the design of LoadFunc, setLocation is not guaranteed to be called in the frontend.
But seems now some LoadFunc depends on it. Shall we make the statement that setLocation should
be called in the frontend?
                
> LoadFunc.setLocation() is not called when pig script only has Order By
> ----------------------------------------------------------------------
>
>                 Key: PIG-2666
>                 URL: https://issues.apache.org/jira/browse/PIG-2666
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.3
>            Reporter: Francis Liu
>
> HCatLoader.setLocation() needs setLocation() called on the frontend. This doesn't happen
with this pig script:
> A = LOAD 'foo' USING org.apache.hcatalog.pig.HCatLoader();
> B = ORDER A BY id;
> DUMP B;

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message