pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-15) Filenames in the logical plan are not absolute
Date Fri, 02 Nov 2007 03:11:50 GMT
Filenames in the logical plan are not absolute

                 Key: PIG-15
                 URL: https://issues.apache.org/jira/browse/PIG-15
             Project: Pig
          Issue Type: Bug
          Components: impl
            Reporter: Olga Natkovich

Lets say my current working dir (CWD) is /user/x and there exists a file 'a';

The following results in an error:

a = load 'a';

cd /

dump a;

The problem is that the logical plan does not have fully qualified name for 'a' and it is
converted only when the
physical plan compilation is done. So in between if someone changes the directory as above
we have a problem.

As a user I do not worry/know about the side effects of pig's choice to execute queries lazily.
So when I asked it to
load 'a' I made sure that I was in the right directory. I think that the file is loaded and
I change the directory. Now
when the dump is asked for, the compilation starts and all it does to qualify the filename
is to get the CWD and append
it with the filename if its not absolute already. Hence the problem.

One solution is to store the FQFN while parsing the query. Since there might users of just
the logical plan like
pigbody, I think the logical plan should support this.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message