hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shubham Chopra (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-443) Illustrate for the Types branch
Date Tue, 23 Sep 2008 07:52:47 GMT

     [ https://issues.apache.org/jira/browse/PIG-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shubham Chopra updated PIG-443:
-------------------------------

    Attachment: pig_types_23_09.patch

I have modified the code to address these issues.

* I now use the clonePlan method in PigServer to generate the logical plan. I already had
a functional optimiser that puts in the necessary operators to make the plan functional (Cast
and Split operators). Using clonePlan also addresses the optimisations done by explain since
it starts with the initial script.

* I checked with the latest checkout. You get a RuntimeException that says you need to specify
a schema while loading files. I need the schema to be able to generate synthetic data, since
without schema I have no idea how many columns exist in the data. Can you pls confirm if its
a null pointer exception?

* I haven't tested streaming with illustrate. I am just looking at supporting the basic operators
right now. I was hoping to get illustrate into the beta drop.


> Illustrate for the Types branch
> -------------------------------
>
>                 Key: PIG-443
>                 URL: https://issues.apache.org/jira/browse/PIG-443
>             Project: Pig
>          Issue Type: New Feature
>    Affects Versions: types_branch
>            Reporter: Shubham Chopra
>            Assignee: Shubham Chopra
>             Fix For: types_branch
>
>         Attachments: pig_types_22_09.patch, pig_types_23_09.patch
>
>
> This implementation of Illustrate uses visitors to traverse the plans.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message