hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nigel Daley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-198) Integration with Hadoop 0.17
Date Wed, 16 Apr 2008 21:35:21 GMT

    [ https://issues.apache.org/jira/browse/PIG-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12589735#action_12589735
] 

Nigel Daley commented on PIG-198:
---------------------------------

This still needs some work. Pig doesn't work with HOD.

HOD now sets fs.default.name to a full specified URI such as hdfs://foo.bar:8094 (before it
just set for.bar:8094).  In src/org/apache/pig/backend/hadoop/executionengine/HExecutionEngine.java,
the fixUpDomain() method splits the string at the first colon and thinks everything after
the first colon is the port.  You can see that this assumption no longer works.  I suspect
that fixUpDomain should work with URI's that have and don't have a scheme (hdfs:// or file://).


> Integration with Hadoop 0.17
> ----------------------------
>
>                 Key: PIG-198
>                 URL: https://issues.apache.org/jira/browse/PIG-198
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Arun C Murthy
>         Attachments: hadoop17.jar, hadoop17.jar, PIG-198_1_20080409.patch, PIG-198_2_20080415.patch,
PIG-198_v0.patch
>
>
> There are some changes in 0.17 that require changes to pig code. Patch coming soon.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message