hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benjamin Reed (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-67) FileLocalizer doesn't work on reduce sise
Date Fri, 18 Jan 2008 00:24:34 GMT

    [ https://issues.apache.org/jira/browse/PIG-67?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560173#action_12560173

Benjamin Reed commented on PIG-67:

It would probably be best if the FileLocalizer uses the Configuration that will be exposed
using PIG-66 rather than using PigRecordReader.

> FileLocalizer doesn't work on reduce sise
> -----------------------------------------
>                 Key: PIG-67
>                 URL: https://issues.apache.org/jira/browse/PIG-67
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Utkarsh Srivastava
> FileLocalizer.openDFSFile() does not work on the reduce side. This is probably because
FileLocalizer uses PigRecordReader which exists only on the map task.
> The correct solution will be for FileLocalizer to have a hadoop conf that is initialized
by the reduce task on the reduce side, and the pig record reader on the map side.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message