pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ying He (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-67) FileLocalizer doesn't work on reduce sise
Date Fri, 22 May 2009 21:30:45 GMT

     [ https://issues.apache.org/jira/browse/PIG-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Ying He updated PIG-67:

    Attachment:     (was: FileLocalizer.java)

> FileLocalizer doesn't work on reduce sise
> -----------------------------------------
>                 Key: PIG-67
>                 URL: https://issues.apache.org/jira/browse/PIG-67
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Utkarsh Srivastava
> FileLocalizer.openDFSFile() does not work on the reduce side. This is probably because
FileLocalizer uses PigRecordReader which exists only on the map task.
> The correct solution will be for FileLocalizer to have a hadoop conf that is initialized
by the reduce task on the reduce side, and the pig record reader on the map side.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message