hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Thusoo (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-56) The reducer output is not created if the mapper input is empty
Date Mon, 01 Dec 2008 17:49:44 GMT

     [ https://issues.apache.org/jira/browse/HIVE-56?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ashish Thusoo updated HIVE-56:
------------------------------

    Component/s: Query Processor

> The reducer output is not created if the mapper input is empty
> --------------------------------------------------------------
>
>                 Key: HIVE-56
>                 URL: https://issues.apache.org/jira/browse/HIVE-56
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>
> For some Hive stuff, I ran into the following scenario:
> For a given map-reduce job, the input was empty. Because of that no mappers and reducers
were created. It would have been helpful if an empty output for the reducer would have been
created.
> After browsing though the code, it seems that in initTasks() in JobInProgress, no mappers
and reducers are initialized if input is empty.
> I was thinking of putting a fix there. If the input is empty, before returning, create
the output directory (as specified by the reducer) if needed.Any comments/suggestions....

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message