hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HIVE-56) The reducer output is not created if the mapper input is empty
Date Wed, 23 Jun 2010 21:13:50 GMT

     [ https://issues.apache.org/jira/browse/HIVE-56?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Namit Jain resolved HIVE-56.
----------------------------

    Fix Version/s: 0.6.0
       Resolution: Fixed

This was fixed a long time back. In hive, an empty input is created to start a dummy mapper

> The reducer output is not created if the mapper input is empty
> --------------------------------------------------------------
>
>                 Key: HIVE-56
>                 URL: https://issues.apache.org/jira/browse/HIVE-56
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.6.0
>
>
> For some Hive stuff, I ran into the following scenario:
> For a given map-reduce job, the input was empty. Because of that no mappers and reducers
were created. It would have been helpful if an empty output for the reducer would have been
created.
> After browsing though the code, it seems that in initTasks() in JobInProgress, no mappers
and reducers are initialized if input is empty.
> I was thinking of putting a fix there. If the input is empty, before returning, create
the output directory (as specified by the reducer) if needed.Any comments/suggestions....

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message