hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rahul Bhattacharjee <rahul.rec....@gmail.com>
Subject Re: How to ignore empty file comming out from hive map side join
Date Fri, 13 Sep 2013 16:41:45 GMT
See if this makes sense .

You mean in the output directory there are some empty files as well. Those
might have come from maps which didn't emit any pair.
Not sure if there is anything like lazy output formater which will not
create the files till its required.

Rahul


On Fri, Sep 13, 2013 at 5:13 PM, samir das mohapatra <
samir.helpdoc@gmail.com> wrote:

> Dear Hive/Hadoop Developer
>
>    Just I was  runing hive mapside join , along with output data I colud
> see some empty file  in map stage, Why it is ? and how to ignore this file .
>
> Regards,
> samir.
>

Mime
View raw message