hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahadev konar (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3560) Archvies sometimes create empty part files.
Date Fri, 13 Jun 2008 22:35:45 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Mahadev konar updated HADOOP-3560:
----------------------------------

    Attachment: hadoop-3560_1.patch

this patch fixes the splits created in archive map reduce jobs so that splits are evenly distributed
amongst the maps. The sync marker made the splits to be non uniform amongst the maps. The
sync marker is called on each record append in the filesplits file.

> Archvies sometimes create empty part files.
> -------------------------------------------
>
>                 Key: HADOOP-3560
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3560
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Mahadev konar
>            Assignee: Mahadev konar
>            Priority: Blocker
>             Fix For: 0.18.0, 0.19.0
>
>         Attachments: hadoop-3560_1.patch
>
>
> Archvies creates a bunch of empty part files sometimes which are not necessary.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message