hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4189) HADOOP-3245 is incomplete
Date Wed, 24 Sep 2008 06:31:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12634034#action_12634034

Amar Kamat commented on HADOOP-4189:

bq. we should actually set the default in hadoop-default to the real value instead of 0, -1,
or "".

bq. we should mark it expert
+1. Will add this to the comment

bq. if it isn't already, I think this should be only configured by the cluster, not the job.
This value is used when the jobtracker starts. So its per cluster and not per job.

bq. As to the defaults ....
On an avg I found ~300-350 characters per line. Which makes 600-700 bytes per line. Hence
with 1mb block size we risk ~1750 lines, i.e 875 task updates (as they come in pairs). Which
I think should be ok. Thoughts?

> HADOOP-3245 is incomplete
> -------------------------
>                 Key: HADOOP-4189
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4189
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
>            Priority: Blocker
>             Fix For: 0.19.0
>         Attachments: HADOOP-4189-v1.patch, HADOOP-4189-v2.patch, HADOOP-4189-v3.1.patch,
HADOOP-4189-v3.patch, HADOOP-4189.patch
> There are 2 issues with HADOOP-3245
> - The default block size for the history files in hadoop-default.conf is set to 0. This
file will be empty throughout. It should be made null.
> - Same goes for the buffer size. 
> - InterTrackerProtocol version needs to be bumped.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message