hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6664) fs.inmemory.size.mb not listed in conf. Cluster setup page gives wrong advice.
Date Tue, 20 Apr 2010 19:08:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859024#action_12859024

Chris Douglas commented on HADOOP-6664:

Sorry for closing the issue prematurely, but I'm still unclear on what this issue is about.
It sounded like you were saying that {{io.sort.factor}} and {{io.sort.mb}} belong in mapred-default.xml
rather than core-default.xml, which I thought I'd answered by noting that these parameters
are also used in o.a.h.io.SequenceFile (which is in core, not mapred). Given that {{fs.inmemory.size.mb}}
is unused, that it doesn't appear in the default configs is also correct.

bq. the generated documentation on the site is wrong. 
bq. the generated xml files in the src directory are putting variables in the wrong files.

How? Can you either explain what is "wrong" or post a patch correcting the error?

> fs.inmemory.size.mb not listed in conf. Cluster setup page gives wrong advice.
> ------------------------------------------------------------------------------
>                 Key: HADOOP-6664
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6664
>             Project: Hadoop Common
>          Issue Type: Task
>          Components: conf, documentation
>    Affects Versions: 0.20.2
>            Reporter: Edward Capriolo
> http://hadoop.apache.org/common/docs/current/cluster_setup.html
> fs.inmemory.size.mb does not appear in any xml file
> {noformat}
> grep "fs.inmemory.size.mb" ./mapred/mapred-default.xml 
> [edward@ec src]$ grep "fs.inmemory.size.mb" ./hdfs/hdfs-default.xml 
> [edward@ec src]$ grep "fs.inmemory.size.mb" ./core/core-default.xml 
> {noformat}
> http://hadoop.apache.org/common/docs/current/cluster_setup.html
> Documentation error:
> Real-World Cluster Configurations
> {noformat}
> conf/core-site.xml  	io.sort.factor  	100  	More streams merged at once while sorting
> conf/core-site.xml 	io.sort.mb 	200 	Higher memory-limit while sorting data.
> {noformat}
> core --- io.sort.factor					-- should be mapred
> core --- io.sort.mb					-- should be mapred

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message