hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shobin joseph (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5039) Configuration getInt is called From vaidya, but it actually need a float calculation(The values always be a Floating Poin Number)
Date Fri, 01 Mar 2013 11:01:13 GMT
shobin joseph created MAPREDUCE-5039:
----------------------------------------

             Summary: Configuration getInt is called From vaidya, but it actually need a float
calculation(The values always be a Floating Poin Number)
                 Key: MAPREDUCE-5039
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5039
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: contrib/vaidya
    Affects Versions: 0.23.1
         Environment: hadoop-2.0.0-mr1-cdh4.1.2, Ubuntu 10.04
            Reporter: shobin joseph


when we run the vaidya scrpit in hadoop-2.0.0-mr1-cdh4.1.2.

Exception:java.lang.NumberFormatException: For input string: "0.05"java.lang.NumberFormatException:
For input string: "0.05"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Integer.parseInt(Integer.java:458)
at java.lang.Integer.parseInt(Integer.java:499)
at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:887)
at org.apache.hadoop.vaidya.postexdiagnosis.tests.MapSideDiskSpill.getPrescription(MapSideDiskSpill.java:99)
at org.apache.hadoop.vaidya.DiagnosticTest.getReportElement(DiagnosticTest.java:283)
at org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.main(PostExPerformanceDiagnoser.java:254)

In the job conf file
the properties are like

<property><name>mapred.reduce.slowstart.completed.maps</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>

<property><name>io.sort.record.percent</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>

<property><name>io.sort.spill.percent</name><value>0.80</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>

all the above lines throw the exception.

The important thing is default values for the above properties are 0.05 and 0.8 

But the getInt() Function takes only integer values, if not it takes only the integer part.
In Hadoop io.sort.spill.percent,io.sort.record.percent,mapred.reduce.slowstart.completed.maps
are expressed as Floating Point Numbers.




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message