hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5039) Configuration getInt is called From vaidya, but it actually need a float calculation(The values always be a Floating Poin Number)
Date Fri, 01 Mar 2013 11:27:14 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Harsh J updated MAPREDUCE-5039:
-------------------------------

    Hadoop Flags:   (was: Incompatible change)
    
> Configuration getInt is called From vaidya, but it actually need a float calculation(The
values always be a Floating Poin Number)
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5039
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5039
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/vaidya
>    Affects Versions: 0.23.1
>         Environment: hadoop-2.0.0-mr1-cdh4.1.2, Ubuntu 10.04
>            Reporter: shobin joseph
>   Original Estimate: 60h
>  Remaining Estimate: 60h
>
> when we run the vaidya scrpit in hadoop-2.0.0-mr1-cdh4.1.2.
> Exception:java.lang.NumberFormatException: For input string: "0.05"java.lang.NumberFormatException:
For input string: "0.05"
> at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
> at java.lang.Integer.parseInt(Integer.java:458)
> at java.lang.Integer.parseInt(Integer.java:499)
> at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:887)
> at org.apache.hadoop.vaidya.postexdiagnosis.tests.MapSideDiskSpill.getPrescription(MapSideDiskSpill.java:99)
> at org.apache.hadoop.vaidya.DiagnosticTest.getReportElement(DiagnosticTest.java:283)
> at org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.main(PostExPerformanceDiagnoser.java:254)
> In the job conf file
> the properties are like
> <property><name>mapred.reduce.slowstart.completed.maps</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> <property><name>io.sort.record.percent</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> <property><name>io.sort.spill.percent</name><value>0.80</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> all the above lines throw the exception.
> The important thing is default values for the above properties are 0.05 and 0.8 
> But the getInt() Function takes only integer values, if not it takes only the integer
part.
> In Hadoop io.sort.spill.percent,io.sort.record.percent,mapred.reduce.slowstart.completed.maps
are expressed as Floating Point Numbers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message