hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5039) Configuration getInt is called From vaidya, but it actually need a float calculation(The values always be a Floating Poin Number)
Date Tue, 05 Mar 2013 05:45:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593092#comment-13593092

Harsh J commented on MAPREDUCE-5039:

I seem to have looked at a past Apache release's src/ directory when posting that, instead
of the current trunk. You are correct that vaidya is no longer maintained/available on trunk
and is probably shelved.

What version are you looking at a fix for? What version of Hadoop are you using Vaidya with?
> Configuration getInt is called From vaidya, but it actually need a float calculation(The
values always be a Floating Poin Number)
> ---------------------------------------------------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-5039
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5039
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/vaidya
>    Affects Versions: 0.23.1
>         Environment: hadoop-2.0.0-mr1-cdh4.1.2, Ubuntu 10.04
>            Reporter: shobin joseph
>   Original Estimate: 60h
>  Remaining Estimate: 60h
> when we run the vaidya scrpit in hadoop-2.0.0-mr1-cdh4.1.2.
> Exception:java.lang.NumberFormatException: For input string: "0.05"java.lang.NumberFormatException:
For input string: "0.05"
> at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
> at java.lang.Integer.parseInt(Integer.java:458)
> at java.lang.Integer.parseInt(Integer.java:499)
> at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:887)
> at org.apache.hadoop.vaidya.postexdiagnosis.tests.MapSideDiskSpill.getPrescription(MapSideDiskSpill.java:99)
> at org.apache.hadoop.vaidya.DiagnosticTest.getReportElement(DiagnosticTest.java:283)
> at org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.main(PostExPerformanceDiagnoser.java:254)
> In the job conf file
> the properties are like
> <property><name>mapred.reduce.slowstart.completed.maps</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> <property><name>io.sort.record.percent</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> <property><name>io.sort.spill.percent</name><value>0.80</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> all the above lines throw the exception.
> The important thing is default values for the above properties are 0.05 and 0.8 
> But the getInt() Function takes only integer values, if not it takes only the integer
> In Hadoop io.sort.spill.percent,io.sort.record.percent,mapred.reduce.slowstart.completed.maps
are expressed as Floating Point Numbers.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message