hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nigel Daley (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-794) JobTracker crashes with ArithmeticException
Date Thu, 07 Dec 2006 18:30:21 GMT
JobTracker crashes with ArithmeticException
-------------------------------------------

                 Key: HADOOP-794
                 URL: http://issues.apache.org/jira/browse/HADOOP-794
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.9.1
            Reporter: Nigel Daley


The sort benchmark on 20 nodes failed for me with an ArithmeticException.  Sort.java calculates
the number of maps and reduces dynamically based on the cluster size.  I'm guessing at the
time it did the calculation, the jobtracker had heard from 0 task trackers (which seems odd
since I wait 1 minute after starting the jobtracker before starting Sort).

>From the job output:
Running on 0 nodes to sort from /sortBenchmark20/input into /sortBenchmark20/output with 0
reduces.

>From the JobTracker log:
2006-12-07 07:10:06,709 ERROR org.apache.hadoop.mapred.JobTracker: Job initialization failed:
java.lang.ArithmeticException: / by zero
        at org.apache.hadoop.mapred.InputFormatBase.getSplits(InputFormatBase.java:130)
        at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:125)
        at org.apache.hadoop.mapred.JobTracker$JobInitThread.run(JobTracker.java:326)
        at java.lang.Thread.run(Thread.java:595)

The jobtacker should check for illegal inputs like this and not fall over.


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message