hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James P. White (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1013) ArithmeticException when number of racks is zero
Date Tue, 13 Feb 2007 04:44:05 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12472518
] 

James P. White commented on HADOOP-1013:
----------------------------------------

The first thing in the log indicates trouble ahead:

[root@domU-12-31-34-00-00-D9 hadoop-0.11.0]# more /mnt/hadoop/logs/hadoop-root-namenode-domU-12-31-34-00-00-D9.log

2007-02-12 23:22:53,292 INFO org.apache.hadoop.dfs.StateChange: STATE* Network topology has
0 racks and 0 datanodes
2007-02-12 23:22:53,550 INFO org.mortbay.util.Credential: Checking Resource aliases
2007-02-12 23:22:53,659 INFO org.mortbay.http.HttpServer: Version Jetty/5.1.4
2007-02-12 23:22:54,475 INFO org.mortbay.util.Container: Started org.mortbay.jetty.servlet.WebApplicationHandler@17ee8b8
2007-02-12 23:22:54,573 INFO org.mortbay.util.Container: Started WebApplicationContext[/,/]
2007-02-12 23:22:54,573 INFO org.mortbay.util.Container: Started HttpContext[/logs,/logs]
2007-02-12 23:22:54,573 INFO org.mortbay.util.Container: Started HttpContext[/static,/static]
2007-02-12 23:22:54,576 INFO org.mortbay.http.SocketListener: Started SocketListener on 0.0.0.0:50070
2007-02-12 23:22:54,576 INFO org.mortbay.util.Container: Started org.mortbay.jetty.Server@10385c1
2007-02-12 23:22:54,617 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 50001: starting
2007-02-12 23:22:54,618 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 50001:
starting
2007-02-12 23:22:54,618 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 50001:
starting
2007-02-12 23:22:54,618 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 50001:
starting
2007-02-12 23:22:54,618 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 50001:
starting
2007-02-12 23:22:54,619 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 50001:
starting
2007-02-12 23:22:54,619 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 50001:
starting
2007-02-12 23:22:54,619 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 50001:
starting
2007-02-12 23:22:54,619 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 50001:
starting
2007-02-12 23:22:54,619 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 50001:
starting
2007-02-12 23:22:54,619 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 50001:
starting
2007-02-12 23:22:57,441 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete:
failed to remove /mnt/hadoop/mapred/.system.crc
 because it does not exist
2007-02-12 23:22:57,453 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete:
failed to remove /mnt/hadoop/mapred/system beca
use it does not exist
2007-02-12 23:25:02,841 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete:
failed to remove /user/root/.test-mini-mr.crc b
ecause it does not exist
2007-02-12 23:25:02,842 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete:
failed to remove /user/root/test-mini-mr becaus
e it does not exist
2007-02-12 23:25:03,056 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 50001 call
error: java.io.IOException: java.lang.ArithmeticExcep
tion: / by zero
java.io.IOException: java.lang.ArithmeticException: / by zero
...


> ArithmeticException when number of racks is zero
> ------------------------------------------------
>
>                 Key: HADOOP-1013
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1013
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.11.0
>         Environment: EC2
>            Reporter: James P. White
>
> It seems that if something is wrong in the configuration that results in the number of
racks being zero, the symptom is a divide-by-zero exception.
> [root@domU-12-31-34-00-03-2F ~]# cd /usr/local/hadoop-0.11.0/
> [root@domU-12-31-34-00-03-2F hadoop-0.11.0]# bin/hadoop jar hadoop-0.11.0-examples.jar
pi 10 10000000
> Number of Maps = 10 Samples per Map = 10000000
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.ArithmeticException:
/ by zero
>         at org.apache.hadoop.dfs.FSNamesystem$Replicator.chooseTarget(FSNamesystem.java:2593)
>         at org.apache.hadoop.dfs.FSNamesystem$Replicator.chooseTarget(FSNamesystem.java:2555)
>         at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:684)
>         at org.apache.hadoop.dfs.NameNode.create(NameNode.java:248)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:337)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:538)
>         at org.apache.hadoop.ipc.Client.call(Client.java:467)
>         at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:164)
>         at org.apache.hadoop.dfs.$Proxy0.create(Unknown Source)
>         at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.locateNewBlock(DFSClient.java:1091)
>         at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:1031)
>         at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1255)
>         at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1345)
>         at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
>         at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
>         at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
>         at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:98)
>         at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
>         at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
>         at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
>         at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:724)
>         at org.apache.hadoop.examples.PiEstimator.launch(PiEstimator.java:185)
>         at org.apache.hadoop.examples.PiEstimator.main(PiEstimator.java:226)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
>         at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:143)
>         at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:40)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
> [root@domU-12-31-34-00-03-2F hadoop-0.11.0]# 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message