hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mathias De Maré <mathias.dem...@gmail.com>
Subject Re: JobTracker crashing
Date Wed, 22 Jul 2009 07:16:08 GMT
Hi,


On Fri, Jul 17, 2009 at 5:37 PM, Bogdan M. Maryniuk <
bogdan.maryniuk@gmail.com> wrote:

> 2009/7/17 Mathias De Maré <mathias.demare@gmail.com>:
> > I'm using Hadoop 0.20.0 (semidistributed mode, or whatever it's called --
> I
> > can't look up the name, since the documentation on the site seems to be
> > down), and I'm experiencing a JobTracker crash every time I start Hadoop.
>
> What is output of "hadoop dfsadmin -report" ?


bin/hadoop dfsadmin -report
Configured Capacity: 99214172160 (92.4 GB)
Present Capacity: 82849009664 (77.16 GB)
DFS Remaining: 82848985088 (77.16 GB)
DFS Used: 24576 (24 KB)
DFS Used%: 0%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0

-------------------------------------------------
Datanodes available: 1 (1 total, 0 dead)

Name: 127.0.0.1:50010
Decommission Status : Normal
Configured Capacity: 99214172160 (92.4 GB)
DFS Used: 24576 (24 KB)
Non DFS Used: 16365162496 (15.24 GB)
DFS Remaining: 82848985088(77.16 GB)
DFS Used%: 0%
DFS Remaining%: 83.51%
Last contact: Wed Jul 22 09:02:18 CEST 2009



>
>
> Doc site is not down:
> http://hadoop.apache.org/common/docs/current/quickstart.html


It was down when I checked :-)

>
> Also very carefully follow this:
>
> http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster)<http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Single-Node_Cluster%29>
> (since you're on 0.20, config bit differs, but that's nothing
> serious).


I went over the steps, and it looks like I did the same (only I didn't
create a dedicated user and I didn't disable IPv6, since I can use it here).
Oh, and I noticed one more thing: when I start Hadoop by running
bin/start-dfs.sh, wait about 20 seconds for everything to get set up and
then run bin/start-mapred.sh, everything works fine.

With the JUnit tests and MiniMRCluster, there's the following error:
09/07/22 09:15:21 ERROR mapred.MiniMRCluster: Job tracker crashed
java.lang.NullPointerException
        at java.io.File.<init>(File.java:222)
        at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:151)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1559)
        at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:174)
        at
org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:101)
        at java.lang.Thread.run(Thread.java:619)


Mathias

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message