hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arv Mistry" <...@kindsight.net>
Subject Could not obtain block blk ...
Date Wed, 18 Feb 2009 03:05:34 GMT
I am using hadoop 18.3, I have a single datanode and it appears to be up and running fine.
I'm able to read/write data to it.
 
However, when I try to spawn a map/reduce job it fails with "Could not obtain block: blk_3263745172951227264_1155
file   =/opt/kindsight/hadoop/data/mapred/system/job_200902171547_0001/job.xml"
 
I noticed in the logs the following exception. I have not specified a mapred.fairscheduler.allocation.file
but I have another machine(s) running the same configuration and that seems to work. If I
do have to specify that file how do I do it and whats the format of the file?
 
Any help would be appreciated.
 
2009-02-17 15:47:03,304 WARN org.apache.hadoop.mapred.PoolManager: No mapred.fairscheduler.allocation.file
given in jobconf - the fair scheduler will    not use any queues.
2009-02-17 15:47:03,319 INFO org.apache.hadoop.mapred.FairScheduler: Successfully configured
FairScheduler
2009-02-17 15:47:17,338 ERROR org.apache.hadoop.mapred.PoolManager: Failed to reload allocations
file - will use existing allocations.
java.lang.NullPointerException
        at java.io.File.<init>(File.java:222)
        at org.apache.hadoop.mapred.PoolManager.reloadAllocsIfNecessary(PoolManager.java:116)
        at org.apache.hadoop.mapred.FairScheduler.assignTasks(FairScheduler.java:226)
        at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:1288)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
2009-02-17 15:52:29,611 INFO org.apache.hadoop.dfs.DFSClient: Could not obtain block blk_3263745172951227264_1155
from any node:  java.io.IOException:    No live nodes contain current block
2009-02-17 15:52:32,617 INFO org.apache.hadoop.dfs.DFSClient: Could not obtain block blk_3263745172951227264_1155
from any node:  java.io.IOException:    No live nodes contain current block
2009-02-17 15:52:35,626 INFO org.apache.hadoop.dfs.DFSClient: Could not obtain block blk_3263745172951227264_1155
from any node:  java.io.IOException:    No live nodes contain current block
2009-02-17 15:52:38,631 WARN org.apache.hadoop.dfs.DFSClient: DFS Read: java.io.IOException:
Could not obtain block: blk_3263745172951227264_1155 file   =/opt/kindsight/hadoop/data/mapred/system/job_200902171547_0001/job.xml
        at org.apache.hadoop.dfs.DFSClient$DFSInputStream.chooseDataNode(DFSClient.java:1470)
        at org.apache.hadoop.dfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:1320)
        at org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:1425)
        at java.io.DataInputStream.read(DataInputStream.java:83)
        at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:47)

Cheers Arv

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message