hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Santosh Belda <santosh.be...@broadridge.com>
Subject wordcount example throwing null pointer with ConcurrentHashMap
Date Fri, 14 Oct 2011 05:10:01 GMT


Hi,

I have setup the hadoop on single node and worked fine but when executing
the wordcount example, following error is thornw, Is this any configuration
issue? 

 bin/hadoop jar hadoop-examples-0.20.2-cdh3u1.jar wordcount
/user/hduser/testfiles /user/hduser/output
11/10/14 10:29:53 INFO input.FileInputFormat: Total input paths to process :
3
11/10/14 10:29:53 WARN snappy.LoadSnappy: Snappy native library is available
11/10/14 10:29:53 INFO util.NativeCodeLoader: Loaded the native-hadoop
library
11/10/14 10:29:53 INFO snappy.LoadSnappy: Snappy native library loaded
11/10/14 10:29:53 INFO mapred.JobClient: Running job: job_201110141028_0001
11/10/14 10:29:54 INFO mapred.JobClient:  map 0% reduce 0%
11/10/14 10:29:59 INFO mapred.JobClient:  map 66% reduce 0%
11/10/14 10:30:01 INFO mapred.JobClient: Task Id :
attempt_201110141028_0001_r_000000_0, Status : FAILED
Error: java.lang.NullPointerException
        at
java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:768)
        at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.getMapCompletionEvents(ReduceTask.java:2824)
        at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.run(ReduceTask.java:2744)

11/10/14 10:30:02 INFO mapred.JobClient:  map 100% reduce 0%
11/10/14 10:30:03 INFO mapred.JobClient: Task Id :
attempt_201110141028_0001_r_000000_1, Status : FAILED
Error: java.lang.NullPointerException
        at
java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:768)
        at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.getMapCompletionEvents(ReduceTask.java:2824)
        at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.run(ReduceTask.java:2744)

11/10/14 10:30:05 INFO mapred.JobClient: Task Id :
attempt_201110141028_0001_r_000000_2, Status : FAILED
Error: java.lang.NullPointerException
        at
java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:768)
        at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.getMapCompletionEvents(ReduceTask.java:2824)
        at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.run(ReduceTask.java:2744)

11/10/14 10:30:08 INFO mapred.JobClient: Job complete: job_201110141028_0001
11/10/14 10:30:08 INFO mapred.JobClient: Counters: 18
11/10/14 10:30:08 INFO mapred.JobClient:   Job Counters
11/10/14 10:30:08 INFO mapred.JobClient:     Launched reduce tasks=4
11/10/14 10:30:08 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=9167
11/10/14 10:30:08 INFO mapred.JobClient:     Total time spent by all reduces
waiting after reserving slots (ms)=0
11/10/14 10:30:08 INFO mapred.JobClient:     Total time spent by all maps
waiting after reserving slots (ms)=0
11/10/14 10:30:08 INFO mapred.JobClient:     Launched map tasks=3
11/10/14 10:30:08 INFO mapred.JobClient:     Data-local map tasks=3
11/10/14 10:30:08 INFO mapred.JobClient:     Failed reduce tasks=1
11/10/14 10:30:08 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=3292
11/10/14 10:30:08 INFO mapred.JobClient:   FileSystemCounters
11/10/14 10:30:08 INFO mapred.JobClient:     FILE_BYTES_READ=740427
11/10/14 10:30:08 INFO mapred.JobClient:     HDFS_BYTES_READ=2863597
11/10/14 10:30:08 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=2161157
11/10/14 10:30:08 INFO mapred.JobClient:   Map-Reduce Framework
11/10/14 10:30:08 INFO mapred.JobClient:     Combine output records=87431
11/10/14 10:30:08 INFO mapred.JobClient:     Map input records=58570
11/10/14 10:30:08 INFO mapred.JobClient:     Spilled Records=138742
11/10/14 10:30:08 INFO mapred.JobClient:     Map output bytes=4774081
11/10/14 10:30:08 INFO mapred.JobClient:     Combine input records=487561
11/10/14 10:30:08 INFO mapred.JobClient:     Map output records=487561
11/10/14 10:30:08 INFO mapred.JobClient:     SPLIT_RAW_BYTES=361

-- 
View this message in context: http://old.nabble.com/wordcount-example-throwing-null-pointer-with-ConcurrentHashMap-tp32650178p32650178.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message