hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From psterk <Paul.St...@Sun.COM>
Subject Problem with com.sun.pinkdots.LogHandler
Date Mon, 16 Mar 2009 23:51:32 GMT

Hi,

I have been running a hadoop cluster successfully for a few months.  During
today's run, I am seeing a new error and it is not clear to me how to
resolve it. Below are the stack traces and the configure file I am using.
Please share any tips you may have.

Thanks,
Paul

09/03/16 16:28:25 INFO mapred.JobClient: Task Id :
task_200903161455_0003_m_000127_0, Status : FAILED
java.lang.ArrayIndexOutOfBoundsException: 3
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:71)
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:22)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
        at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

task_200903161455_0003_m_000127_0: Starting
null.task_200903161455_0003_m_000127_0
task_200903161455_0003_m_000127_0: Closing
task_200903161455_0003_m_000127_0: log4j:WARN No appenders could be found
for logger (org.apache.hadoop.mapred.TaskRu
task_200903161455_0003_m_000127_0: log4j:WARN Please initialize the log4j
system properly.
09/03/16 16:28:27 INFO mapred.JobClient: Task Id :
task_200903161455_0003_m_000128_0, Status : FAILED
java.lang.ArrayIndexOutOfBoundsException: 3
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:71)
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:22)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
        at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

task_200903161455_0003_m_000128_0: Starting
null.task_200903161455_0003_m_000128_0
task_200903161455_0003_m_000128_0: Closing
09/03/16 16:28:32 INFO mapred.JobClient: Task Id :
task_200903161455_0003_m_000128_1, Status : FAILED
java.lang.ArrayIndexOutOfBoundsException: 3
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:71)
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:22)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
        at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

task_200903161455_0003_m_000128_1: Starting
null.task_200903161455_0003_m_000128_1
task_200903161455_0003_m_000128_1: Closing
09/03/16 16:28:37 INFO mapred.JobClient: Task Id :
task_200903161455_0003_m_000127_1, Status : FAILED
java.lang.ArrayIndexOutOfBoundsException: 3
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:71)
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:22)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
        at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

:qsk_200903161455_0003_m_000127_1: Starting
null.task_200903161455_0003_m_000127_1
clear200903161455_0003_m_000127_1: Closing
task_200903161455_0003_m_000127_1: log4j:WARN No appenders could be found
for logger (org.apache.hadoop.ipc.Client).
task_200903161455_0003_m_000127_1: log4j:WARN Please initialize the log4j
system properly.
09/03/16 16:28:40 INFO mapred.JobClient: Task Id :
task_200903161455_0003_m_000128_2, Status : FAILED
java.lang.ArrayIndexOutOfBoundsException: 3
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:71)
        at com.sun.pinkdots.LogHandler$Mapper.map(LogHandler.java:22)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
        at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

task_200903161455_0003_m_000128_2: Starting
null.task_200903161455_0003_m_000128_2
task_200903161455_0003_m_000128_2: Closing
09/03/16 16:28:46 INFO mapred.JobClient:  map 100% reduce 100%
java.io.IOException: Job failed!
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1062)
        at com.sun.pinkdots.Main.handleLogs(Main.java:63)
        at com.sun.pinkdots.Main.main(Main.java:35)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
        at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220)


#
# First, setup the necessary filesystem locations
#
${HADOOP}/bin/hadoop dfs -rmr hdfs:///user/${USER}/pinkdots
${HADOOP}/bin/hadoop dfs -copyFromLocal \
  file://${HOME}/pinkdots/config/glassfish_admin.xml \
  hdfs:///user/${USER}/pinkdots/config/glassfish_admin.xml
${HADOOP}/bin/hadoop dfs -copyFromLocal \
  file://${HOME}/pinkdots/data/combined/hits_all.txt \
  hdfs:///user/${USER}/pinkdots/data/combined/hits_all.txt
${HADOOP}/bin/hadoop dfs -mkdir
hdfs:///user/${USER}/pinkdots/work/tile_handler

#
# Then run the actual job
#
${HADOOP}/bin/hadoop --config ${HADOOP}/conf \
  jar ${HOME}/pinkdots/dist/pinkdots.jar \
  com.sun.pinkdots.Main \
  hdfs:///user/${USER}/pinkdots/config/glassfish_admin.xml \
  hdfs:///user/${USER}/pinkdots/data/combined \
  hdfs:///user/${USER}/pinkdots/work/log_handler \
  hdfs:///user/${USER}/pinkdots/work/tile_handler \
  file://${HOME}/pinkdots/tiles.zip


-- 
View this message in context: http://www.nabble.com/Problem-with-com.sun.pinkdots.LogHandler-tp22550022p22550022.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.


Mime
View raw message