hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5064) TestRumenJobTraces failing on 1.3.x
Date Wed, 13 Mar 2013 09:54:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13600995#comment-13600995
] 

Steve Loughran commented on MAPREDUCE-5064:
-------------------------------------------

later log
{code}
013-03-13 09:43:45,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199))
- Adding job_20130313094330609_0001 for user-log deletion with retainTimeStamp:1363254225852
JOB_SUBMITTED
JOB_PRIORITY_CHANGED
JOB_STATUS_CHANGED
JOB_INITED
JOB_INFO_CHANGED
TASK_STARTED
SETUP_ATTEMPT_STARTED
SETUP_ATTEMPT_FINISHED
MAP_ATTEMPT_FINISHED
TASK_UPDATED
TASK_FINISHED
JOB_STATUS_CHANGED
TASK_STARTED
MAP_ATTEMPT_STARTED
MAP_ATTEMPT_FINISHED
MAP_ATTEMPT_FINISHED
TASK_UPDATED
TASK_FINISHED
TASK_STARTED
REDUCE_ATTEMPT_STARTED
REDUCE_ATTEMPT_FINISHED
REDUCE_ATTEMPT_FINISHED
TASK_UPDATED
TASK_FINISHED
TASK_STARTED
CLEANUP_ATTEMPT_STARTED
CLEANUP_ATTEMPT_FINISHED
MAP_ATTEMPT_FINISHED
TASK_UPDATED
TASK_FINISHED
JOB_STATUS_CHANGED
JOB_FINISHED
2013-03-13 09:43:48,006 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedJobAPI(236))
- Validating ParsedJob.obtainXXX api... for job_20130313094330609_0001
2013-03-13 09:43:48,006 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedTaskAPI(290))
- Validating ParsedTask.obtainXXX api... for task_20130313094330609_0001_m_000000
2013-03-13 09:43:48,007 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedTaskAttemptAPI(323))
- Validating ParsedTaskAttempt.obtainXXX api... for attempt_20130313094330609_0001_m_000000_0
2013-03-13 09:43:48,007 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedTaskAPI(290))
- Validating ParsedTask.obtainXXX api... for task_20130313094330609_0001_r_000000
2013-03-13 09:43:48,007 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedTaskAttemptAPI(323))
- Validating ParsedTaskAttempt.obtainXXX api... for attempt_20130313094330609_0001_r_000000_0
2013-03-13 09:43:48,007 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedTaskAPI(290))
- Validating ParsedTask.obtainXXX api... for task_20130313094330609_0001_m_000002
2013-03-13 09:43:48,007 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedTaskAttemptAPI(323))
- Validating ParsedTaskAttempt.obtainXXX api... for attempt_20130313094330609_0001_m_000002_0
2013-03-13 09:43:48,007 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedTaskAPI(290))
- Validating ParsedTask.obtainXXX api... for task_20130313094330609_0001_m_000001
2013-03-13 09:43:48,007 INFO  rumen.TestRumenJobTraces (TestRumenJobTraces.java:validateParsedTaskAttemptAPI(323))
- Validating ParsedTaskAttempt.obtainXXX api... for attempt_20130313094330609_0001_m_000001_0
2013-03-13 09:43:48,009 INFO  mapred.TaskTracker (TaskTracker.java:run(1080)) - Shutting down:
Map-events fetcher for all reduce tasks on tracker_host0.foo.com:localhost/127.0.0.1:57455
2013-03-13 09:43:48,009 INFO  filecache.TrackerDistributedCacheManager (TrackerDistributedCacheManager.java:run(1025))
- Cleanup...
java.lang.InterruptedException: sleep interrupted
	at java.lang.Thread.sleep(Native Method)
	at org.apache.hadoop.filecache.TrackerDistributedCacheManager$CleanupThread.run(TrackerDistributedCacheManager.java:1020)
2013-03-13 09:43:48,009 INFO  ipc.Server (Server.java:stop(1594)) - Stopping server on 57455
2013-03-13 09:43:48,010 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 1 on
57455: exiting
2013-03-13 09:43:48,010 INFO  metrics.RpcInstrumentation (RpcInstrumentation.java:shutdown(154))
- shut down
2013-03-13 09:43:48,010 INFO  ipc.Server (Server.java:run(467)) - Stopping IPC Server listener
on 57455
2013-03-13 09:43:48,010 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 0 on
57455: exiting
2013-03-13 09:43:48,010 INFO  mapred.TaskTracker (TaskTracker.java:shutdown(1438)) - Shutting
down StatusHttpServer
2013-03-13 09:43:48,010 INFO  ipc.Server (Server.java:run(664)) - Stopping IPC Server Responder
2013-03-13 09:43:48,012 INFO  mortbay.log (Slf4jLog.java:info(67)) - Stopped SelectChannelConnector@0.0.0.0:0
2013-03-13 09:43:48,085 ERROR impl.MetricsSinkAdapter (MetricsSinkAdapter.java:publishMetricsFromQueue(158))
- Got sink exception and over retry limit, suppressing further error messages
org.apache.hadoop.metrics2.MetricsException: Failed to putMetrics
	at org.apache.hadoop.metrics2.sink.ganglia.GangliaSink30.putMetrics(GangliaSink30.java:129)
	at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.publishMetrics(MetricsSinkAdapter.java:180)
	at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$1.consume(MetricsSinkAdapter.java:60)
	at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$1.consume(MetricsSinkAdapter.java:58)
	at org.apache.hadoop.metrics2.impl.SinkQueue.consumeAll(SinkQueue.java:82)
	at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.publishMetricsFromQueue(MetricsSinkAdapter.java:135)
	at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$2.run(MetricsSinkAdapter.java:94)
Caused by: java.io.IOException: Host is down
	at java.net.PlainDatagramSocketImpl.send(Native Method)
	at java.net.DatagramSocket.send(DatagramSocket.java:625)
	at org.apache.hadoop.metrics2.sink.ganglia.AbstractGangliaSink.emitToGangliaHosts(AbstractGangliaSink.java:265)
	at org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31.emitMetric(GangliaSink31.java:88)
	at org.apache.hadoop.metrics2.sink.ganglia.GangliaSink30.putMetrics(GangliaSink30.java:120)
	... 6 more
2013-03-13 09:43:48,116 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1905)) - Interrupted.
Closing down.
2013-03-13 09:43:48,117 INFO  mapred.JobTracker (JobTracker.java:close(2188)) - Stopping infoServer
2013-03-13 09:43:48,118 INFO  mortbay.log (Slf4jLog.java:info(67)) - Stopped SelectChannelConnector@localhost:0
2013-03-13 09:43:48,220 INFO  mapred.JobTracker (JobTracker.java:close(2196)) - Stopping interTrackerServer
2013-03-13 09:43:48,220 INFO  ipc.Server (Server.java:stop(1594)) - Stopping server on 57453
2013-03-13 09:43:48,220 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 5 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 1 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 8 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 4 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 2 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 0 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 9 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(664)) - Stopping IPC Server Responder
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 7 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 6 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(1433)) - IPC Server handler 3 on
57453: exiting
2013-03-13 09:43:48,221 INFO  ipc.Server (Server.java:run(467)) - Stopping IPC Server listener
on 57453
2013-03-13 09:43:48,221 INFO  metrics.RpcInstrumentation (RpcInstrumentation.java:shutdown(154))
- shut down
2013-03-13 09:43:48,222 INFO  mapred.JobTracker (JobTracker.java:close(2200)) - Stopping expireTrackers
2013-03-13 09:43:48,222 INFO  mapred.JobTracker (JobTracker.java:offerService(2172)) - Stopped
interTrackerServer
2013-03-13 09:43:48,222 INFO  mapred.JobTracker (JobTracker.java:close(2209)) - Stopping retirer
2013-03-13 09:43:48,223 INFO  mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:terminate(107))
- Stopping Job Init Manager thread
2013-03-13 09:43:48,223 INFO  mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(61))
- JobInitManagerThread interrupted.
2013-03-13 09:43:48,223 INFO  mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(65))
- Shutting down thread pool
2013-03-13 09:43:48,223 INFO  mapred.JobTracker (JobTracker.java:close(2221)) - Stopping expireLaunchingTasks
2013-03-13 09:43:48,224 INFO  mapred.JobTracker (JobTracker.java:close(2240)) - Stopping job
history server
2013-03-13 09:43:48,224 INFO  mapred.JobTracker (JobTracker.java:close(2248)) - stopped all
jobtracker services
testCurrentJHParser validating using gold std 
2013-03-13 09:43:48,253 WARN  rumen.ZombieJob (ZombieJob.java:sanitizeValue(244)) - NumberMaps
not defined for null
2013-03-13 09:43:48,253 WARN  rumen.ZombieJob (ZombieJob.java:sanitizeValue(244)) - NumberReduces
not defined for null
2013-03-13 09:43:48,272 INFO  compress.CodecPool (CodecPool.java:getDecompressor(128)) - Got
brand-new decompressor
------------- ---------------- ---------------
------------- Standard Error -----------------
In LoggedJob, we saw the unknown attribute numberMaps.
In LoggedJob, we saw the unknown attribute numberReduces.
------------- ---------------- ---------------

Testcase: testSmallTrace took 0.98 sec
Testcase: testTruncatedTask took 0.155 sec
Testcase: testRumenViaDispatch took 0.563 sec
Testcase: testBracketedCounters took 0.109 sec
Testcase: testHadoop20JHParser took 0 sec
Testcase: testJobHistoryFilenameParsing took 0.015 sec
Testcase: testProcessInputArgument took 0.047 sec
Testcase: testCurrentJHParser took 17.638 sec
	FAILED
Content mismatch expected:<[MA]P_ATTEMPT_STARTED> but was:<[SETU]P_ATTEMPT_STARTED>
junit.framework.AssertionFailedError: Content mismatch expected:<[MA]P_ATTEMPT_STARTED>
but was:<[SETU]P_ATTEMPT_STARTED>
	at org.apache.hadoop.tools.rumen.TestRumenJobTraces.testCurrentJHParser(TestRumenJobTraces.java:779)
{code}
                
> TestRumenJobTraces failing on 1.3.x
> -----------------------------------
>
>                 Key: MAPREDUCE-5064
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5064
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 1.3.0
>         Environment: OS/X, java 1.6.0_41, GMT, home network (no DNS)
>            Reporter: Steve Loughran
>            Priority: Minor
>         Attachments: TEST-org.apache.hadoop.tools.rumen.TestRumenJobTraces.txt
>
>
> {{TestRumenJobTraces.testCurrentJHParser()}} is failing locally, both in a bulk test
and standalone

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message