hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the gridmix TT logs
Date Wed, 01 Jun 2011 20:04:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042392#comment-13042392
] 

Thomas Graves commented on MAPREDUCE-2555:
------------------------------------------

 The exceptions are generated by status updates sent by the child after it reports 'done'
to the TaskTracker. Ideally
this should not happen.

The fix for MAPREDUCE-2429 is meant to ignore such calls (since the child jvm is effectively
not supposed to exist after the done call is processed).

In previous versions - the statusUpdate RPC would return success but would ignore the request.
This exception is effectively replacing another message from previous version (Ignoring status-update
since task is
'done'). With the current code - the statusUpdate RPC fails - which causes the Child to retry
- effectively generating way more messages in the logs.


> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
>                 Key: MAPREDUCE-2555
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.20.204.0
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Minor
>
> Observing a  lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121,
call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException:
JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed.
Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430:
--
>       at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
>       at java.security.AccessController.doPrivileged(Native Method)
>       at javax.security.auth.Subject.doAs(Subject.java:396)
>       at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>       at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message