spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dongjoon Hyun (Jira)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-31233) Enhance RpcTimeoutException Log Message
Date Tue, 21 Apr 2020 21:11:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dongjoon Hyun updated SPARK-31233:
----------------------------------
    Summary: Enhance RpcTimeoutException Log Message  (was: TimeoutException contains null
remoteAddr)

> Enhance RpcTimeoutException Log Message
> ---------------------------------------
>
>                 Key: SPARK-31233
>                 URL: https://issues.apache.org/jira/browse/SPARK-31233
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.1.0
>            Reporter: Yi Huang
>            Assignee: Yi Huang
>            Priority: Minor
>             Fix For: 3.1.0
>
>
> Application log: 
> {code:java}
> Failed to process batch org.apache.spark.rpc.RpcTimeoutException: Futures timed out after
[800 seconds]. This timeout is controlled by spark.network.timeout:
> org.apache.spark.rpc.RpcTimeout.org
> $apache$spark$rpc$RpcTimeout$$createRpcTimeoutException(RpcTimeout.scala:47)
> {code}
> Driver log:
> {code:java}
> [block-manager-ask-thread-pool-149] WARN org.apache.spark.storage.BlockManagerMaster
- Failed to remove RDD 25344 - Cannot receive any reply from null in 800 seconds. This timeout
is controlled by spark.network.timeout org.apache.spark.rpc.RpcTimeoutException: Cannot receive
any reply from null in 800 seconds. This timeout is controlled by spark.network.timeout{code}
> The log message does not provide RpcAddress of the destination RpcEndpoint. It is due
to 
> {noformat}
> * The `rpcAddress` may be null, in which case the endpoint is registered via a client-only
> * connection and can only be reached via the client that sent the endpoint reference.{noformat}
>  Solution:
> using rpcAdress from client of the NettyRpcEndpoingRef once such endpoint resides in
client mode.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message