spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kiszk <...@git.apache.org>
Subject [GitHub] spark issue #22001: [SPARK-24819][CORE] Fail fast when no enough slots to la...
Date Tue, 14 Aug 2018 06:16:32 GMT
Github user kiszk commented on the issue:

    https://github.com/apache/spark/pull/22001
  
    Just curious.
    
    It is very interesting to me since the recent three tries consistently cause a timeout
failure at the same test.
    https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94687
    https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94705
    https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94716
    
    In addition, other PRs look successful without timeout.
    
    ```
    [info] - abort the job if total size of results is too large (1 second, 122 milliseconds)
    Exception in thread "task-result-getter-3" java.lang.Error: java.lang.InterruptedException
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1148)
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    	at java.lang.Thread.run(Thread.java:745)
    Caused by: java.lang.InterruptedException
    	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998)
    	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
    	at scala.concurrent.impl.Promise$DefaultPromise.tryAwait(Promise.scala:206)
    	at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:222)
    	at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:227)
    	at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:220)
    	at org.apache.spark.network.BlockTransferService.fetchBlockSync(BlockTransferService.scala:115)
    	at org.apache.spark.storage.BlockManager.getRemoteBytes(BlockManager.scala:701)
    	at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$1.apply$mcV$sp(TaskResultGetter.scala:82)
    	at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$1.apply(TaskResultGetter.scala:63)
    	at org.apache.spark.scheduler.TaskResultGetter$$anon$3$$anonfun$run$1.apply(TaskResultGetter.scala:63)
    	at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1932)
    	at org.apache.spark.scheduler.TaskResultGetter$$anon$3.run(TaskResultGetter.scala:62)
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    	... 2 more
    ```


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message