hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-9089) Error when cleaning up in spark.log [Spark Branch]
Date Fri, 12 Dec 2014 17:06:13 GMT
Xuefu Zhang created HIVE-9089:
---------------------------------

             Summary: Error when cleaning up in spark.log [Spark Branch]
                 Key: HIVE-9089
                 URL: https://issues.apache.org/jira/browse/HIVE-9089
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Xuefu Zhang


Error in logged in spark.log. It might be an concurrency issue:
{code}
2014-12-11 05:24:58,690 ERROR [delete Spark local dirs]: storage.DiskBlockManager (Logging.scala:logError(96))
- Exception while deleting local spark dir: /tmp/spark-local-20141211052409-61ef
java.io.IOException: Failed to list files for dir: /tmp/spark-local-20141211052409-61ef/24
	at org.apache.spark.util.Utils$.listFilesSafely(Utils.scala:745)
	at org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:763)
	at org.apache.spark.util.Utils$$anonfun$deleteRecursively$1.apply(Utils.scala:765)
	at org.apache.spark.util.Utils$$anonfun$deleteRecursively$1.apply(Utils.scala:763)
	at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
	at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:34)
	at org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:763)
	at org.apache.spark.storage.DiskBlockManager$$anonfun$stop$1.apply(DiskBlockManager.scala:171)
	at org.apache.spark.storage.DiskBlockManager$$anonfun$stop$1.apply(DiskBlockManager.scala:168)
	at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
	at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
	at org.apache.spark.storage.DiskBlockManager.stop(DiskBlockManager.scala:168)
	at org.apache.spark.storage.DiskBlockManager$$anon$1$$anonfun$run$1.apply$mcV$sp(DiskBlockManager.scala:159)
	at org.apache.spark.storage.DiskBlockManager$$anon$1$$anonfun$run$1.apply(DiskBlockManager.scala:157)
	at org.apache.spark.storage.DiskBlockManager$$anon$1$$anonfun$run$1.apply(DiskBlockManager.scala:157)
	at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1460)
	at org.apache.spark.storage.DiskBlockManager$$anon$1.run(DiskBlockManager.scala:157)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message