reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tyson Condie <tcondie.apa...@gmail.com>
Subject Brain/Heap dump
Date Fri, 06 Oct 2017 22:41:07 GMT
Does REEF provide any mechanisms for doing a process brain dump;
specifically, I'd like to get the current state of the heap space in order
to track down problems such as this:

*Application failed due to:*

*Java heap space*

*With stack trace:*

*java.lang.OutOfMemoryError: Java heap space*

*at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:84)*

*at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:59)*

*at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:119)*

*at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:366)*

*at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)*

*at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1965)*

*at
org.apache.reef.runtime.yarn.driver.UploaderToJobFolder.uploadToJobFolder(UploaderToJobfolder.java:83)*

*at
org.apache.reef.runtime.yarn.driver.EvaluatorSetupHelper.getResources(EvaluatorSetupHelper.java:116)*

*at
org.apache.reef.runtime.yarn.driver.YARNResourceLaunchHandler.onNext(YARNResourceLaunchHandler.java:83)*

*at
org.apache.reef.runtime.yarn.driver.YARNResourceLaunchHandler.onNext(YARNResourceLaunchHandler.java:47)*

*at
org.apache.reef.runtime.common.driver.evaluator.EvaluatorManager.onResourceLaunch(EvaluatorManager.java:557)*

*at
org.apache.reef.runtime.common.driver.evaluator.AllocatedEvaluatorImpl.resourceBuildAndLaunch(AllocatedEvaluatorImpl.java:266)*

*at
org.apache.reef.runtime.common.driver.evaluator.AllocatedEvaluatorImpl.launch(AllocatedEvaluatorImpl.java:228)*

*at
org.apache.reef.runtime.common.driver.evaluator.AllocatedEvaluatorImpl.submitContextAndTask(AllocatedEvaluatorImpl.java:164)*

*at
microsoft.cosmos.yarnpp.GenericPlatform.runtime.core.RuntimeDriver$AllocatedEvaluatorHandler.onNext(RuntimeDriver.java:156)*

*at
microsoft.cosmos.yarnpp.GenericPlatform.runtime.core.RuntimeDriver$AllocatedEvaluatorHandler.onNext(RuntimeDriver.java:145)*

*at
org.apache.reef.runtime.common.utils.BroadCastEventHandler.onNext(BroadCastEventHandler.java:40)*

*at
org.apache.reef.util.ExceptionHandlingEventHandler.onNext(ExceptionHandlingEventHandler.java:46)*

*at
org.apache.reef.runtime.common.utils.DispatchingEStage$1.onNext(DispatchingEStage.java:72)*

*at
org.apache.reef.runtime.common.utils.DispatchingEStage$1.onNext(DispatchingEStage.java:69)*

*at
org.apache.reef.wake.impl.ThreadPoolStage$1.run(ThreadPoolStage.java:182)*

*at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)*

*at java.util.concurrent.FutureTask.run(FutureTask.java:266)*

*at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)*

*at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)*

*at java.lang.Thread.run(Thread.java:745)*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message