apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ambarish Pande <ambarish.pande2...@gmail.com>
Subject Re: Apex Application failing to run.
Date Sun, 04 Sep 2016 20:21:16 GMT
Thank You so much for your help. It is working now.



On Mon, Sep 5, 2016 at 1:15 AM, Thomas Weise <thomas.weise@gmail.com> wrote:

> Since it is the virtual memory, please see:
>
> http://docs.datatorrent.com/configuration/#hadoop-tuning
>
> --
> sent from mobile
> On Sep 4, 2016 12:10 PM, "Munagala Ramanath" <ram@datatorrent.com> wrote:
>
>> It looks like there is not enough memory for all the containers. If you're
>> running in the sandbox, how much memory is allocated to the sandbox ?
>> Can you try increasing it ?
>>
>> There is also a detailed discussion of how to manage memory using
>> configuration
>> parameters in the properties files at: http://docs.datatorrent.co
>> m/tutorials/topnwords-c7/
>>
>> As a first step, can you simply build the archetype generated project
>> (without copying
>> over the source files for the word count application) and try to run the
>> resulting app ?
>> It has only 2 operators and so minimal memory requirements. If it runs,
>> it will confirm
>> that your setup is OK but availability of adequate memory is the issue.
>>
>> Ram
>>
>> On Sun, Sep 4, 2016 at 11:47 AM, Ambarish Pande <
>> ambarish.pande2011@gmail.com> wrote:
>>
>>> Hello Guys,
>>>
>>> I have followed the steps shown in this video https://www.youtube.com/
>>> watch?v=LwRWBudOjg4&feature=youtu.be to build my first apex
>>> application. My application is failing and the following diagnostics report
>>> is shown in the web admin interface on master:8088
>>>
>>> ----------
>>>
>>> Application application_1473011986197_0001 failed 2 times due to AM
>>> Container for appattempt_1473011986197_0001_000002 exited with
>>> exitCode: -103
>>> For more detailed output, check application tracking page:
>>> http://master:8088/cluster/app/application_1473011986197_0001Then,
>>> click on links to logs of each attempt.
>>> Diagnostics: Container [pid=8339,containerID=containe
>>> r_1473011986197_0001_02_000001] is running beyond virtual memory
>>> limits. Current usage: 254.7 MB of 1 GB physical memory used; 2.4 GB of 2.1
>>> GB virtual memory used. Killing container.
>>> Dump of the process-tree for container_1473011986197_0001_02_000001 :
>>> |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS)
>>> SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
>>> |- 8389 8339 8339 8339 (java) 976 19 2575908864 64519
>>> /usr/lib/jvm/java-8-oracle/bin/java -Djava.io.tmpdir=/home/hadoopu
>>> ser/tmp/nm-local-dir/usercache/hadoopuser/appcache/applicati
>>> on_1473011986197_0001/container_1473011986197_0001_02_000001/tmp
>>> -Xmx768m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/dt-heap-1.bin
>>> -Dhadoop.root.logger=INFO,RFA -Dhadoop.log.dir=/home/hadoopu
>>> ser/hadoop/logs/userlogs/application_1473011986197_0001/
>>> container_1473011986197_0001_02_000001 -Ddt.attr.APPLICATION_PATH=hdf
>>> s://master:54310/user/hadoopuser/datatorrent/apps/application_1473011986197_0001
>>> com.datatorrent.stram.StreamingAppMaster
>>> |- 8339 8337 8339 8339 (bash) 0 0 17043456 679 /bin/bash -c
>>> /usr/lib/jvm/java-8-oracle/bin/java -Djava.io.tmpdir=/home/hadoopu
>>> ser/tmp/nm-local-dir/usercache/hadoopuser/appcache/applicati
>>> on_1473011986197_0001/container_1473011986197_0001_02_000001/tmp
>>> -Xmx768m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/dt-heap-1.bin
>>> -Dhadoop.root.logger=INFO,RFA -Dhadoop.log.dir=/home/hadoopu
>>> ser/hadoop/logs/userlogs/application_1473011986197_0001/
>>> container_1473011986197_0001_02_000001 -Ddt.attr.APPLICATION_PATH=hdf
>>> s://master:54310/user/hadoopuser/datatorrent/apps/application_1473011986197_0001
>>> com.datatorrent.stram.StreamingAppMaster 1>/home/hadoopuser/hadoop/logs
>>> /userlogs/application_1473011986197_0001/container_147301198
>>> 6197_0001_02_000001/AppMaster.stdout 2>/home/hadoopuser/hadoop/logs
>>> /userlogs/application_1473011986197_0001/container_147301198
>>> 6197_0001_02_000001/AppMaster.stderr
>>> Container killed on request. Exit code is 143
>>> Container exited with a non-zero exit code 143
>>> Failing this attempt. Failing the application.
>>>
>>>
>>> ----------
>>>
>>>
>>> Any help would be appreciated.
>>>
>>> Thank you in advance.
>>>
>>>
>>>
>>>
>>

Mime
View raw message