ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Onischuk <aonis...@hortonworks.com>
Subject Review Request 42849: Add Oozie limits.conf for Oozie User as done for HDFS/YARN
Date Wed, 27 Jan 2016 10:29:53 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42849/
-----------------------------------------------------------

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-14808
    https://issues.apache.org/jira/browse/AMBARI-14808


Repository: ambari


Description
-------

There are only 3 coordinators running.

from the oozie log

    
    
    
    2016-01-20 16:30:24,746 ERROR ActionCheckXCommand:517 - SERVER[hcube2-1n03.eng.hortonworks.com]
USER[hcube] GROUP[-] TOKEN[] APP[hcube-hive-superapp] JOB[0000014-160119174957821-oozie-oozi-W]
ACTION[00000
    14-160119174957821-oozie-oozi-W@clean_0864_D5E7AAD611D3EB92C000B4B2D86C964F] Error,
    java.lang.OutOfMemoryError: unable to create new native thread
            at java.lang.Thread.start0(Native Method)
            at java.lang.Thread.start(Thread.java:714)
            at java.util.Timer.<init>(Timer.java:176)
            at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl$LogFDsCache.<init>(TimelineClientImpl.java:1018)
            at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceStart(TimelineClientImpl.java:390)
            at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
            at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceStart(YarnClientImpl.java:194)
            at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
            at org.apache.hadoop.mapred.ResourceMgrDelegate.serviceStart(ResourceMgrDelegate.java:109)
            at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
            at org.apache.hadoop.mapred.ResourceMgrDelegate.<init>(ResourceMgrDelegate.java:98)
            at org.apache.hadoop.mapred.YARNRunner.<init>(YARNRunner.java:112)
            at org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34)
            at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:95)
            at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
            at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
            at org.apache.hadoop.mapred.JobClient.init(JobClient.java:475)
            at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:454)
            at org.apache.oozie.service.HadoopAccessorService$3.run(HadoopAccessorService.java:462)
            at org.apache.oozie.service.HadoopAccessorService$3.run(HadoopAccessorService.java:460)
            at java.security.AccessController.doPrivileged(Native Method)
            at javax.security.auth.Subject.doAs(Subject.java:415)
            at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
            at org.apache.oozie.service.HadoopAccessorService.createJobClient(HadoopAccessorService.java:460)
            at org.apache.oozie.action.hadoop.JavaActionExecutor.createJobClient(JavaActionExecutor.java:1336)
            at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1384)
            at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:182)
            at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
            at org.apache.oozie.command.XCommand.call(XCommand.java:286)
            at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)
            at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)
            at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
            at java.lang.Thread.run(Thread.java:745)


Diffs
-----

  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/configuration/oozie-env.xml
1b1c8e5 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
ba56c26 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py
89cf8e7 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/templates/oozie.conf.j2
PRE-CREATION 
  ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_client.py dd36ba9 
  ambari-server/src/test/python/stacks/2.0.6/OOZIE/test_oozie_server.py 971faf1 

Diff: https://reviews.apache.org/r/42849/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message