ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk" <aonis...@hortonworks.com>
Subject Review Request 41199: Ats active Dir not created on HDFS through Installer
Date Thu, 10 Dec 2015 11:27:01 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41199/
-----------------------------------------------------------

Review request for Ambari and Dmytro Sen.


Bugs: AMBARI-14318
    https://issues.apache.org/jira/browse/AMBARI-14318


Repository: ambari


Description
-------

Ambari is deploying ATS v1.5. (ambari Version 2.2.0.0 ) But Active Dir is not created on HDFS
through Installer.
<property>
<name>
yarn.timeline-service.entity-group-fs-store.active-dir
</name>
<value>/atshistory/active</value>
</property>
hdfs@hn0-hb23-y:/root$ hdfs dfs -ls /
Found 10 items
drwxr-xr-x   - root   supergroup          0 2015-12-07 08:29 /HdiSamples
drwxr-xr-x   - hdfs   supergroup          0 2015-12-07 07:57 /ams
drwxr-xr-x   - hdfs   supergroup          0 2015-12-07 07:57 /amshbase
drwxrwxrwt   - yarn   supergroup          0 2015-12-07 11:04 /app-logs
drwxr-xr-x   - hdfs   supergroup          0 2015-12-07 08:32 /ats
drwxr-xr-x   - root   supergroup          0 2015-12-07 08:28 /example
drwxr-xr-x   - hdfs   supergroup          0 2015-12-07 07:53 /hdp
drwxr-x---   - mapred supergroup          0 2015-12-07 07:58 /mr-history
dr----x--t   - hdfs   supergroup          0 2015-12-07 07:59 /tmp
drwxr-xr-x   - hdfs   supergroup          0 2015-12-07 07:54 /user
Thus, all Yarn application/commands fail with below error.
2015-12-07 08:30:22,503|beaver.machine|INFO|55813|139928831948608|MainThread|RUNNING: /usr/hdp/current/hadoop-mapreduce-client/bin/mapred
job -list-active-trackers
2015-12-07 08:30:27,011|beaver.machine|INFO|55813|139928831948608|MainThread|15/12/07 08:30:27
INFO impl.TimelineClientImpl: Timeline service address: http://hn0-hb23-y.hb23-yarn1-ssh.h8.internal.cloudapp.net:8188/ws/v1/timeline/
2015-12-07 08:30:27,395|beaver.machine|INFO|55813|139928831948608|MainThread|15/12/07 08:30:27
INFO client.RMProxy: Connecting to ResourceManager at hn0-hb23-y.hb23-yarn1-ssh.h8.internal.cloudapp.net/10.0.0.14:8050
2015-12-07 08:30:27,918|beaver.machine|INFO|55813|139928831948608|MainThread|15/12/07 08:30:27
INFO client.AHSProxy: Connecting to Application History server at hn0-hb23-y.hb23-yarn1-ssh.h8.internal.cloudapp.net/10.0.0.14:10200
2015-12-07 08:30:29,351|beaver.machine|INFO|55813|139928831948608|MainThread|15/12/07 08:30:29
INFO service.AbstractService: Service org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl
failed in state STARTED; cause: java.io.IOException: /atshistory/active does not exist
2015-12-07 08:30:29,351|beaver.machine|INFO|55813|139928831948608|MainThread|java.io.IOException:
/atshistory/active does not exist
2015-12-07 08:30:29,351|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceStart(TimelineClientImpl.java:371)
2015-12-07 08:30:29,351|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceStart(YarnClientImpl.java:194)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapred.ResourceMgrDelegate.serviceStart(ResourceMgrDelegate.java:109)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapred.ResourceMgrDelegate.<init>(ResourceMgrDelegate.java:98)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapred.YARNRunner.<init>(YARNRunner.java:112)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:95)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
2015-12-07 08:30:29,352|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapreduce.tools.CLI.createCluster(CLI.java:405)
2015-12-07 08:30:29,353|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:256)
2015-12-07 08:30:29,353|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
2015-12-07 08:30:29,353|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
2015-12-07 08:30:29,353|beaver.machine|INFO|55813|139928831948608|MainThread|at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1266)
Ambari version hash
root@hn0-hb23-y:~# ambari-server --hash
4c7ce483795afe420774f173feb4159e942b8963


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/providers/hdfs_resource.py a016ad6


Diff: https://reviews.apache.org/r/41199/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message