ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick Dimiduk (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-14751) Ambari not setting hdp.version in config files
Date Thu, 17 Mar 2016 20:00:35 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200260#comment-15200260
] 

Nick Dimiduk commented on AMBARI-14751:
---------------------------------------

I'm happy to extract debugging information from my cluster, but this is impacting my prod
cluster, not staging, so i'm unwilling to experiment with it. The current state is that this
variable isn't substituted anywhere; I've gone through all my service configs and replaced
the variable with the explicit value. I don't think it's isolated to a single service because
it impacted HBase, MR2, and non-MR YARN applications. Basically everything deployed on the
cluster.

> Ambari not setting hdp.version in config files
> ----------------------------------------------
>
>                 Key: AMBARI-14751
>                 URL: https://issues.apache.org/jira/browse/AMBARI-14751
>             Project: Ambari
>          Issue Type: Bug
>    Affects Versions: 2.2.0
>            Reporter: Nick Dimiduk
>            Assignee: Dmitry Lysnichenko
>            Priority: Critical
>             Fix For: 2.2.2
>
>
> After dealing with a number of arcane failures, I've tracked down the issue to ambari
not rendering config files correctly. This manifests mostly MR and Spark job submission failures.
For example,
> {noformat}
> $ hbase org.apache.hadoop.hbase.mapreduce.RowCounter -libjars /usr/hdp/current/phoenix-client/phoenix-server.jar
-Dhbase.client.scanner.caching=1000 -Dmapreduce.map.speculative=false TEST
> ...
> Exception in thread "main" java.lang.IllegalArgumentException: Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework'
as a URI, check the setting for mapreduce.application.framework.path
>         at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:443)
>         at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:142)
>         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
>         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
>         at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
>         at org.apache.hadoop.hbase.mapreduce.RowCounter.main(RowCounter.java:210)
> Caused by: java.net.URISyntaxException: Illegal character in path at index 11: /hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework
>         at java.net.URI$Parser.fail(URI.java:2848)
>         at java.net.URI$Parser.checkChars(URI.java:3021)
>         at java.net.URI$Parser.parseHierarchical(URI.java:3105)
>         at java.net.URI$Parser.parse(URI.java:3063)
>         at java.net.URI.<init>(URI.java:588)
>         at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:441)
>         ... 9 more
> {noformat}
> Restarting ambari-server + redeploying configs does not help.
> {noformat}
> $ dpkg -s ambari-server
> Package: ambari-server
> Status: install ok installed
> Priority: extra
> Section: universe/admin
> Installed-Size: 457149
> Maintainer: Hortonworks
> Architecture: amd64
> Version: 2.2.0.0-1310
> Depends: openssl, postgresql (>= 8.1), python (>= 2.6), curl
> Description: Ambari Server
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message