ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-21068) Kafka broker goes down after Ambari upgrade from 2.5.0 to 2.5.1 due to missing 'kafka.timeline.metrics.instanceId' property
Date Sat, 20 May 2017 00:56:04 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-21068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16018217#comment-16018217
] 

Hudson commented on AMBARI-21068:
---------------------------------

FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #7506 (See [https://builds.apache.org/job/Ambari-trunk-Commit/7506/])
AMBARI-21068 : Kafka broker goes down after Ambari upgrade from 2.5.0 to (avijayan: [http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=c9f705de801aac16f7da4550bcd180ff56b8c685])
* (edit) ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog251Test.java
* (edit) ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog251.java
AMBARI-21068 : Kafka broker goes down after Ambari upgrade from 2.5.0 to (avijayan: [http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=d740384e8059d9d7b12d7ae99e7423a92c4df4bf])
* (edit) ambari-server/src/main/resources/common-services/HIVE/2.1.0.3.0/package/templates/hadoop-metrics2-hivemetastore.properties.j2
* (edit) ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/templates/hadoop-metrics2.properties.j2
* (edit) ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/HadoopTimelineMetricsSink.java
* (edit) ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/templates/hadoop-metrics2-hivemetastore.properties.j2
* (edit) ambari-metrics/ambari-metrics-hadoop-sink/src/test/java/org/apache/hadoop/metrics2/sink/timeline/HadoopTimelineMetricsSinkTest.java
* (edit) ambari-metrics/ambari-metrics-storm-sink-legacy/src/main/java/org/apache/hadoop/metrics2/sink/storm/StormTimelineMetricsReporter.java
* (edit) ambari-server/src/main/resources/common-services/STORM/1.0.1.3.0/package/templates/config.yaml.j2
* (edit) ambari-server/src/main/resources/common-services/STORM/0.9.1/package/templates/storm-metrics2.properties.j2
* (edit) ambari-server/src/main/resources/stacks/HDP/2.6/services/HDFS/configuration/hadoop-metrics2.properties.xml
* (edit) ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/templates/hadoop-metrics2-hbase.properties-GANGLIA-MASTER.j2
* (edit) ambari-server/src/main/resources/common-services/STORM/1.0.1.3.0/package/templates/storm-metrics2.properties.j2
* (edit) ambari-server/src/main/resources/common-services/KAFKA/0.10.0.3.0/configuration/kafka-broker.xml
* (edit) ambari-server/src/main/resources/common-services/HIVE/2.1.0.3.0/package/templates/hadoop-metrics2-llapdaemon.j2
* (edit) ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/templates/hadoop-metrics2-hbase.properties.j2
* (edit) ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/templates/flume-metrics2.properties.j2
* (edit) ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/templates/hadoop-metrics2-hiveserver2.properties.j2
* (edit) ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/templates/hadoop-metrics2-llaptaskscheduler.j2
* (edit) ambari-server/src/main/resources/common-services/HIVE/2.1.0.3.0/package/templates/hadoop-metrics2-llaptaskscheduler.j2
* (edit) ambari-metrics/ambari-metrics-storm-sink/src/main/java/org/apache/hadoop/metrics2/sink/storm/StormTimelineMetricsSink.java
* (edit) ambari-server/src/main/resources/common-services/KAFKA/0.8.1/configuration/kafka-broker.xml
* (edit) ambari-server/src/main/resources/common-services/HIVE/2.1.0.3.0/package/templates/hadoop-metrics2-hiveserver2.properties.j2
* (edit) ambari-server/src/main/resources/stacks/HDP/3.0/hooks/before-START/templates/hadoop-metrics2.properties.j2
* (edit) ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/templates/hadoop-metrics2-hbase.properties-GANGLIA-RS.j2
* (edit) ambari-server/src/main/resources/common-services/HDFS/3.0.0.3.0/configuration/hadoop-metrics2.properties.xml
* (edit) ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/templates/hadoop-metrics2-llapdaemon.j2
* (edit) ambari-server/src/main/resources/common-services/STORM/0.9.1/package/templates/config.yaml.j2
* (edit) ambari-metrics/ambari-metrics-kafka-sink/src/main/java/org/apache/hadoop/metrics2/sink/kafka/KafkaTimelineMetricsReporter.java
* (edit) ambari-metrics/ambari-metrics-storm-sink-legacy/src/main/java/org/apache/hadoop/metrics2/sink/storm/StormTimelineMetricsSink.java
* (edit) ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/templates/hadoop-metrics2-accumulo.properties.j2


> Kafka broker goes down after Ambari upgrade from 2.5.0 to 2.5.1 due to missing 'kafka.timeline.metrics.instanceId'
property
> ---------------------------------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-21068
>                 URL: https://issues.apache.org/jira/browse/AMBARI-21068
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-upgrade
>    Affects Versions: 2.5.1
>            Reporter: Vivek Sharma
>            Assignee: Dmytro Sen
>            Priority: Blocker
>              Labels: upgrade
>             Fix For: 2.5.1
>
>         Attachments: AMBARI-21068-addendum-2.5.patch, AMBARI-21068-addendum-trunk.patch,
AMBARI-21075-branch-2.5.patch, AMBARI-21075.patch
>
>
> STR:
> 1. Deploy HDP-2.6.0 cluster with Ambari-2.5.0.3
> 2. Upgrade Ambari to 2.5.1.0-130 (hash: e7745e411638405dd0a406305e1da222c6879daa)
> 3. Observed that Kafka broker went down
> Kafka logs indicate:
> {code}
> [2017-05-19 03:42:17,105] FATAL  (kafka.Kafka$)
> java.lang.IllegalArgumentException: requirement failed: Missing required property 'kafka.timeline.metrics.instanceId'
>         at scala.Predef$.require(Predef.scala:233)
>         at kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177)
>         at org.apache.hadoop.metrics2.sink.kafka.KafkaTimelineMetricsReporter.init(KafkaTimelineMetricsReporter.java:169)
>         at kafka.metrics.KafkaMetricsReporter$$anonfun$startReporters$1.apply(KafkaMetricsReporter.scala:66)
>         at kafka.metrics.KafkaMetricsReporter$$anonfun$startReporters$1.apply(KafkaMetricsReporter.scala:64)
>         at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
>         at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:34)
>         at kafka.metrics.KafkaMetricsReporter$.startReporters(KafkaMetricsReporter.scala:64)
>         at kafka.server.KafkaServerStartable$.fromProps(KafkaServerStartable.scala:27)
>         at kafka.Kafka$.main(Kafka.scala:58)
>         at kafka.Kafka.main(Kafka.scala)
> {code}
> Did not see this property being added on ambari_upgrade_config_changes.json file



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message