Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BA7D1200B4E for ; Thu, 16 Jun 2016 00:08:12 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B965B160A57; Wed, 15 Jun 2016 22:08:12 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id AD6AE160A4D for ; Thu, 16 Jun 2016 00:08:11 +0200 (CEST) Received: (qmail 4229 invoked by uid 500); 15 Jun 2016 22:08:10 -0000 Mailing-List: contact issues-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list issues@ambari.apache.org Received: (qmail 2893 invoked by uid 99); 15 Jun 2016 22:08:10 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jun 2016 22:08:10 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id CAEE72C1F71 for ; Wed, 15 Jun 2016 22:08:09 +0000 (UTC) Date: Wed, 15 Jun 2016 22:08:09 +0000 (UTC) From: "Hudson (JIRA)" To: issues@ambari.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (AMBARI-16651) Ambari 2.2.0 breaks backward compatibility with HDP 2.3.2 and below due to spark configs with hdp.version being removed MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 15 Jun 2016 22:08:13 -0000 [ https://issues.apache.org/jira/browse/AMBARI-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332698#comment-15332698 ] Hudson commented on AMBARI-16651: --------------------------------- FAILURE: Integrated in Ambari-trunk-Commit #5085 (See [https://builds.apache.org/job/Ambari-trunk-Commit/5085/]) AMBARI-16651: Ambari 2.2.0 breaks backward compatibility with HDP 2.3.2 (jluniya: [http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=515e1e99212b4c4473ba9ccca6ca34bad6d54e4c]) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/params.py * ambari-server/src/main/resources/common-services/SPARK/1.5.2/metainfo.xml * ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog240.java * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/setup_spark.py * ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py * ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog240Test.java * ambari-server/src/main/resources/common-services/SPARK/1.2.1/metainfo.xml * ambari-server/src/test/python/stacks/2.3/SPARK/test_spark_thrift_server.py * ambari-server/src/main/resources/common-services/SPARK/1.4.1/metainfo.xml * ambari-server/src/main/resources/common-services/SPARK/1.6.0/metainfo.xml * ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_client.py * ambari-server/src/main/resources/common-services/SPARK/1.3.1/metainfo.xml * ambari-server/src/main/resources/common-services/SPARK/1.2.1/configuration/spark-defaults.xml * ambari-server/src/main/resources/common-services/SPARK/1.2.1/configuration/spark-javaopts-properties.xml > Ambari 2.2.0 breaks backward compatibility with HDP 2.3.2 and below due to spark configs with hdp.version being removed > ----------------------------------------------------------------------------------------------------------------------- > > Key: AMBARI-16651 > URL: https://issues.apache.org/jira/browse/AMBARI-16651 > Project: Ambari > Issue Type: Bug > Components: stacks > Affects Versions: 2.4.0 > Reporter: Jayush Luniya > Assignee: Jayush Luniya > Priority: Critical > Fix For: 2.4.0 > > Attachments: AMBARI-16651.trunk.patch > > > In Ambari 2.2.0 few Spark properties were removed. This is because HDP 2.3.4 (Spark 1.5+) self-detects hdp version. > spark.driver.extraJavaOptions -Dhdp.version= > spark.yarn.am.extraJavaOptions -Dhdp.version= > However, removing these properties causes Ambari 2.2.0 + HDP 2.3.2 (Spark 1.4) to break as those properties were required. > This JIRA is to address this backward compatibility issue with HDP 2.3.2 and below caused after upgrading to Ambari 2.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)