Return-Path: X-Original-To: apmail-ambari-dev-archive@www.apache.org Delivered-To: apmail-ambari-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 18F28175D8 for ; Wed, 29 Oct 2014 02:00:37 +0000 (UTC) Received: (qmail 7650 invoked by uid 500); 29 Oct 2014 02:00:37 -0000 Delivered-To: apmail-ambari-dev-archive@ambari.apache.org Received: (qmail 7617 invoked by uid 500); 29 Oct 2014 02:00:37 -0000 Mailing-List: contact dev-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list dev@ambari.apache.org Received: (qmail 7605 invoked by uid 99); 29 Oct 2014 02:00:36 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Oct 2014 02:00:36 +0000 Date: Wed, 29 Oct 2014 02:00:36 +0000 (UTC) From: "Hudson (JIRA)" To: dev@ambari.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (AMBARI-7842) Ambari to manage tarballs on HDFS MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/AMBARI-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187896#comment-14187896 ] Hudson commented on AMBARI-7842: -------------------------------- SUCCESS: Integrated in Ambari-trunk-Commit-docker #40 (See [https://builds.apache.org/job/Ambari-trunk-Commit-docker/40/]) AMBARI-7842. Ambari to manage tarballs on HDFS (alejandro) (afernandez: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=d6652e8dc8fd5642ce89cfb683f62c4c98cd3bff) * ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/configuration/yarn-site.xml * ambari-server/src/main/resources/stacks/HDP/2.2/services/TEZ/configuration/tez-site.xml * ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/webhcat.py * ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/configuration-mapred/mapred-site.xml * ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/historyserver.py * ambari-server/src/test/python/stacks/2.2/configs/default.json * ambari-web/app/data/HDP2/site_properties.js * ambari-server/src/test/python/stacks/2.2/configs/secured.json * ambari-common/src/main/python/resource_management/libraries/functions/dynamic_variable_interpretation.py * ambari-server/src/main/resources/stacks/HDP/2.2/services/HIVE/configuration/webhcat-site.xml * ambari-server/src/main/resources/stacks/HDP/2.2/configuration/cluster-env.xml * ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py > Ambari to manage tarballs on HDFS > --------------------------------- > > Key: AMBARI-7842 > URL: https://issues.apache.org/jira/browse/AMBARI-7842 > Project: Ambari > Issue Type: Bug > Reporter: Alejandro Fernandez > Assignee: Alejandro Fernandez > Priority: Blocker > Attachments: AMBARI-7842.patch, AMBARI-7842_branch-1.7.0.patch, ambari_170_versioned_rpms.pptx > > > With HDP 2.2, Ambari needs to copy the tarballs/jars from the local file system to a certain location in HDFS. > The tarballs/jars no longer have a version number (either component version or HDP stack version + build) in the name), but the destination folder in HDFS does contain the HDP Version (e.g., 2.2.0.0-999). > {code} > /hdp/apps/$(hdp-stack-version) > |---- mapreduce/mapreduce.tar.gz > |---- mapreduce/hadoop-streaming.jar (which is needed by WebHcat. In the file system, it is a symlink to a versioned file, so HDFS needs to follow the link) > |---- tez/tez.tar.gz > |---- pig/pig.tar.gz > |---- hive/hive.tar.gz > |---- sqoop/sqoop.tar.gz > {code} > Furthermore, the folders created in HDFS need to have a permission of 0555, while files need 0444. > The owner should be hdfs, and the group should be hadoop. -- This message was sent by Atlassian JIRA (v6.3.4#6332)