From dev-return-145873-archive-asf-public=cust-asf.ponee.io@hive.apache.org Thu Jan 25 17:14:17 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id E3A59180651 for ; Thu, 25 Jan 2018 17:14:17 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id D3C25160C3D; Thu, 25 Jan 2018 16:14:17 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 266C8160C13 for ; Thu, 25 Jan 2018 17:14:16 +0100 (CET) Received: (qmail 75159 invoked by uid 500); 25 Jan 2018 16:14:15 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 75147 invoked by uid 99); 25 Jan 2018 16:14:15 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Jan 2018 16:14:15 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id C65421A03B1 for ; Thu, 25 Jan 2018 16:14:14 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id qhmu5UA0Ev_z for ; Thu, 25 Jan 2018 16:14:13 +0000 (UTC) Received: from mail-ot0-f174.google.com (mail-ot0-f174.google.com [74.125.82.174]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id D4F2A5FBEE for ; Thu, 25 Jan 2018 16:14:12 +0000 (UTC) Received: by mail-ot0-f174.google.com with SMTP id t35so7140469otd.13 for ; Thu, 25 Jan 2018 08:14:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=OvoV/yuBJ4pFCBt9LLgKMh/rMcRON4jKVYU4QP5AmS0=; b=Lr5jmRz64KKHHJcF06RgG6NfSvB67kRrpLP4cmWkbOULvnVocSAD1hn2ZH7Tx5RJZd T8y/ay8eYIE/zCfj5iHPJApKxNC5YjZEBoKLEaL0goi5maHcDcvw5a2NYHspCE8dcDLX mnsQT0/XU35JVD5fYig+Pvt6nKXBI1QG0wwk7sp6B14aOao44F8L2NmAvfCQLWtZFIRB rD/XcaQjDG35bXy219G7VnSw0GkFGyFKH25SLzn83IGNqOB9GCxFQyZmtqhn5wHuvle0 NmXL3Ywb3CkG7nDfMDlnrN4feUVqULif7Xwmg0Y0DqRgP5PotJqOlUOUunyyRw6UyRTA pslA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=OvoV/yuBJ4pFCBt9LLgKMh/rMcRON4jKVYU4QP5AmS0=; b=ZNp4+HqLah5VuOVjSGx/pX67TeZzvMpz1CU1z4FbcNG9jB6wSYSSOExUZc7MKOCnrl Gm+3wwxWqZNV4r3GtowrTGEeQ9FGZd9Kz/1toEU2qCNrpgWEmIjfGKZQebcwkR15c1Ch zeajBNk1BZFOf2CItr8sdMabytYyriddq9jNafq3Nt/EYuZvY/3wKh06hz879OM981dY uECVkO/e8hLGGcxOJ53mxVCpoO4FDPA+VhJ5VbreiG4fjMZ90xsTD3Ph9cYLIFIv2hFi OXTuEDAKiiZ5yxFaXsQQ52dziBJAFvWP0fvG9HuctvKrQNLwGqyzV2u8H+Kz9Lrx34Nl Buaw== X-Gm-Message-State: AKwxytd48lYzPVElLX9LMUBA/yi78HhBNXM7dfiesWzHnmCktE3hRJBl nh48sFemRair0Bz+gaOEPEq1mJCvu/YI3nNN9w6+BA== X-Google-Smtp-Source: AH8x2253DtQ3AOh1I5aN53lcRWPoYBSaFN0TGBvWO/c0qqgDbi16WpNjv897TbnLu8C3n863+jCkd6lQhPQZJh4aiwY= X-Received: by 10.157.48.5 with SMTP id d5mr12586091otc.132.1516896851227; Thu, 25 Jan 2018 08:14:11 -0800 (PST) MIME-Version: 1.0 Received: by 10.168.182.205 with HTTP; Thu, 25 Jan 2018 08:13:30 -0800 (PST) In-Reply-To: References: From: Alexander Kolbasov Date: Thu, 25 Jan 2018 08:13:30 -0800 Message-ID: Subject: Re: Hive packaging and the standalone metastore To: dev@hive.apache.org Content-Type: multipart/alternative; boundary="001a113d0142fa9f0f05639c114c" --001a113d0142fa9f0f05639c114c Content-Type: text/plain; charset="UTF-8" Alan, While continuing shipping HMS with Hive makes sense (at least for a while), what do you think about somehow separating lib/bin directories created in the distro so Hive and metastore have a separate set of bin/lib dirs? - Alex On Wed, Jan 24, 2018 at 12:16 PM, Alan Gates wrote: > In HIVE-17983 I have been working on packaing and start/stop scripts for > the standalone metastore. One question this brings up is how Hive will be > released now, with or without the metastore. I can see two options: > > 1) We continue to ship the metastore with Hive. Not only does this mean > the metastore code is in the Hive source code release and the metastore > jars are in the Hive binary distribution, but scripts like metastore.sh are > still included in Hive's bin directory, so that Hive admins can still do > 'hive --service metastore' to start the metastore. I see the following > advantages of this: > a) it is completely backwards compatible; > b) it is what users would expect (I have installed many databases and never > been asked to first install a separate package for its data catalog or any > other essential piece); > c) this will still be the metastore's most frequent use case for at least > the near future. > > The disadvantage is it is error prone when Hive is set up to connect to a > separate metastore. An operator could easily start the metastore in the > Hive package, not realizing Hive is configured to connect to a different > one. > > 2) We remove the metastore from the packaging completely like we do Hadoop > and require the user to install it separately. The advantages and > disadvantages of this exactly mirror those of option 1. > > Based on both the 80/20 rule (most metastore users will still be single > system Hive users) and the law of least astonishment (people expect a > database to have a data catalog) I vote for option 1. > > Anyone strongly feel we should do 2 instead? > > Any other options I haven't considered? > > Alan. > --001a113d0142fa9f0f05639c114c--