Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 29FA017F2D for ; Mon, 11 May 2015 22:38:53 +0000 (UTC) Received: (qmail 63115 invoked by uid 500); 11 May 2015 22:38:52 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 63031 invoked by uid 500); 11 May 2015 22:38:52 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 62177 invoked by uid 99); 11 May 2015 22:38:51 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 May 2015 22:38:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 36CF5C20B6 for ; Mon, 11 May 2015 22:38:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.102 X-Spam-Level: X-Spam-Status: No, score=-0.102 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id gXn_uk7pZieB for ; Mon, 11 May 2015 22:38:50 +0000 (UTC) Received: from mail-pd0-f181.google.com (mail-pd0-f181.google.com [209.85.192.181]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 439E1261FB for ; Mon, 11 May 2015 22:38:50 +0000 (UTC) Received: by pdbnk13 with SMTP id nk13so157103160pdb.0 for ; Mon, 11 May 2015 15:38:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=uSF6aEx6JLbqFErgUEYEZrNHZAsNdF9bSf+Qx9dx69A=; b=PeEBMYSJgixqj18I7uzLbDY3qcR6xJXspMg2uqBP8TL4/NdRiCU4752KKt81t7bl7J 1alicHUpv+p7yFDx/orsiWNf26OR2WlEL/OZIUtpgFWyAhcLfrzCTBk5IqAlHJv9Csm/ ximVigm1810HGGjOn/5St9BszHg3pXeK/zWfx9pdfZYZodyoG/5DxraWduKRTRbWwzfQ 9J2IwPTGW0LwNCL1YLNuceds2VmFjYG4okSckRqpapcgsuoxJ0FB443azFO0ZMGKs2ug 8/UphcFYxtTz2Iw1hbsEDYxWG+9jQKPKwWb1qGpLMUjcH8zBgoP68hQjfefn6RfLIYVP u9Vw== X-Received: by 10.70.53.99 with SMTP id a3mr22604122pdp.169.1431383884788; Mon, 11 May 2015 15:38:04 -0700 (PDT) Received: from Alan-Gatess-MacBook-Pro.local ([192.175.27.15]) by mx.google.com with ESMTPSA id dc8sm14120757pdb.23.2015.05.11.15.38.03 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 11 May 2015 15:38:04 -0700 (PDT) Message-ID: <55512F4A.2080907@gmail.com> Date: Mon, 11 May 2015 15:38:02 -0700 From: Alan Gates User-Agent: Postbox 3.0.11 (Macintosh/20140602) MIME-Version: 1.0 To: "dev@hive.apache.org" Subject: [DISCUSS] Supporting Hadoop-1 and experimental features Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit There is a lot of forward-looking work going on in various branches of Hive: LLAP, the HBase metastore, and the work to drop the CLI. It would be good to have a way to release this code to users so that they can experiment with it. Releasing it will also provide feedback to developers. At the same time there are discussions on whether to keep supporting Hadoop-1. The burden of supporting older, less used functionality such as Hadoop-1 is becoming ever harder as many new features are added. I propose that the best way to deal with this would be to make a branch-1. We could continue to make new feature releases off of this branch (1.3, 1.4, etc.). This branch would not drop old functionality. This provides stability and continuity for users and developers. We could then merge these new features branches (LLAP, HBase metastore, CLI drop) into the trunk, as well as turn on by default newer features such as the vectorization and ACID. We could also drop older, less used features such as support for Hadoop-1 and MapReduce. It will be a while before we are ready to make stable, production ready releases of this code. But we could start making alpha quality releases soon. We would call these releases 2.x, to stress the non-backward compatible changes such as dropping Hadoop-1. This will give users a chance to play with the new code and developers a chance to get feedback. Thoughts?