Return-Path: 
 <dev-return-3866-apmail-crunch-dev-archive=crunch.apache.org@crunch.apache.org>
X-Original-To: apmail-crunch-dev-archive@www.apache.org
Delivered-To: apmail-crunch-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id B0B6B10523
	for <apmail-crunch-dev-archive@www.apache.org>;
 Mon, 10 Feb 2014 08:31:06 +0000 (UTC)
Received: (qmail 98533 invoked by uid 500); 10 Feb 2014 08:31:06 -0000
Delivered-To: apmail-crunch-dev-archive@crunch.apache.org
Received: (qmail 98380 invoked by uid 500); 10 Feb 2014 08:31:04 -0000
Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@crunch.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@crunch.apache.org>
List-Post: <mailto:dev@crunch.apache.org>
List-Id: <dev.crunch.apache.org>
Reply-To: dev@crunch.apache.org
Delivered-To: mailing list dev@crunch.apache.org
Received: (qmail 98362 invoked by uid 99); 10 Feb 2014 08:31:03 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Feb 2014 08:31:03 +0000
X-ASF-Spam-Status: No, hits=2.2 required=10
	tests=HTML_MESSAGE,MSGID_FROM_MTA_HEADER,RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of stepinto@live.com designates
 65.55.116.41 as permitted sender)
Received: from [65.55.116.41] (HELO blu0-omc1-s30.blu0.hotmail.com)
 (65.55.116.41)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Feb 2014 08:30:56 +0000
Received: from BLU0-SMTP65 ([65.55.116.9]) by blu0-omc1-s30.blu0.hotmail.com
 with Microsoft SMTPSVC(6.0.3790.4675);
	 Mon, 10 Feb 2014 00:30:35 -0800
X-TMN: [HCul7dm15r0Llf/n8Ens1XLQvOWr7WEz]
X-Originating-Email: [stepinto@live.com]
Message-ID: <BLU0-SMTP65FD146F5D44BCF52A4183AD900@phx.gbl>
Received: from mail-wi0-f169.google.com ([209.85.212.169]) by
 BLU0-SMTP65.phx.gbl over TLS secured channel with Microsoft
 SMTPSVC(6.0.3790.4675);
	 Mon, 10 Feb 2014 00:30:35 -0800
Received: by mail-wi0-f169.google.com with SMTP id e4so2459494wiv.2
        for <multiple recipients>; Mon, 10 Feb 2014 00:30:33 -0800 (PST)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20130820;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        bh=Pwoedx9f4nEx0xC51ZbyZsWAYwMcqPiUuMiGz5fSmXE=;
        b=aPusfYuQPBUUTlcD4LVN6Oq4S9CIid3ASMfg8ZuWi6UyM7MywEF9wDWnW7r5rTihk2
         3mi2xy8WMyb3JsS8+FSAd/bK5ts9fyrXnHPD6CKo7iQlPA8nr/H5ms0WrkrI4lbZi1If
         egMyjXmZonDLVwTdaVdJLPEUZc1hzH44wHJXoituVL9aiS8P2Rbkza6/9mL3ewy9W7HI
         j/x7GvX56xW7QQq8JSw/IC1qbLv8Wti9ekzNoMYOTammPX5Qn1UjW4KX3ZS9pnBxZqDn
         3MiHA2re7wpjUyefeYUeiuEVUxStrgAoFeaG79UYrpS1PLhA73gZjIm3AtIqs1WzfOeT
         Tjww==
X-Received: by 10.180.103.227 with SMTP id fz3mr9289178wib.29.1392021033931;
 Mon, 10 Feb 2014 00:30:33 -0800 (PST)
MIME-Version: 1.0
Received: by 10.194.138.233 with HTTP; Mon, 10 Feb 2014 00:30:12 -0800 (PST)
In-Reply-To: 
 <CA+H5GPx1VAhG6As__8S02vg97LtzrqMzYmy9Ox7N2tvmVci-eA@mail.gmail.com>
References: 
 <CA+H5GPx1VAhG6As__8S02vg97LtzrqMzYmy9Ox7N2tvmVci-eA@mail.gmail.com>
From: Chao Shi <stepinto@live.com>
Date: Mon, 10 Feb 2014 16:30:12 +0800
Subject: Re: Add a new submodule crunch-hcatalog?
To: crunch-dev@apache.org, crunch-user@apache.org
Content-Type: multipart/alternative; boundary="f46d04428e703f5bb504f20927a5"
X-OriginalArrivalTime: 10 Feb 2014 08:30:35.0341 (UTC)
 FILETIME=[5E8ECFD0:01CF263A]
X-Virus-Checked: Checked by ClamAV on apache.org

--f46d04428e703f5bb504f20927a5
Content-Type: text/plain; charset="ISO-8859-1"

Oops.. I didn't noticed that Josh has already sent another email for the
same topic. Please ignore me and let's discuses there.


2014-02-10 15:57 GMT+08:00 Chao Shi <stepinto@live.com>:

> Hi users and devs,
>
> I'd like to add HCatalog support to crunch. CRUNCH-340 [1] is a first
> effort on it. It is simply a Source wrapper for HCatInputFormat, with which
> you can write Crunch pipelines reading from Hive tables.
>
> The down side is that it has dependency on hcatalog and several hive
> modules transitively. There was some discussion in the JIRA ticket on
> whether or not to start a new submodule, instead of adding such
> dependencies to crunch-core (similar to crunch-hbase). I post the question
> here to get more feedback.
>
> I personally prefer adding a new submodule, as this piece of work can be
> completely decoupled from crunch-core. Feel free to tell me if you have any
> ideas.
>
> [1] https://issues.apache.org/jira/browse/CRUNCH-340
>
>

--f46d04428e703f5bb504f20927a5--