crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chao Shi <stepi...@live.com>
Subject Re: HCatalog Source for Crunch
Date Wed, 12 Feb 2014 14:58:44 GMT
Hi there,

I think we have agreed to make it as a separate module. I will update
CRUNCH-340 soon if there's no opposition.


2014-02-10 23:03 GMT+08:00 Gabriel Reid <gabriel.reid@gmail.com>:

> I'm not currently in a position to make use of the HCat support, but
> it definitely sounds like a cool thing to have in Crunch.
>
> I also agree that it should be in a separate Maven module.
>
> - Gabriel
>
> On Mon, Feb 10, 2014 at 8:17 AM, Josh Wills <jwills@cloudera.com> wrote:
> > Hey all,
> >
> > I wanted to solicit feedback on
> > https://issues.apache.org/jira/browse/CRUNCH-340, which adds HCatalog
> > Source and Target types to Crunch. I'm of two minds about adding in
> support
> > for HCatalog to the core project; in general, I like for their to be more
> > ways to read and write data from Crunch, esp. when we can add
> > interoperability w/Hive, which is such a natural complement to Crunch. On
> > the other hand, I'm concerned about the costs that Hive's not-super-nice
> > dependency framework impose on Crunch clients and the project-- that is
> to
> > say, I'm worried that bringing in HCat dependencies makes it harder for
> us
> > to update existing dependencies and add in new dependencies that will
> > conflict with the Hive/HCat dependencies. I'd like to hear from at least
> a
> > few folks that the HCat support would be useful for them before we
> promote
> > it from a useful extension to a feature of the core project.
> >
> > Thanks!
> > Josh
> >
> > --
> > Director of Data Science
> > Cloudera <http://www.cloudera.com>
> > Twitter: @josh_wills <http://twitter.com/josh_wills>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message