ambari-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Artem Ervits <artemerv...@gmail.com>
Subject Re: HDP stack 2.3 and Flume 1.6
Date Tue, 28 Jul 2015 02:48:04 GMT
I faced with similar issue. I was using Storm and Hive. Take a look at Hive
streaming injest API, it uses the same technique as flume Hive sink.
On Jul 21, 2015 11:13 AM, "Benjamin Delespierre" <
bdelespierre@adserverpub.com> wrote:

> Hello,
>
> We're using Kafka for event retention and would like to stream the data
> directly into Hive using Flume. The problem is that only Flume 1.6 can acts
> as a Kafka client for now and it's not yet in the Hortonworks stack
> (currently HDP 2.3 still use the 1.5).
>
> How can I get the proper flume version installed ?
>
> - Should I create a custom repository with my package in it (can't get my
> hands on a .rpm or .deb for this version by the way) ?
> - Should I create a custom service ?
> - Should I modify the existing service in order to change the installation
> behavior ?
> - Am I completely wrong ?
>
> Any help is welcome ;-)
>
> Best regards.
> -- Benjamin
>
>

Mime
View raw message