kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Craig Lancaster <craig.lancas...@gmail.com>
Subject Re: Is anyone able to consume from Kafka 0.7.x and write into Hadoop CDH 4.x ?
Date Fri, 15 Mar 2013 17:43:46 GMT
We're successfully using Camus to move data from Kafka 0.7.x into CDH 4.x.
I didn't hit any particular problems getting that to work, I only had
tweaked the pom.xml files.

Craig


On Fri, Mar 15, 2013 at 12:20 PM, Matthew Rathbone
<matthew@foursquare.com>wrote:

> =david, we use a subset of the KafkaETLJob in cdh4 with great success. Just
> make sure to compile your mapreduce against CDH4
>
>
> On Thu, Mar 14, 2013 at 10:28 PM, David Arthur <mumrah@gmail.com> wrote:
>
> > I have used KafkaETLJob to write a job that consumes from Kafka and
> writes
> > to HDFS. Kafka version 0.7.2 rc5 and CDH 4.1.2.
> >
> > Is anything in particular not working?
> >
> > -David
> >
> >
> > On 3/14/13 5:31 PM, Matt Lieber wrote:
> >
> >> Just curious, were you able to make Camus work with CDH4 then ?
> >>
> >> Cheers,
> >> Matt
> >>
> >> ______________________________**__
> >>
> >>
> >>
> >>
> >>
> >>
> >> NOTE: This message may contain information that is confidential,
> >> proprietary, privileged or otherwise protected by law. The message is
> >> intended solely for the named addressee. If received in error, please
> >> destroy and notify the sender. Any use of this email is prohibited when
> >> received in error. Impetus does not represent, warrant and/or guarantee,
> >> that the integrity of this communication has been maintained nor that
> the
> >> communication is free of errors, virus, interception or interference.
> >>
> >>
> >
>
>
> --
> Matthew Rathbone
> Foursquare | Software Engineer | Server Engineering Team
> matthew@foursquare.com | @rathboma <http://twitter.com/rathboma> |
> 4sq<http://foursquare.com/rathboma>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message