hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sudeep Singh Thakur <sudeepthaku...@gmail.com>
Subject Re: Kafka or Flume
Date Fri, 30 Jun 2017 03:55:37 GMT
In your use Kafka would be better because you want some transformations and
validations.

Kind regards,
Sudeep Singh Thakur

On Jun 30, 2017 8:57 AM, "Sidharth Kumar" <sidharthkumar2707@gmail.com>
wrote:

> Hi,
>
> I have a requirement where I have all transactional data injestion into
> hadoop in real time and before storing the data into hadoop, process it to
> validate the data. If the data failed to pass validation process , it will
> not be stored into hadoop. The validation process also make use of
> historical data which is stored in hadoop. So, my question is which
> injestion tool will be best for this Kafka or Flume?
>
> Any suggestions will be a great help for me.
>
>
> Warm Regards
>
> Sidharth Kumar | Mob: +91 8197 555 599/7892 192 367 |  LinkedIn:
> www.linkedin.com/in/sidharthkumar2792
>
>
>
>
>
>

Mime
View raw message