hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashutosh Kumar <ashutosh....@gmail.com>
Subject Re: need expert advise on using Hadoop
Date Thu, 14 Apr 2016 16:07:00 GMT
you can consider

Kafka-->Spark-->SparkML-Zeppein
OR
Kafka-->Flink-->FlinkML-->Zeppelin


Thanks
Ashutosh

On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva <viki.sanjeeva@gmail.com>
wrote:

> Hi,
>
> I'm here to take a expert advise on using Hadoop or not for my
> situation/case.
>
> Brief intro: I'm a masters by research student doing research in BigData
> area which I wish to explore more by continuing into PhD.
>
> We've a side project in its inception phase (not related to research) for
> developing mobile app using Ionic framework. One of the non-functional
> requirement of the project is to collect various analytics, for example,
> how many times apps downloaded, visited, which feature is used more, which
> user uses what etc etc. As a part of proposed solution, we've proposed to
> use Google Analytics to capture the required analytics and MangoDB for
> storing user's data.
>
> I believe these statistics can be easily captured by GA. However,
> recently, I was thinking to use Hadoop and its related technologies (Hive,
> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
> get a chance to work on Hadoop echosystem which will be a good compliment
> with my Master's research which is in BigData.
>
> What I know that Hadoop is mainly used where we have really BigData (in
> TBs or more) in a variety of format (unstructured, semi-structured) and
> where value out of data is needed by performing analytics.
>
> My question is, we will not have much data in mobile app, but we do have
> data analytics work in mobile app. So does it make sense (reasonable?) to
> export data from MangoDB into HDFS and use Hive or Impala for doing
> analytics ?
>
> Please give feedback. Your expert advise is highly appreciated.
>
> Many thanks.
>
> Viki.
>
>

Mime
View raw message