hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From selam <selam...@gmail.com>
Subject Re: need expert advise on using Hadoop
Date Thu, 14 Apr 2016 19:10:25 GMT
I am no expert or user of hadoop except hdfs part, but you should
check snowplow project for analytics stuff and they use hadoop with
many other proejcts as well.

On Thu, Apr 14, 2016 at 8:34 PM, Vikrama Sanjeeva
<viki.sanjeeva@gmail.com> wrote:
> Thanks Ashutosh,
>
> I'm really unfamiliar of technologies you mentioned. I will explore them
> hopefully.
>
> Actually the motivation here is to get hands-on experience on Hadoop
> echosystem and data analytic. The good part is that we already have Hadoop
> cluster setup in university.
>
> Still looking for insights...
>
> Many thanks.
>
> Viki
>
> On Fri, Apr 15, 2016 at 12:07 AM, Ashutosh Kumar <ashutosh.k78@gmail.com>
> wrote:
>>
>> you can consider
>>
>> Kafka-->Spark-->SparkML-Zeppein
>> OR
>> Kafka-->Flink-->FlinkML-->Zeppelin
>>
>>
>> Thanks
>> Ashutosh
>>
>> On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva
>> <viki.sanjeeva@gmail.com> wrote:
>>>
>>> Hi,
>>>
>>> I'm here to take a expert advise on using Hadoop or not for my
>>> situation/case.
>>>
>>> Brief intro: I'm a masters by research student doing research in BigData
>>> area which I wish to explore more by continuing into PhD.
>>>
>>> We've a side project in its inception phase (not related to research) for
>>> developing mobile app using Ionic framework. One of the non-functional
>>> requirement of the project is to collect various analytics, for example, how
>>> many times apps downloaded, visited, which feature is used more, which user
>>> uses what etc etc. As a part of proposed solution, we've proposed to use
>>> Google Analytics to capture the required analytics and MangoDB for storing
>>> user's data.
>>>
>>> I believe these statistics can be easily captured by GA. However,
>>> recently, I was thinking to use Hadoop and its related technologies (Hive,
>>> Impala, Sqoop etc) for doing analytics work. Why ? Because this way, I will
>>> get a chance to work on Hadoop echosystem which will be a good compliment
>>> with my Master's research which is in BigData.
>>>
>>> What I know that Hadoop is mainly used where we have really BigData (in
>>> TBs or more) in a variety of format (unstructured, semi-structured) and
>>> where value out of data is needed by performing analytics.
>>>
>>> My question is, we will not have much data in mobile app, but we do have
>>> data analytics work in mobile app. So does it make sense (reasonable?) to
>>> export data from MangoDB into HDFS and use Hive or Impala for doing
>>> analytics ?
>>>
>>> Please give feedback. Your expert advise is highly appreciated.
>>>
>>> Many thanks.
>>>
>>> Viki.
>>>
>>
>



-- 
Saygılar && İyi Çalışmalar
Timu EREN ( a.k.a selam )

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org


Mime
View raw message