Mailing-List: contact dev-help@hama.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hama.apache.org
Received-SPF: pass (athena.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
From: "Edward J. Yoon" <edwardyoon@apache.org>
Content-Type: text/plain;
	charset=euc-kr
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (1.0)
Subject: Re: [jira] [Updated] (HAMA-883) [Research Task] Massive log event
 aggregation in real time using Apache Hama
Message-Id: <BC9E52F1-98F7-4608-8D1E-ED3239411ABC@apache.org>
Date: Wed, 5 Mar 2014 13:25:20 +0900
References: <JIRA.12698542.1393895731744@arcas>
 <JIRA.12698542.1393895731744.8491.1393916062140@arcas>
 <CAN_uYPhX=OO731eTe8x=zRWDS9JME_0xidreXOnG=9k==VJR6w@mail.gmail.com>
 <CAGQgZQSVwurYYQ5KUK0hjEtBBRMRq9+ari1fN4oJgxAh=fLXoQ@mail.gmail.com>
 <CAN_uYPgsOvM1O6gCrXqPRp46ONeN91Otcy0G8qqbB9aYb3xkZQ@mail.gmail.com>
 <CA+jdVcy=GY4tqcC1k1=EC1+SwgCHMzsbs6hN6bqdAhwyz_M0MQ@mail.gmail.com>
 <CAN_uYPi1KKaK0hnG3n1fq5x4gK5p0GQZ3wZf5Zh5=cLHDBK1kw@mail.gmail.com>
In-Reply-To: 
 <CAN_uYPi1KKaK0hnG3n1fq5x4gK5p0GQZ3wZf5Zh5=cLHDBK1kw@mail.gmail.com>
To: "dev@hama.apache.org" <dev@hama.apache.org>

Why not?

Sent from my iPhone

> On 2014. 3. 5., at =BF=C0=C8=C4 1:09, Yexi Jiang <yexijiang@gmail.com> wro=
te:
>=20
> Yes, currently Hama does not support streaming input and streaming output.=

> That's why currently it is not a natural choice for people with real time
> computing needs.
>=20
> Do we really need to make Hama to support the real time computing? In that=

> case, we need to compete with Storm...
>=20
>=20
> 2014-03-04 22:58 GMT-05:00 Chia-Hung Lin <clin4j@googlemail.com>:
>=20
>> I used Twitter Storm previously. Storm is an excellent framework in
>> real time processing.
>>=20
>> Considering Hama in real time tasks, the framework in my opinion need
>> to decouple io from hdfs so that the source/ input is not restricted
>> to just hdfs.
>>=20
>>> On 5 March 2014 09:30, Yexi Jiang <yexijiang@gmail.com> wrote:
>>> Please correct me if I'm wrong. My understanding of aggregating the log
>> is
>>> the collect the generated from each monitored machine in real time. The
>>> collecting procedure is continuous like a data stream and never end.
>>>=20
>>> I know how to use Hama to aggregate the logs batch by batch (e.g.
>> aggregate
>>> the logs incrementally each day), but I cannot immediately make up an
>> idea
>>> of using Hama to solve this problem in real time approach.
>>>=20
>>>=20
>>> 2014-03-04 19:32 GMT-05:00 Edward J. Yoon <edwardyoon@apache.org>:
>>>=20
>>>> Aggregators of Graph package are doing similar wok. Monitoring and
>>>> Global communication, ..., etc.
>>>>=20
>>>>=20
>>>>=20
>>>> On Tue, Mar 4, 2014 at 10:20 PM, Yexi Jiang <yexijiang@gmail.com>
>> wrote:
>>>>> I am very interested in this topic since my research area includes
>> event
>>>>> mining, but can BSP conducts the real time computing?
>>>>>=20
>>>>> I once used the message queue based solution to collect the event
>> logs.
>>>>>=20
>>>>>=20
>>>>> 2014-03-04 1:54 GMT-05:00 Edward J. Yoon (JIRA) <jira@apache.org>:
>>>>>=20
>>>>>>=20
>>>>>>     [
>> https://issues.apache.org/jira/browse/HAMA-883?page=3Dcom.atlassian.jira.=
plugin.system.issuetabpanels:all-tabpanel
>>>> ]
>>>>>>=20
>>>>>> Edward J. Yoon updated HAMA-883:
>>>>>> --------------------------------
>>>>>>=20
>>>>>>    Summary: [Research Task] Massive log event aggregation in real
>> time
>>>>>> using Apache Hama  (was: [Research Task] Massive log data
>> aggregation in
>>>>>> real time using Apache Hama)
>>>>>>=20
>>>>>>> [Research Task] Massive log event aggregation in real time using
>>>> Apache
>>>>>> Hama
>> -------------------------------------------------------------------------=
---
>>>>>>>=20
>>>>>>>                Key: HAMA-883
>>>>>>>                URL:
>> https://issues.apache.org/jira/browse/HAMA-883
>>>>>>>            Project: Hama
>>>>>>>         Issue Type: Task
>>>>>>>           Reporter: Edward J. Yoon
>>>>>>>=20
>>>>>>> BSP tasks can be used for aggregating log data streamed in real
>> time.
>>>>>> With this research task, we might able to platformization these kind
>> of
>>>>>> processing.
>>>>>>=20
>>>>>>=20
>>>>>>=20
>>>>>> --
>>>>>> This message was sent by Atlassian JIRA
>>>>>> (v6.2#6252)
>>>>>=20
>>>>>=20
>>>>>=20
>>>>> --
>>>>> ------
>>>>> Yexi Jiang,
>>>>> ECS 251,  yjian004@cs.fiu.edu
>>>>> School of Computer and Information Science,
>>>>> Florida International University
>>>>> Homepage: http://users.cis.fiu.edu/~yjian004/
>>>>=20
>>>>=20
>>>>=20
>>>> --
>>>> Edward J. Yoon (@eddieyoon)
>>>> Chief Executive Officer
>>>> DataSayer, Inc.
>>>=20
>>>=20
>>>=20
>>> --
>>> ------
>>> Yexi Jiang,
>>> ECS 251,  yjian004@cs.fiu.edu
>>> School of Computer and Information Science,
>>> Florida International University
>>> Homepage: http://users.cis.fiu.edu/~yjian004/
>=20
>=20
>=20
> --=20
> ------
> Yexi Jiang,
> ECS 251,  yjian004@cs.fiu.edu
> School of Computer and Information Science,
> Florida International University
> Homepage: http://users.cis.fiu.edu/~yjian004/