Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7E499DD24 for ; Sun, 19 Aug 2012 19:45:26 +0000 (UTC) Received: (qmail 73817 invoked by uid 500); 19 Aug 2012 19:45:21 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 73695 invoked by uid 500); 19 Aug 2012 19:45:21 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 73688 invoked by uid 99); 19 Aug 2012 19:45:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Aug 2012 19:45:21 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.214.176] (HELO mail-ob0-f176.google.com) (209.85.214.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Aug 2012 19:45:13 +0000 Received: by obbtb18 with SMTP id tb18so10898927obb.35 for ; Sun, 19 Aug 2012 12:44:51 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:in-reply-to:references:date :message-id:subject:from:to:content-type:x-gm-message-state; bh=CBTKQDuK0iZdCxhPDdQPWbiW3lQ9fizBvCgYOpdgSFw=; b=bEsa0KaQjjTZ7lB8y36flxoSk/OObLHic2ff6U4gjCwyT2sApxJHVfIwxH9jI0dyEm mpeplgWCItC0J00ppk00eqtLpHpPytyqlmmLn5Ud/nFyKvyEBIiewMwCosBypY8le+wB /ymPz/v41LbbEX2DsDF8s5psXPDsNOjgdF0SHVW9hTNgeD5Lw/CSo+Y27KO+AqGUXekI +c1pZ8NLIKN6DFZZWuW8dr4Z7AHvY+cygfNzp2OpDbF1iTqL249tPQJRR5Q4YDJ4PXEs ZowuLvLFF5tkhyE76Puca7eC45cnSgfs3ty/HifhecUBJEJkueZKQaCrfr0zdWrLLDo3 cLmg== MIME-Version: 1.0 Received: by 10.50.94.135 with SMTP id dc7mr7818243igb.37.1345405491391; Sun, 19 Aug 2012 12:44:51 -0700 (PDT) Received: by 10.64.93.231 with HTTP; Sun, 19 Aug 2012 12:44:51 -0700 (PDT) X-Originating-IP: [80.100.47.45] Received: by 10.64.93.231 with HTTP; Sun, 19 Aug 2012 12:44:51 -0700 (PDT) In-Reply-To: References: Date: Sun, 19 Aug 2012 21:44:51 +0200 Message-ID: Subject: Re: Hadoop Real time help From: Niels Basjes To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=e89a8f234bd964ad7204c7a3a097 X-Gm-Message-State: ALoCoQnTqkCPIP43skkbWRrV327/CqEoR/mQBV2Trubm0+onbt4B9CpTJbIYtMmP04hwrUUppxxz X-Virus-Checked: Checked by ClamAV on apache.org --e89a8f234bd964ad7204c7a3a097 Content-Type: text/plain; charset=ISO-8859-1 Is there a "complete" overview of the tools that allow processing streams of data in realtime? Or even better; what are the terms to google for? -- Met vriendelijke groet, Niels Basjes (Verstuurd vanaf mobiel ) Op 19 aug. 2012 18:22 schreef "Bertrand Dechoux" het volgende: > That's a good question. More and more people are talking about Hadoop Real > Time. > One key aspect of this question is whether we are talking about MapReduce > or not. > > MapReduce greatly improves the response time of any data intensive jobs > but it is still a batch framework with a noticeable latency. > > There is multiple ways to improve the latency : > * ESP/CEP solutions (like Esper, FlumeBase, ...) > * Big Table clones (like HBase ...) > * YARN with a non MapReduce application > * ... > > But it will really depend on the context and the definition of 'real time'. > > Regards > > Bertrand > > > > On Sun, Aug 19, 2012 at 5:44 PM, mahout user wrote: > >> Hello folks, >> >> >> I am new to hadoop, I just want to get information that how hadoop >> framework is usefull for real time service.?can any one explain me..? >> >> Thanks. >> > > > > -- > Bertrand Dechoux > --e89a8f234bd964ad7204c7a3a097 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Is there a "complete" overview of the tools that allow process= ing streams of data in realtime?

Or even better; what are the terms to google for?

--
Met vriendelijke groet,
Niels Basjes
(Verstuurd vanaf mobiel )

Op 19 aug. 2012 18:22 schreef "Bertrand Dec= houx" <dechouxb@gmail.com= > het volgende:
That's a good question. More and more people are talking about Hadoop R= eal Time.
One key aspect of this question is whether we are talking abou= t MapReduce or not.

MapReduce greatly improves the response time of = any data intensive jobs but it is still a batch framework with a noticeable= latency.

There is multiple ways to improve the latency :
* ESP/CEP solutions = (like Esper, FlumeBase, ...)
* Big Table clones (like HBase ...)
* YA= RN with a non MapReduce application
* ...

But it will really depe= nd on the context and the definition of 'real time'.

Regards

Bertrand



On Su= n, Aug 19, 2012 at 5:44 PM, mahout user <mahoutuser@gmail.com> wrote:
Hello folks,


=A0=A0 I am new to = hadoop, I just want to get information that how hadoop framework is usefull= for real time service.?can any one explain me..?

Thanks.



--
Bertrand Dechoux
--e89a8f234bd964ad7204c7a3a097--