hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Taeho Kang" <tka...@gmail.com>
Subject Re: Is there any real world heavyweight application based on Hadoop project from Yahoo currently?
Date Tue, 18 Dec 2007 02:52:29 GMT
If your definition of "realworld heavyweight application" is something like
"providing some service to end users." (e.g. file repository service), then
no - Hadoop is not good/mature enough. It lacks such features as security
and access control to be used that way.

But, I think it's suitable and good enough for a lot of "heavyweight work"
that are running internally. (e.g. daily log analysis of internal data.
digitalizing documents.)

And that's probably why you can't find too many references on how others use
Hadoop because most of them probably use Hadoop for their internal works.

On Dec 18, 2007 11:07 AM, 11 Nov. <nov.eleventh@gmail.com> wrote:

> Hi buddies,
>    I have been tracking hadoop project for a while, and I think I'm a big
> fun of hadoop:)
>    To my point of view, hadoop is not mature enough to be used in
> realworld
> heavy weight application yet, for example, to build PB level search
> engine.
> So I'm here to ask, as Yahoo is one of the key supporter of Hadoop
> project,
> does there exist any heavy weight, realworld, applications purely based on
> hadoop from Yahoo? Or Yahoo have some secret features to make hadoop more
> realistic in real applications.
>    Acturally, we are going to build a environment of 1000 nodes based on
> hadoop technology before 2009. That's a tuff job, right?

Taeho Kang [tkang.blogspot.com]
Software Engineer, NHN Corporation, Korea

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message