hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raghu Angadi <rang...@yahoo-inc.com>
Subject Re: Hadoop suitable for production
Date Wed, 14 Mar 2007 15:33:36 GMT

Simon Willnauer wrote:
> Thanks Timothy for your short answer, I guess I have to be a bit more
> specific!
> Actually I'm interested in the  distributed FS rather than in the
> Map/Reduce features. Did the HDFS change very much since it has been
> moved out of the nutch project?As far as I can tell the version of
> hadoop is a very very early one but this hasn't been developed from
> the scratch right?
> I can remember that nutch has been around for a while and nutch does
> make use of HDFS as well.
> Is there anybody around who runs hadoop in a production env. at all?
> Timothy talked about "major bugs" still coming up, so are they rather
> related to new features or also to the DFS? (I don't need details
> don't worry)
> What I need to know is if it is worth to use HDFS to build a prototype
> and a proof of concept for an upcoming project. If we can not use it
> due to it's early dev. state it's ok but we could save heaps of time
> with some information or recommendations.

It is absolutely fine especially for prototype and proof of concept. 
There are a lot of clusters with many hundreds of nodes. Many are at 
least 'semi-production' and committed to using in production. Just use 
the versions marked 'stable'. Why don't you just try it and decide for 
yourself :)


View raw message