hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stefan Groschupf ...@media-style.com>
Subject Re: Hadoop production-ready?
Date Sat, 08 Jul 2006 02:07:45 GMT
Hi Otis,

I think this is difficult to answer. Just some points from my  
perspective. I use it in two projects in production but not the  
latest trunk.
Map reduce works great and stable in my scale (up to 20 boxes). I  
lost several times data from the dfs so this is tricky.
Watch out that you better never touch your network setup. If it runs  
once my experience is that it runs. However making backups from  
important data to a "normal" file system is a good idea.

However hadoop related problems are fixed in a amazing short time frame.

.. just my personal perspective.

On 07.07.2006, at 09:58, Otis Gospodnetic wrote:

> Hi,
> Sorry for the nature of the question, but can anyone estimate when  
> Hadoop will be "stable and production-ready"?  I know you've run it  
> on clusters with 600+ nodes, but you guys (hadoop-dev) know this  
> beast inside out, and can spend time troubleshooting and fixing its  
> problems, but for somebody who is unable to do that, when do you  
> think it will be as stable as Nutch and Lucene are, for example?
> I'm asking because I see a LOT of fast development, but also see  
> that things being worked on are all non-trivial and still very much  
> in the core.
> Thanks,
> Otis

View raw message