hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shi Yu <sh...@uchicago.edu>
Subject Re: Why hadoop is written in java?
Date Sun, 10 Oct 2010 21:44:29 GMT
That sounds interesting. I am interested in the perspective of using 
Hadoop to solve huge scale convex / noconvex optimization problems. Will 
take a look at them. Thanks.

Shi

On 2010-10-10 16:12, Matt Tanquary wrote:
> Please check out Rhipe and Mahout projects, there are others as well,
> but these are coming on strong and Hadoop has many avenues for
> extension through things such as python or matlab that you can take
> advantage of. The good thing is, if you have an algorithm or
> computational challenge that hasn't been met, you can solve it and
> share it with the rest of us.
>
> On Sat, Oct 9, 2010 at 11:39 PM, Shi Yu<shiyu@uchicago.edu>  wrote:
>    
>> Wondering how Hadoop running with python and other languages. Java is easy
>> to develop, however, not very efficient to handle numerical computation with
>> objects like sparse matrices. Maybe hadoop will have Matlab, R extensions as
>> well? Hope to see it happens.
>>
>>
>>
>> On 2010-10-10 1:07, Arvind Kalyan wrote:
>>      
>>> On Sat, Oct 9, 2010 at 9:40 PM, elton sky<eltonsky9404@gmail.com>    wrote:
>>>
>>>
>>>        
>>>> I always have this question but couldn't find proper answer for this. For
>>>> system level applications, c/c++ is preferable. But why this one using
>>>> java?
>>>>
>>>>
>>>>          
>>> Look at the system (software) requirements for running Hadoop:
>>>
>>> http://hadoop.apache.org/common/docs/current/single_node_setup.html#PreReqs
>>>
>>> Imagine how it would be, if it were to be written in C/C++.
>>>
>>> While C/C++ might give you a performance improvement at run-time, it can
>>> be
>>> a total nightmare to develop and maintain. Especially if the network gets
>>> to
>>> be heterogeneous.
>>>
>>>
>>>
>>>
>>>        
>>      
>
>
>    


-- 
Postdoctoral Scholar
Institute for Genomics and Systems Biology
Department of Medicine, the University of Chicago
Knapp Center for Biomedical Discovery
900 E. 57th St. Room 10148
Chicago, IL 60637, US
Tel: 773-702-6799


Mime
View raw message