hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bertrand Dechoux <decho...@gmail.com>
Subject Re: About many user accounts in hadoop platform
Date Fri, 24 Aug 2012 05:40:21 GMT
You might also want to look at Hadoop On Demand.
http://hadoop.apache.org/common/docs/r0.17.0/hod.html

But I would not recommend to make one cluster per user.

Regards

Bertrand

On Fri, Aug 24, 2012 at 5:50 AM, Sonal Goyal <sonalgoyal4@gmail.com> wrote:

> Hi,
>
> Do your users want different versions of Hadoop? Or can they share the
> same hadoop cluster and schedule their jobs? If the latter, Hadoop can be
> configured to run for multiple users, and each user can submit their data
> and jobs to the same cluster. Hence you can maintain a single cluster and
> utilize your resources more efficiently. You can read more here:
>
>
> http://www.ibm.com/developerworks/linux/library/os-hadoop-scheduling/index.html
>
> http://www.cloudera.com/blog/2008/11/job-scheduling-in-hadoop/
>
> Best Regards,
> Sonal
> Crux: Reporting for HBase <https://github.com/sonalgoyal/crux>
> Nube Technologies <http://www.nubetech.co>
>
> <http://in.linkedin.com/in/sonalgoyal>
>
>
>
>
>
>
> On Fri, Aug 24, 2012 at 9:13 AM, Li Shengmei <lishengmei@ict.ac.cn> wrote:
>
>> Hi, all****
>>
>>          There are many users in hadoop platform. Can they install their
>> own hadoop version on the same clusters platform? ****
>>
>> I tried to do this but failed. There exsited a user account and the user
>> install his hadoop. I create another account and install his hadoop. The
>> logs display “ERROR org.apache.hadoop.hdfs.server.namenode.NameNode:
>> java.net.BindException: Problem binding to hadoop01/10.3.1.91:9000 :
>> Address already in use”. So I change the port no. to 8000, but still
>> failed. ****
>>
>> When I “start-all.sh”, the namenode can’t start, the logs display “ERROR
>> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
>> as:lismhadoop cause:java.net.BindException: Address already in use”****
>>
>> Can anyone give some suggestions? ****
>>
>> Thanks,****
>>
>> May****
>>
>
>


-- 
Bertrand Dechoux

Mime
View raw message