Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D163ADB7B for ; Fri, 24 Aug 2012 08:12:55 +0000 (UTC) Received: (qmail 80869 invoked by uid 500); 24 Aug 2012 08:12:50 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 80673 invoked by uid 500); 24 Aug 2012 08:12:50 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 80644 invoked by uid 99); 24 Aug 2012 08:12:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2012 08:12:49 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of lism03@gmail.com designates 209.85.160.48 as permitted sender) Received: from [209.85.160.48] (HELO mail-pb0-f48.google.com) (209.85.160.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2012 08:12:44 +0000 Received: by pbbrq13 with SMTP id rq13so3577320pbb.35 for ; Fri, 24 Aug 2012 01:12:24 -0700 (PDT) Received: by 10.68.219.226 with SMTP id pr2mr11063420pbc.1.1345795944444; Fri, 24 Aug 2012 01:12:24 -0700 (PDT) Received: from shengmeiTHINK ([159.226.43.43]) by mx.google.com with ESMTPS id wh7sm7831824pbc.33.2012.08.24.01.12.20 (version=SSLv3 cipher=OTHER); Fri, 24 Aug 2012 01:12:23 -0700 (PDT) From: "Li Shengmei" To: Subject: Re: About many user accounts in hadoop platform Date: Fri, 24 Aug 2012 16:12:19 +0800 Message-ID: <01f901cd81d0$30c5c320$92514960$@ict.ac.cn> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_01FA_01CD8213.3EEC1060" X-Mailer: Microsoft Outlook 14.0 Thread-Index: Ac2Bz34wDTJWf7g9RXWKGCk77N3FMg== Content-Language: zh-cn X-Virus-Checked: Checked by ClamAV on apache.org This is a multipart message in MIME format. ------=_NextPart_000_01FA_01CD8213.3EEC1060 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, Sonal Thanks for your information. Because some users want to modify the source codes of hadoop, these users want to install their own hadoop version in the same clusters. After they modify their hadoop version, they may compile and install the modified hadoop version and don't want to make any influence to other users. Does your method make effect on this? Thanks a lot, May --------------------------------------------------- Hi, Do your users want different versions of Hadoop? Or can they share the same hadoop cluster and schedule their jobs? If the latter, Hadoop can be configured to run for multiple users, and each user can submit their data and jobs to the same cluster. Hence you can maintain a single cluster and utilize your resources more efficiently. You can read more here: http://www.ibm.com/developerworks/linux/library/os-hadoop-scheduling/index.h tml http://www.cloudera.com/blog/2008/11/job-scheduling-in-hadoop/ Best Regards, Sonal Crux: Reporting for HBase Nube Technologies On Fri, Aug 24, 2012 at 9:13 AM, Li Shengmei wrote: Hi, all There are many users in hadoop platform. Can they install their own hadoop version on the same clusters platform? I tried to do this but failed. There exsited a user account and the user install his hadoop. I create another account and install his hadoop. The logs display "ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.net.BindException: Problem binding to hadoop01/10.3.1.91:9000 : Address already in use". So I change the port no. to 8000, but still failed. When I "start-all.sh", the namenode can't start, the logs display "ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:lismhadoop cause:java.net.BindException: Address already in use" Can anyone give some suggestions? Thanks, May ------=_NextPart_000_01FA_01CD8213.3EEC1060 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi, Sonal

       Thanks for your = information.
       Because some users = want to modify the source codes of hadoop, these users want to install = their own hadoop version in the same clusters. After they modify their = hadoop version, they may compile and install the modified hadoop version = and don’t want to make any influence to other users. =

       Does your method make = effect on this?

Thanks a lot,

May

 

 

-------------------------------------------------= --

Hi,

 

Do your users want different = versions of Hadoop? Or can they share the same hadoop cluster and = schedule their jobs? If the latter, Hadoop can be configured to run for = multiple users, and each user can submit their data and jobs to the same = cluster. Hence you can maintain a single cluster and utilize your = resources more efficiently. You can read more = here:

 

 

 

Best = Regards,
Sonal
Crux: Reporting for HBase
Nube Technologies =






On Fri, Aug 24, 2012 at 9:13 AM, Li = Shengmei <lishengmei@ict.ac.cn> = wrote:

Hi, all

         There are = many users in hadoop platform. Can they install their own hadoop version = on the same clusters platform?

I tried to do this but failed. There exsited a = user account and the user install his hadoop. I create another account = and install his hadoop. The logs display “ERROR = org.apache.hadoop.hdfs.server.namenode.NameNode: java.net.BindException: = Problem binding to hadoop01/10.3.1.91:9000 : Address already in use”. So = I change the port no. to 8000, but still failed. =

When I “start-all.sh”, the = namenode can’t start, the logs display “ERROR = org.apache.hadoop.security.UserGroupInformation: = PriviledgedActionException as:lismhadoop cause:java.net.BindException: = Address already in use”

Can anyone give some suggestions? =

Thanks,

May

 

------=_NextPart_000_01FA_01CD8213.3EEC1060--