Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D3BF1DC7E for ; Fri, 24 Aug 2012 05:40:53 +0000 (UTC) Received: (qmail 27731 invoked by uid 500); 24 Aug 2012 05:40:48 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 27425 invoked by uid 500); 24 Aug 2012 05:40:47 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 27398 invoked by uid 99); 24 Aug 2012 05:40:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2012 05:40:46 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of dechouxb@gmail.com designates 209.85.216.41 as permitted sender) Received: from [209.85.216.41] (HELO mail-qa0-f41.google.com) (209.85.216.41) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2012 05:40:42 +0000 Received: by qafk30 with SMTP id k30so333657qaf.14 for ; Thu, 23 Aug 2012 22:40:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=6fJwXLxkWuQTcb5eqlqcmig97l8yCHljgCL0wclUqzA=; b=H8OqZjXXdWqEHL6N85PVq8gbxeEf7Dpd0rOCSu5zyWvxI1YEjSH6cl0t4H87kWlByl 8U0SnD7SMnI0XBgtY+pT6Tq1fyg1VXFhjZe+6N3O/PgWSx3oBRPsh/lAhiAg4SAssmWt 3wZiM+chEHb/JY6yn1fU+nTBMeQ6XGSkxmOXRAm4TiY0hfxxWyxoq5hN0NRSRcjDPGW5 Lo4eqRkGH4X3ybuQzjghG6YtpCnvhrs2nDmrLeSefY7ow/2cgF0f+U84U1WPiLfMVUTH Dpqh90K3JC3AzZNDhXBIonfVswus2rVz8yiB1a4b/1LUgT6YFwYxjgKxmFlegy87jUEj zPLQ== MIME-Version: 1.0 Received: by 10.224.185.138 with SMTP id co10mr6867794qab.95.1345786821603; Thu, 23 Aug 2012 22:40:21 -0700 (PDT) Received: by 10.49.76.10 with HTTP; Thu, 23 Aug 2012 22:40:21 -0700 (PDT) In-Reply-To: References: <01e601cd81aa$ac9d3620$05d7a260$@ict.ac.cn> Date: Fri, 24 Aug 2012 07:40:21 +0200 Message-ID: Subject: Re: About many user accounts in hadoop platform From: Bertrand Dechoux To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf303349d771f17a04c7fc6935 X-Virus-Checked: Checked by ClamAV on apache.org --20cf303349d771f17a04c7fc6935 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable You might also want to look at Hadoop On Demand. http://hadoop.apache.org/common/docs/r0.17.0/hod.html But I would not recommend to make one cluster per user. Regards Bertrand On Fri, Aug 24, 2012 at 5:50 AM, Sonal Goyal wrote: > Hi, > > Do your users want different versions of Hadoop? Or can they share the > same hadoop cluster and schedule their jobs? If the latter, Hadoop can be > configured to run for multiple users, and each user can submit their data > and jobs to the same cluster. Hence you can maintain a single cluster and > utilize your resources more efficiently. You can read more here: > > > http://www.ibm.com/developerworks/linux/library/os-hadoop-scheduling/inde= x.html > > http://www.cloudera.com/blog/2008/11/job-scheduling-in-hadoop/ > > Best Regards, > Sonal > Crux: Reporting for HBase > Nube Technologies > > > > > > > > > On Fri, Aug 24, 2012 at 9:13 AM, Li Shengmei wrote= : > >> Hi, all**** >> >> There are many users in hadoop platform. Can they install their >> own hadoop version on the same clusters platform? **** >> >> I tried to do this but failed. There exsited a user account and the user >> install his hadoop. I create another account and install his hadoop. The >> logs display =93ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: >> java.net.BindException: Problem binding to hadoop01/10.3.1.91:9000 : >> Address already in use=94. So I change the port no. to 8000, but still >> failed. **** >> >> When I =93start-all.sh=94, the namenode can=92t start, the logs display = =93ERROR >> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionExcept= ion >> as:lismhadoop cause:java.net.BindException: Address already in use=94***= * >> >> Can anyone give some suggestions? **** >> >> Thanks,**** >> >> May**** >> > > --=20 Bertrand Dechoux --20cf303349d771f17a04c7fc6935 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable You might also want to look at Hadoop On Demand.

But I would not recomme= nd to make one cluster per user.

Regards

Bertrand

On Fri, Aug 24, 2012 at 5:50 AM, Sonal Goyal <son= algoyal4@gmail.com> wrote:
Hi,

Do your users want di= fferent versions of Hadoop? Or can they share the same hadoop cluster and s= chedule their jobs? If the latter, Hadoop can be configured to run for mult= iple users, and each user can submit their data and jobs to the same cluste= r. Hence you can maintain a single cluster and utilize your resources more = efficiently. You can read more here:



Best Regards,
Sonal
Crux: Reporting for HBase
Nube Technologies

=






On Fri, Aug 24, 2012 at 9:13 AM, Li Shen= gmei <lishengmei@ict.ac.cn> wrote:

Hi, all

=A0=A0=A0=A0=A0=A0=A0=A0 There are many users in = hadoop platform. Can they install their own hadoop version on the same clus= ters platform?

I = tried to do this but failed. There exsited a user account and the user inst= all his hadoop. I create another account and install his hadoop. The logs d= isplay =93ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.net.B= indException: Problem binding to hadoop01/10.3.1.91:9000 : Address already in use=94. So I cha= nge the port no. to 8000, but still failed.

Wh= en I =93start-all.sh=94, the namenode can=92t start, the logs display =93ER= ROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionExcep= tion as:lismhadoop cause:java.net.BindException: Address already in use=94<= u>

Ca= n anyone give some suggestions?

Thanks,

May





--
Bertrand Dec= houx
--20cf303349d771f17a04c7fc6935--