Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F40EC8F02 for ; Tue, 30 Aug 2011 11:43:53 +0000 (UTC) Received: (qmail 84070 invoked by uid 500); 30 Aug 2011 11:43:53 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 84043 invoked by uid 500); 30 Aug 2011 11:43:52 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 84035 invoked by uid 99); 30 Aug 2011 11:43:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Aug 2011 11:43:52 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of miguel.cabero@gmail.com designates 74.125.82.54 as permitted sender) Received: from [74.125.82.54] (HELO mail-ww0-f54.google.com) (74.125.82.54) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Aug 2011 11:43:45 +0000 Received: by wwg11 with SMTP id 11so6242045wwg.23 for ; Tue, 30 Aug 2011 04:43:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to:x-mailer; bh=pBjM5FLFXNkFyKZ5guHBBLFHbV+QEXRTW42JKXGXmBE=; b=Z1G00GeB1LgJNcRsiTxBYisYzHqpErEPKEJwxqczwnmeEIuHmMBz+m3MBgnPmHCP7b fb//QqcM+Ymd2dAJ4Baz3cVCXEPfKe6/5BnR5h1ZWCmJ3BSGSVGYQqpjUN27BXOopxOh z4u4M+TB1q5TIck/jneX6IAVP+WzWnbk4KLxo= Received: by 10.227.206.197 with SMTP id fv5mr5096771wbb.66.1314704604858; Tue, 30 Aug 2011 04:43:24 -0700 (PDT) Received: from unknown-00-1e-52-73-6a-9e.lan (cust-48-193-108-94.dyn.as47377.net [94.108.193.48]) by mx.google.com with ESMTPS id fj19sm4551817wbb.49.2011.08.30.04.43.23 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 30 Aug 2011 04:43:24 -0700 (PDT) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Apple Message framework v1084) Subject: Re: Hive in EC2 From: Miguel Cabero In-Reply-To: Date: Tue, 30 Aug 2011 13:43:21 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: To: user@hive.apache.org X-Mailer: Apple Mail (2.1084) X-Virus-Checked: Checked by ClamAV on apache.org Hi, I set up my clusters on EC2 via with Cloudera Whirr. My hadoop.properties file is like : whirr.hardware-id=3Dm1.xlarge # Ubuntu 10.04 LTS Lucid. See http://alestic.com/ whirr.image-id=3Deu-west-1/ami-1e34016a whirr.location-id=3Deu-west-1 whirr.service-name=3Dhadoop whirr.cluster-name=3Dmyhadoopcluster whirr.instance-templates=3D1 jt+nn,5 dn+tt whirr.provider=3Dec2 whirr.identity=3DSECRET whirr.credential=3DSECRET whirr.private-key-file=3D${sys:user.home}/.ssh/id_rsa whirr.public-key-file=3D${sys:user.home}/.ssh/id_rsa.pub whirr.hadoop-install-runurl=3Dcloudera/cdh/install whirr.hadoop-configure-runurl=3Dcloudera/cdh/post-configure Cloudera default settings are currently fine for me. I recommend using MySql as metastore instead of Derby. I use Amazon RDS for its simplicity. Regards, Lemig Le 30 ao=FBt 2011 =E0 08:02, MIS a =E9crit : > Hi, >=20 > Can somebody point me to production level setup of Hive in EC2. The = intent is to know the setup best practices being employed. >=20 > Thanks.