Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B8E13FB80 for ; Tue, 28 May 2013 17:08:49 +0000 (UTC) Received: (qmail 32005 invoked by uid 500); 28 May 2013 17:08:48 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 31869 invoked by uid 500); 28 May 2013 17:08:47 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 31849 invoked by uid 99); 28 May 2013 17:08:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 May 2013 17:08:47 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Sanjay.Subramanian@wizecommerce.com designates 216.32.180.13 as permitted sender) Received: from [216.32.180.13] (HELO va3outboundpool.messaging.microsoft.com) (216.32.180.13) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 May 2013 17:08:39 +0000 Received: from mail214-va3-R.bigfish.com (10.7.14.249) by VA3EHSOBE011.bigfish.com (10.7.40.61) with Microsoft SMTP Server id 14.1.225.23; Tue, 28 May 2013 17:08:16 +0000 Received: from mail214-va3 (localhost [127.0.0.1]) by mail214-va3-R.bigfish.com (Postfix) with ESMTP id 2B8CF880125; Tue, 28 May 2013 17:08:16 +0000 (UTC) X-Forefront-Antispam-Report: CIP:157.56.232.197;KIP:(null);UIP:(null);IPV:NLI;H:BLUPRD0411HT002.namprd04.prod.outlook.com;RD:none;EFVD:NLI X-SpamScore: -10 X-BigFish: PS-10(zz9371I11efR181fMc85ehdd85k9a6kzz1f42h1ee6h1de0h1fdah1202h1e76h1d1ah1d2ah1fc6hzz17326ah18c673h8275bh8275dhz2fh2a8h668h839hbe3he5bhf0ah1288h12a5h12bdh137ah1441h1504h1537h153bh162dh1631h1758h18e1h1946h19b5h1ad9h1b0ah1bceh1d0ch1d2eh1d3fh1dc1h1155h) Received-SPF: pass (mail214-va3: domain of wizecommerce.com designates 157.56.232.197 as permitted sender) client-ip=157.56.232.197; envelope-from=Sanjay.Subramanian@wizecommerce.com; helo=BLUPRD0411HT002.namprd04.prod.outlook.com ;.outlook.com ; Received: from mail214-va3 (localhost.localdomain [127.0.0.1]) by mail214-va3 (MessageSwitch) id 1369760894355914_18341; Tue, 28 May 2013 17:08:14 +0000 (UTC) Received: from VA3EHSMHS043.bigfish.com (unknown [10.7.14.237]) by mail214-va3.bigfish.com (Postfix) with ESMTP id 4AFE1D4006D; Tue, 28 May 2013 17:08:14 +0000 (UTC) Received: from BLUPRD0411HT002.namprd04.prod.outlook.com (157.56.232.197) by VA3EHSMHS043.bigfish.com (10.7.99.53) with Microsoft SMTP Server (TLS) id 14.1.225.23; Tue, 28 May 2013 17:08:08 +0000 Received: from BLUPRD0411MB426.namprd04.prod.outlook.com ([169.254.10.213]) by BLUPRD0411HT002.namprd04.prod.outlook.com ([10.255.127.37]) with mapi id 14.16.0311.000; Tue, 28 May 2013 17:08:07 +0000 From: Sanjay Subramanian To: "user@hive.apache.org" , "bejoy_ks@yahoo.com" Subject: Re: how does hive find where is MR job tracker Thread-Topic: how does hive find where is MR job tracker Thread-Index: Ac5bw0B1EenRuPjXRNSOWmNbKi7kdQAAdGaA//+MZgA= Date: Tue, 28 May 2013 17:08:07 +0000 Message-ID: In-Reply-To: <1860799726-1369760520-cardhu_decombobulator_blackberry.rim.net-373360913-@b4.c16.bise7.blackberry> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.255.127.4] Content-Type: multipart/alternative; boundary="_000_CDCA31D77D2Csanjaysubramanianwizecommercecom_" MIME-Version: 1.0 X-OriginatorOrg: wizecommerce.com X-Virus-Checked: Checked by ClamAV on apache.org --_000_CDCA31D77D2Csanjaysubramanianwizecommercecom_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable In Cloudera Manager , there is a Safety Valve feature (its a multiline text= widget) that u can use to input the XML properties that u would use for ma= pred-site.xml Possibly since u changed the JobTracker machine , u have to mod the mapred-= site.xml to specify the machine name and port Regards Sanjay From: "bejoy_ks@yahoo.com" > Reply-To: "user@hive.apache.org" >, "bejoy_ks@yahoo.com" > Date: Tuesday, May 28, 2013 10:02 AM To: "user@hive.apache.org" > Subject: Re: how does hive find where is MR job tracker Hive gets the JobTracker from the mapred-site.xml specified within your $HA= DOOP_HOME/conf. Is your $HADOOP_HOME/conf/mapred-site.xml on the node that runs hive have t= he correct value for jobtracker? If not changing that to the right one might resolve your issue. Regards Bejoy KS Sent from remote device, Please excuse typos ________________________________ From: Frank Luo > Date: Tue, 28 May 2013 16:49:01 +0000 To: user@hive.apache.org> ReplyTo: user@hive.apache.org Subject: how does hive find where is MR job tracker I have a cloudera cluster, version 4.2.0. In the hive configuration, I have =93MapReduce Service=94 set to =93mapredu= ce1=94, which is my MR service. However, without setting =93mapred.job.tracker=94, whenever I run hive comm= and, it always sends the job to a wrong job tracker. Here is the error: java.net.ConnectException: Call From hqhd01ed01.pclc0.merkle.local/10.129.2= .52 to hqhd01ed01.pclc0.merkle.local:8021 failed on connection exception: j= ava.net.ConnectException: Connection refused; For more details see: http:/= /wiki.apache.org/hadoop/ConnectionRefused at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Me= thod) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeCons= tructorAccessorImpl.java:39) And the Cloudera Manager doesn=92t allow me to manually set =93mapred.job.t= racker=94. So my question is how to make Hive point to the right job tracke= r without setting =93=93mapred.job.tracker=94 every time. PS. Not sure it matters, but I did move the job tracker from machine A to m= achine B. Thx! CONFIDENTIALITY NOTICE =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D This email message and any attachments are for the exclusive use of the int= ended recipient(s) and may contain confidential and privileged information.= Any unauthorized review, use, disclosure or distribution is prohibited. If= you are not the intended recipient, please contact the sender by reply ema= il and destroy all copies of the original message along with any attachment= s, from your computer system. If you are the intended recipient, please be = advised that the content of this message is subject to access, review and d= isclosure by the sender's Email System Administrator. --_000_CDCA31D77D2Csanjaysubramanianwizecommercecom_ Content-Type: text/html; charset="Windows-1252" Content-ID: <59CEE4725FE3AE45B411C2E440335790@namprd04.prod.outlook.com> Content-Transfer-Encoding: quoted-printable
In Cloudera Manager , there is a Safety Valve feature (its a multiline= text widget) that u can use to input the XML properties that u would use f= or mapred-site.xml

Possibly since u changed the JobTracker machine , u have to mod the ma= pred-site.xml  to specify the machine name and port


Regards

Sanjay

From: "bejoy_ks@yahoo.com" <bejoy_ks@yahoo.com>
Reply-To: "user@hive.apache.org" <user@hive.apache.org>, "bejoy_ks@yahoo.com" <bejoy_ks@yahoo.com>
Date: Tuesday, May 28, 2013 10:02 A= M
To: "user@hive.apache.org" <user@hive.apache.org>
Subject: Re: how does hive find whe= re is MR job tracker

Hive gets the JobTracker from the mapred-site.xml speci= fied within your $HADOOP_HOME/conf.

Is your $HADOOP_HOME/conf/mapred-site.xml on the node that runs hive have t= he correct value for jobtracker?
If not changing that to the right one might resolve your issue.
Regards
Bejoy KS

Sent from remote device, Please excuse typos
From: Frank Luo <jluo@= merkleinc.com>
Date: Tue, 28 May 2013 16:49:01 +0000
Subject: how does hive find where is MR job tracker

I have a cloudera cluster, version 4.2.0.

 

In the hive configuration, I have =93MapReduce Service=94 set to =93mapreduce1=94, which is my MR service.

 

However, without setting =93mapred.job.tracker=94, whenever I run hive command, it always sends the = job to a wrong job tracker. Here is the error:

 

java.net.ConnectException: Call From hqhd01ed01.p= clc0.merkle.local/10.129.2.52 to hqhd01ed01.pclc0.merkle.local:8021 failed = on connection exception: java.net.ConnectException: Connection refused; For= more details see:  http://wiki.apa= che.org/hadoop/ConnectionRefused

        at sun= .reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

        at sun= .reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccesso= rImpl.java:39)

 

And the Cloudera Manager doesn=92t allow me to manua= lly set =93mapred.job.tracker=94. So my question is how to make Hive point to = the right job tracker without setting =93=93mapred.job.tracker=94 every time.

 

PS. Not sure it matters, but I did move the job tracke= r from machine A to machine B.

 

Thx!


CONFIDENTIALITY NOTICE
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
This email message and any attachments are for the exclusive use of the int= ended recipient(s) and may contain confidential and privileged information.= Any unauthorized review, use, disclosure or distribution is prohibited. If= you are not the intended recipient, please contact the sender by reply email and destroy all copies of the ori= ginal message along with any attachments, from your computer system. If you= are the intended recipient, please be advised that the content of this mes= sage is subject to access, review and disclosure by the sender's Email System Administrator.
--_000_CDCA31D77D2Csanjaysubramanianwizecommercecom_--