Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3DF2CE0B7 for ; Wed, 28 Nov 2012 07:27:54 +0000 (UTC) Received: (qmail 20239 invoked by uid 500); 28 Nov 2012 07:27:53 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 20046 invoked by uid 500); 28 Nov 2012 07:27:52 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 20026 invoked by uid 99); 28 Nov 2012 07:27:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Nov 2012 07:27:52 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of vivek.mishra@impetus.co.in designates 203.199.18.84 as permitted sender) Received: from [203.199.18.84] (HELO mail1.impetus.co.in) (203.199.18.84) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Nov 2012 07:27:46 +0000 Received: from MAIL2.impetus.co.in (192.168.100.8) by mail1.impetus.co.in (192.168.100.28) with Microsoft SMTP Server (TLS) id 14.2.283.3; Wed, 28 Nov 2012 12:57:19 +0530 Received: from MAIL3.impetus.co.in ([fe80::443f:4f25:6889:b268]) by Mail2.impetus.co.in ([fe80::9453:16e7:f5d0:4746%11]) with mapi id 14.02.0283.003; Wed, 28 Nov 2012 12:57:19 +0530 From: Vivek Mishra To: "user@hive.apache.org" Subject: RE: MapJoin error: .hashtable file not found Thread-Topic: MapJoin error: .hashtable file not found Thread-Index: AQHNygwLvtitH6flMUGw+2aHzm/Kopf+v7HM//+ujACAAGsI1P//pjaAgABf9o0= Date: Wed, 28 Nov 2012 07:27:19 +0000 Message-ID: <557E5EDB02B4C8459878EF1EC723AD28B37A3CF4@Mail3.impetus.co.in> References: <557E5EDB02B4C8459878EF1EC723AD28B37A26DA@Mail3.impetus.co.in> <557E5EDB02B4C8459878EF1EC723AD28B37A3C28@Mail3.impetus.co.in> <557E5EDB02B4C8459878EF1EC723AD28B37A3C97@Mail3.impetus.co.in>, In-Reply-To: Accept-Language: en-GB, en-IN, en-US Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.102.2] Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Thanks Ashutosh. I will give it a try. -Vivek ________________________________________ From: Ashutosh Chauhan [hashutosh@apache.org] Sent: 28 November 2012 12:43 To: user@hive.apache.org Subject: Re: MapJoin error: .hashtable file not found Hi Vivek, I will encourage you to try out latest trunk or hive-0.10 branch. Lots of w= ork has gone in since 0.9 to make Hive work better on Windows. Ashutosh On Tue, Nov 27, 2012 at 11:08 PM, Vivek Mishra > wrote: Hi, I am using 0.9.0 hive with Windows 2008 server. I did try debugging into code, but no luck to understand: " Can somebody exaplain how exactly such ".hastable" files get created? What = could be the reason they are not created though gz files are there? " -Vivek ________________________________________ From: Mark Grover [grover.markgrover@gmail.com] Sent: 28 November 2012 11:41 To: user@hive.apache.org Subject: Re: MapJoin error: .hashtable file not found Vivek, What version of Hive are you using? And, on what OS? Mark On Tue, Nov 27, 2012 at 9:34 PM, Vivek Mishra >> wrote: Any pointers? Any help? Can somebody exaplain how exactly such ".hastable" files get created? What = could be the reason they are not created though gz files are there -Vivek ________________________________________ From: Vivek Mishra Sent: 24 November 2012 11:52 To: user@hive.apache.org> Subject: MapJoin error: .hashtable file not found Hi, I am trying to run a MapJoin query and somehow getting below error. I can s= ee that file is not there in specified directory. Did some debugging but no= luck as well. Here is the error: nOperator: Load back 1 hashtable file from tmp file uri:c:/hadoop/hd= fs/mapred/local/taskTracker/distcache/-6923915657555089159_-359650783_82109= 8197/localhost/tmp/hive-vivek.mishra/hive_2012-11-24_11-12-30_853_407678261= 1151037010/-mr-10004/HashTable-Stage-5/Stage-5.tar.gz/MapJoin-mapfile10--.h= ashtable 2012-11-24 11:13:45,389 ERROR org.apache.hadoop.hive.ql.exec.MapJoinOperato= r: Load Distributed Cache Error 2012-11-24 11:13:45,390 FATAL ExecMapper: org.apache.hadoop.hive.ql.metadat= a.HiveException: c:\hadoop\hdfs\mapred\local\taskTracker\distcache\-6923915= 657555089159_-359650783_821098197\localhost\tmp\hive-vivek.mishra\hive_2012= -11-24_11-12-30_853_4076782611151037010\-mr-10004\HashTable-Stage-5\Stage-5= .tar.gz\MapJoin-mapfile10--.hashtable (The system cannot find the file spec= ified) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoi= nOperator.java:198) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileCh= angedOp(MapJoinOperator.java:212) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Ope= rator.java:1321) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operat= or.java:1325) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(O= perator.java:1325) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Oper= ator.java:1325) at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:495= ) at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:271) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma= tion.java:1135) at org.apache.hadoop.mapred.Child.main(Child.java:265) Also, i have verified there is no such OOM issue as well. Any idea? -Vivek ________________________________ Neustar VP and Impetus CEO to present on =91Innovative information services= powered by Cloud and Big Data technologies=92at Cloud Expo - Santa Clara, = Nov 6th. http://www.impetus.com/events#2. Check out Impetus contribution to build Luminar - a new business unit at En= travision. http://lf1.me/MS/ NOTE: This message may contain information that is confidential, proprietar= y, privileged or otherwise protected by law. The message is intended solely= for the named addressee. If received in error, please destroy and notify t= he sender. Any use of this email is prohibited when received in error. Impe= tus does not represent, warrant and/or guarantee, that the integrity of thi= s communication has been maintained nor that the communication is free of e= rrors, virus, interception or interference. ________________________________ Neustar VP and Impetus CEO to present on =91Innovative information services= powered by Cloud and Big Data technologies=92at Cloud Expo - Santa Clara, = Nov 6th. http://www.impetus.com/events#2. Check out Impetus contribution to build Luminar - a new business unit at En= travision. http://lf1.me/MS/ NOTE: This message may contain information that is confidential, proprietar= y, privileged or otherwise protected by law. The message is intended solely= for the named addressee. If received in error, please destroy and notify t= he sender. Any use of this email is prohibited when received in error. Impe= tus does not represent, warrant and/or guarantee, that the integrity of thi= s communication has been maintained nor that the communication is free of e= rrors, virus, interception or interference. ________________________________ Neustar VP and Impetus CEO to present on =91Innovative information services= powered by Cloud and Big Data technologies=92at Cloud Expo - Santa Clara, = Nov 6th. http://www.impetus.com/events#2. Check out Impetus contribution to build Luminar - a new business unit at En= travision. http://lf1.me/MS/ NOTE: This message may contain information that is confidential, proprietar= y, privileged or otherwise protected by law. The message is intended solely= for the named addressee. If received in error, please destroy and notify t= he sender. Any use of this email is prohibited when received in error. Impe= tus does not represent, warrant and/or guarantee, that the integrity of thi= s communication has been maintained nor that the communication is free of e= rrors, virus, interception or interference. ________________________________ Neustar VP and Impetus CEO to present on =91Innovative information services= powered by Cloud and Big Data technologies=92at Cloud Expo - Santa Clara, = Nov 6th. http://www.impetus.com/events#2. Check out Impetus contribution to build Luminar - a new business unit at En= travision. http://lf1.me/MS/ NOTE: This message may contain information that is confidential, proprietar= y, privileged or otherwise protected by law. The message is intended solely= for the named addressee. If received in error, please destroy and notify t= he sender. Any use of this email is prohibited when received in error. Impe= tus does not represent, warrant and/or guarantee, that the integrity of thi= s communication has been maintained nor that the communication is free of e= rrors, virus, interception or interference.