Return-Path: Delivered-To: apmail-hadoop-hive-dev-archive@minotaur.apache.org Received: (qmail 7142 invoked from network); 19 Aug 2010 07:40:41 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 19 Aug 2010 07:40:41 -0000 Received: (qmail 38162 invoked by uid 500); 19 Aug 2010 07:40:41 -0000 Delivered-To: apmail-hadoop-hive-dev-archive@hadoop.apache.org Received: (qmail 37955 invoked by uid 500); 19 Aug 2010 07:40:38 -0000 Mailing-List: contact hive-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-dev@hadoop.apache.org Delivered-To: mailing list hive-dev@hadoop.apache.org Received: (qmail 37946 invoked by uid 99); 19 Aug 2010 07:40:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Aug 2010 07:40:37 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Aug 2010 07:40:36 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o7J7eGYK029032 for ; Thu, 19 Aug 2010 07:40:16 GMT Message-ID: <15460118.441421282203616439.JavaMail.jira@thor> Date: Thu, 19 Aug 2010 03:40:16 -0400 (EDT) From: "Joydeep Sen Sarma (JIRA)" To: hive-dev@hadoop.apache.org Subject: [jira] Updated: (HIVE-1562) CombineHiveInputFormat issues in minimr mode In-Reply-To: <30166075.432501282170496378.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1562: ------------------------------------ Summary: CombineHiveInputFormat issues in minimr mode (was: sample10.q fails in minimr mode) Description: followup from HIVE-1523. This is probably because of CombineHiveInputFormat: ant -Dclustermode=miniMR -Dtestcase=TestCliDriver -Dqfile=sample10.q test insert overwrite table srcpartbucket partition(ds, hr) select * from srcpart where ds is not null and key < 10 2010-08-18 15:13:54,378 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: query: insert overwrite table srcpartbucket partition(ds, hr) select *\ from srcpart where ds is not null and key < 10 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: type: QUERY 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 2010-08-18 15:13:54,704 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applicati\ ons should implement Tool for the same. 2010-08-18 15:13:55,642 ERROR mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(83)) - Job initialization failed: java.lang.IllegalArgumentException: Network location name contains /: /default-rack at org.apache.hadoop.net.NodeBase.set(NodeBase.java:75) at org.apache.hadoop.net.NodeBase.(NodeBase.java:57) at org.apache.hadoop.mapred.JobTracker.addHostToNodeMapping(JobTracker.java:2326) at org.apache.hadoop.mapred.JobTracker.resolveAndAddToTopology(JobTracker.java:2320) at org.apache.hadoop.mapred.JobInProgress.createCache(JobInProgress.java:343) at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:440) at org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:619) 2010-08-18 15:13:56,566 ERROR exec.MapRedTask (SessionState.java:printError(277)) - Ended Job = job_201008181513_0001 with errors 2010-08-18 15:13:56,597 ERROR ql.Driver (SessionState.java:printError(277)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedT\ ask See also:combine2.q was: followup from HIVE-1523. This is probably because of CombineHiveInputFormat: ant -Dclustermode=miniMR -Dtestcase=TestCliDriver -Dqfile=smb_mapjoin_8.q test insert overwrite table srcpartbucket partition(ds, hr) select * from srcpart where ds is not null and key < 10 2010-08-18 15:13:54,378 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: query: insert overwrite table srcpartbucket partition(ds, hr) select *\ from srcpart where ds is not null and key < 10 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: type: QUERY 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 2010-08-18 15:13:54,704 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applicati\ ons should implement Tool for the same. 2010-08-18 15:13:55,642 ERROR mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(83)) - Job initialization failed: java.lang.IllegalArgumentException: Network location name contains /: /default-rack at org.apache.hadoop.net.NodeBase.set(NodeBase.java:75) at org.apache.hadoop.net.NodeBase.(NodeBase.java:57) at org.apache.hadoop.mapred.JobTracker.addHostToNodeMapping(JobTracker.java:2326) at org.apache.hadoop.mapred.JobTracker.resolveAndAddToTopology(JobTracker.java:2320) at org.apache.hadoop.mapred.JobInProgress.createCache(JobInProgress.java:343) at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:440) at org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:619) 2010-08-18 15:13:56,566 ERROR exec.MapRedTask (SessionState.java:printError(277)) - Ended Job = job_201008181513_0001 with errors 2010-08-18 15:13:56,597 ERROR ql.Driver (SessionState.java:printError(277)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedT\ ask > CombineHiveInputFormat issues in minimr mode > -------------------------------------------- > > Key: HIVE-1562 > URL: https://issues.apache.org/jira/browse/HIVE-1562 > Project: Hadoop Hive > Issue Type: Bug > Reporter: Joydeep Sen Sarma > > followup from HIVE-1523. This is probably because of CombineHiveInputFormat: > ant -Dclustermode=miniMR -Dtestcase=TestCliDriver -Dqfile=sample10.q test > insert overwrite table srcpartbucket partition(ds, hr) select * from srcpart where ds is not null and key < 10 > 2010-08-18 15:13:54,378 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: query: insert overwrite table srcpartbucket partition(ds, hr) select *\ > from srcpart where ds is not null and key < 10 > 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: type: QUERY > 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 > 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 > 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 > 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 > 2010-08-18 15:13:54,704 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applicati\ > ons should implement Tool for the same. > 2010-08-18 15:13:55,642 ERROR mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(83)) - Job initialization failed: > java.lang.IllegalArgumentException: Network location name contains /: /default-rack > at org.apache.hadoop.net.NodeBase.set(NodeBase.java:75) > at org.apache.hadoop.net.NodeBase.(NodeBase.java:57) > at org.apache.hadoop.mapred.JobTracker.addHostToNodeMapping(JobTracker.java:2326) > at org.apache.hadoop.mapred.JobTracker.resolveAndAddToTopology(JobTracker.java:2320) > at org.apache.hadoop.mapred.JobInProgress.createCache(JobInProgress.java:343) > at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:440) > at org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) > at java.lang.Thread.run(Thread.java:619) > 2010-08-18 15:13:56,566 ERROR exec.MapRedTask (SessionState.java:printError(277)) - Ended Job = job_201008181513_0001 with errors > 2010-08-18 15:13:56,597 ERROR ql.Driver (SessionState.java:printError(277)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedT\ > ask > See also:combine2.q -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.