hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh S (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1562) CombineHiveInputFormat issues in minimr mode
Date Thu, 19 Aug 2010 08:17:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900212#action_12900212
] 

Venkatesh S commented on HIVE-1562:
-----------------------------------

There is a bug in CombineFileInputFormat and you would need to patch hadoop core with HADOOP-5759.
If you cannot patch core, you could patch the client side and use HADOOP-1938 which is what
we are doing.

> CombineHiveInputFormat issues in minimr mode
> --------------------------------------------
>
>                 Key: HIVE-1562
>                 URL: https://issues.apache.org/jira/browse/HIVE-1562
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Joydeep Sen Sarma
>
> followup from HIVE-1523. This is probably because of CombineHiveInputFormat:
> ant -Dclustermode=miniMR -Dtestcase=TestCliDriver -Dqfile=sample10.q test
> insert overwrite table srcpartbucket partition(ds, hr) select * from srcpart where ds
is not null and key < 10
> 2010-08-18 15:13:54,378 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK:
query: insert overwrite table srcpartbucket partition(ds, hr) select *\
>  from srcpart where ds is not null and key < 10
> 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK:
type: QUERY
> 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK:
Input: default@srcpart@ds=2008-04-08/hr=11
> 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK:
Input: default@srcpart@ds=2008-04-08/hr=12
> 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK:
Input: default@srcpart@ds=2008-04-09/hr=11
> 2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277)) - PREHOOK:
Input: default@srcpart@ds=2008-04-09/hr=12
> 2010-08-18 15:13:54,704 WARN  mapred.JobClient (JobClient.java:configureCommandLineOptions(539))
- Use GenericOptionsParser for parsing the arguments. Applicati\
> ons should implement Tool for the same.
> 2010-08-18 15:13:55,642 ERROR mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(83))
- Job initialization failed:
> java.lang.IllegalArgumentException: Network location name contains /: /default-rack
>   at org.apache.hadoop.net.NodeBase.set(NodeBase.java:75)
>   at org.apache.hadoop.net.NodeBase.<init>(NodeBase.java:57)
>   at org.apache.hadoop.mapred.JobTracker.addHostToNodeMapping(JobTracker.java:2326)
>   at org.apache.hadoop.mapred.JobTracker.resolveAndAddToTopology(JobTracker.java:2320)
>   at org.apache.hadoop.mapred.JobInProgress.createCache(JobInProgress.java:343)
>   at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:440)
>   at org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81)
>   at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
>   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
>   at java.lang.Thread.run(Thread.java:619)
> 2010-08-18 15:13:56,566 ERROR exec.MapRedTask (SessionState.java:printError(277)) - Ended
Job = job_201008181513_0001 with errors
> 2010-08-18 15:13:56,597 ERROR ql.Driver (SessionState.java:printError(277)) - FAILED:
Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedT\
> ask
> See also:combine2.q

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message