hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1671) multithreading on Context.pathToCS
Date Mon, 27 Sep 2010 19:22:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12915440#action_12915440
] 

Namit Jain commented on HIVE-1671:
----------------------------------

Are your using HiveServer ?

.bq we having 2 threads running at 100%

What do you mean by the above ? Are you setting hive.exec.parallel to true, in which case,
I can see the problem happening ?

> multithreading on Context.pathToCS
> ----------------------------------
>
>                 Key: HIVE-1671
>                 URL: https://issues.apache.org/jira/browse/HIVE-1671
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1671-1.patch
>
>
> we having 2 threads running at 100%
> With a stacktrace like this:
> "Thread-16725" prio=10 tid=0x00007ff410662000 nid=0x497d runnable [0x00000000442eb000]
>    java.lang.Thread.State: RUNNABLE
>         at java.util.HashMap.get(HashMap.java:303)
>         at org.apache.hadoop.hive.ql.Context.getCS(Context.java:524)
>         at org.apache.hadoop.hive.ql.exec.Utilities.getInputSummary(Utilities.java:1369)
>         at org.apache.hadoop.hive.ql.exec.MapRedTask.estimateNumberOfReducers(MapRedTask.java:329)
>         at org.apache.hadoop.hive.ql.exec.MapRedTask.setNumberOfReducers(MapRedTask.java:297)
>         at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:84)
>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
>         at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
>         at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message