hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joydeep Sen Sarma (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-204) Provide option to run hadoop via TestMiniMR
Date Fri, 02 Jan 2009 07:35:44 GMT

    [ https://issues.apache.org/jira/browse/HIVE-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660268#action_12660268
] 

Joydeep Sen Sarma commented on HIVE-204:
----------------------------------------

we do have the option of submitting the job from the same vm (which is what we do in non-local
mode). in local mode - we ran into issues with multiple tasks running in same jvm (we generally
assume one task per jvm).

is this asking for running tests in non-local mode against a test cluster (miniMR?) (same
as hive-117?)

> Provide option to run hadoop via TestMiniMR
> -------------------------------------------
>
>                 Key: HIVE-204
>                 URL: https://issues.apache.org/jira/browse/HIVE-204
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Raghotham Murthy
>
> Right now MapRedTask does an exec on the hadoop command line. This prevents us from stepping
through query execution code. If there were an option to run hadoop via MiniMR, this will
create tasks within the same VM and so allows stepping into the execution code. See, src/test/org/apache/hadoop/mapred/TestMiniMRWithDFS.java
in the hadoop source code for an example.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message