hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-204) Provide option to run hadoop via TestMiniMR
Date Fri, 08 May 2009 16:33:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12707406#action_12707406
] 

Namit Jain commented on HIVE-204:
---------------------------------

1. You need reflection, since you cant cast dfs to a given class (it is different in 17 and
19) - without casting appropriately, you cannot call the method
2. Will do
3. By default, qfile gets all the .1 files in the test directory, and I did not want to change
that behavior. I did not want to run miniMR cluster tests for all the files,
    since it takes a awefully long time. Once the tests have been parallelized, I agree clusterQueryFiles
can be removed, but we would need it till then.

Will do 2, and upload the new patch

> Provide option to run hadoop via TestMiniMR
> -------------------------------------------
>
>                 Key: HIVE-204
>                 URL: https://issues.apache.org/jira/browse/HIVE-204
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Raghotham Murthy
>            Assignee: Namit Jain
>         Attachments: hive.204.1.patch, hive.204.2.patch, hive.204.3.patch, hive.204.4.patch,
hive.204.5.patch
>
>
> Right now MapRedTask does an exec on the hadoop command line. This prevents us from stepping
through query execution code. If there were an option to run hadoop via MiniMR, this will
create tasks within the same VM and so allows stepping into the execution code. See, src/test/org/apache/hadoop/mapred/TestMiniMRWithDFS.java
in the hadoop source code for an example.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message