hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Friedrich (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-8503) UT: add TestSparkMinimrCliDriver to run UTs that use HDFS
Date Fri, 07 Nov 2014 22:58:33 GMT

     [ https://issues.apache.org/jira/browse/HIVE-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Thomas Friedrich updated HIVE-8503:
-----------------------------------
    Description: 
The tests
empty_dir_in_table
temp_table_external
load_hdfs_file_with_space_in_the_name
external_table_with_space_in_location_path
schemeAuthority2
create directories in HDFS, but TestSparkCliDriver is not using HDFS. 

That's why the tests fail when creating a dir, for example mkdir -p hdfs:///tmp/temp_table_external
In the non-spark case, these tests are executed with the TestMinimrCliDriver which initializes
Hadoop and created a mini-cluster
(see configuration in itests/qtest/pom.xml).

We may need to configure a TestSparkMinimrCliDriver in itests/qtest-spark/pom.xml if we want
to run these test cases.


  was:
The 3 tests
temp_table_external
load_hdfs_file_with_space_in_the_name
external_table_with_space_in_location_path
create directories in HDFS, but TestSparkCliDriver is not using HDFS. 

That's why the tests fail when creating a dir, for example mkdir -p hdfs:///tmp/temp_table_external
In the non-spark case, these tests are executed with the TestMinimrCliDriver which initializes
Hadoop and created a mini-cluster
(see configuration in itests/qtest/pom.xml).

We may need to configure a TestSparkMinimrCliDriver in itests/qtest-spark/pom.xml if we want
to run these test cases.



> UT: add TestSparkMinimrCliDriver to run UTs that use HDFS
> ---------------------------------------------------------
>
>                 Key: HIVE-8503
>                 URL: https://issues.apache.org/jira/browse/HIVE-8503
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Thomas Friedrich
>            Assignee: Thomas Friedrich
>            Priority: Minor
>
> The tests
> empty_dir_in_table
> temp_table_external
> load_hdfs_file_with_space_in_the_name
> external_table_with_space_in_location_path
> schemeAuthority2
> create directories in HDFS, but TestSparkCliDriver is not using HDFS. 
> That's why the tests fail when creating a dir, for example mkdir -p hdfs:///tmp/temp_table_external
> In the non-spark case, these tests are executed with the TestMinimrCliDriver which initializes
Hadoop and created a mini-cluster
> (see configuration in itests/qtest/pom.xml).
> We may need to configure a TestSparkMinimrCliDriver in itests/qtest-spark/pom.xml if
we want to run these test cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message