hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Updated] (HIVE-7702) Start running .q file tests on spark [Spark Branch]
Date Fri, 22 Aug 2014 20:36:11 GMT


Brock Noland updated HIVE-7702:

       Resolution: Fixed
    Fix Version/s: spark-branch
           Status: Resolved  (was: Patch Available)

Thank you so much Chinna! I have committed this to spark!

> Start running .q file tests on spark [Spark Branch]
> ---------------------------------------------------
>                 Key: HIVE-7702
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Brock Noland
>            Assignee: Chinna Rao Lalam
>             Fix For: spark-branch
>         Attachments: HIVE-7702-spark.patch, HIVE-7702.1-spark.patch
> Spark can currently only support a few queries, however there are some .q file tests
which will pass today. The basic idea is that we should get some number of these actually
working (10-20) so we can actually start testing the project.
> A good starting point might be the udf*, varchar*, or alter* tests:
> To generate the output file for test XXX.q, you'd do:
> {noformat}
> mvn clean install -DskipTests -Phadoop-2
> cd itests
> mvn clean install -DskipTests -Phadoop-2
> cd qtest-spark
> mvn test -Dtest=TestCliDriver -Dqfile=XXX.q -Dtest.output.overwrite=true -Phadoop-2
> {noformat}
> which would generate XXX.q.out which we can check-in to source control as a "golden file".
> Multiple tests can be run at a give time as so:
> {noformat}
> mvn test -Dtest=TestCliDriver -Dqfile=X1.q,X2.q -Dtest.output.overwrite=true -Phadoop-2
> {noformat}

This message was sent by Atlassian JIRA

View raw message