hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7702) Start running .q file tests on spark [Spark Branch]
Date Fri, 29 May 2015 02:28:21 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xuefu Zhang updated HIVE-7702:
------------------------------
    Fix Version/s:     (was: spark-branch)
                   1.1.0

> Start running .q file tests on spark [Spark Branch]
> ---------------------------------------------------
>
>                 Key: HIVE-7702
>                 URL: https://issues.apache.org/jira/browse/HIVE-7702
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Brock Noland
>            Assignee: Chinna Rao Lalam
>             Fix For: 1.1.0
>
>         Attachments: HIVE-7702-spark.patch, HIVE-7702.1-spark.patch
>
>
> Spark can currently only support a few queries, however there are some .q file tests
which will pass today. The basic idea is that we should get some number of these actually
working (10-20) so we can actually start testing the project.
> A good starting point might be the udf*, varchar*, or alter* tests:
> https://github.com/apache/hive/tree/spark/ql/src/test/queries/clientpositive
> To generate the output file for test XXX.q, you'd do:
> {noformat}
> mvn clean install -DskipTests -Phadoop-2
> cd itests
> mvn clean install -DskipTests -Phadoop-2
> cd qtest-spark
> mvn test -Dtest= TestSparkCliDriver -Dqfile=XXX.q -Dtest.output.overwrite=true -Phadoop-2
> {noformat}
> which would generate XXX.q.out which we can check-in to source control as a "golden file".
> Multiple tests can be run at a give time as so:
> {noformat}
> mvn test -Dtest= TestSparkCliDriver -Dqfile=X1.q,X2.q -Dtest.output.overwrite=true -Phadoop-2
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message