hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Commented] (HIVE-7717) Add .q tests coverage for "union all" [Spark Branch]
Date Mon, 18 Aug 2014 23:17:19 GMT


Brock Noland commented on HIVE-7717:


Based on your runs...if the order is not deterministic we can either add an ORDER BY to the
query or add the following to the top of the q file:


in either case we'd probably want to make the change on trunk and then merge to our branch
since the MR outputs would also need to be updated. We'd probably want to remove those tests
from this change and add them in a follow-up.

> Add .q tests coverage for "union all" [Spark Branch]
> ----------------------------------------------------
>                 Key: HIVE-7717
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>    Affects Versions: spark-branch
>            Reporter: Na Yang
>            Assignee: Na Yang
>         Attachments: HIVE-7717.1-spark.patch, HIVE-7717.2-spark.patch
> Add automation test coverage for "union all", by searching through the q-tests in "ql/src/test/queries/clientpositive/"
for union tests (like union*.q) and verifying/enabling them on spark.
> Steps to do:
> 1.  Enable a qtest <q-test-name>.q in itests/src/test/resources/
by adding the .q test files to spark.query.files.
> 2.  Run mvn test -Dtest=TestSparkCliDriver -Dqfile=<q-test-name>.q -Dtest.output.overwrite=true
-Phadoop-2 to generate the output (located in ql/src/test/results/clientpositive/spark). 
File will be called <q-test-name>.q.out.
> 3.  Check the generated output is good by verifying the results.  For comparison, check
the MR version in ql/src/test/results/clientpositive/<q-test-name>.q.out.  The reason
its separate is because the explain plan outputs are different for Spark/MR.
> 4.  Checkin the modification to, and the generated q.out
file as well.  You only have to generate the output once.

This message was sent by Atlassian JIRA

View raw message