hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-19572) Add option to mask stats and data size in q files
Date Wed, 16 May 2018 20:36:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-19572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478070#comment-16478070
] 

Hive QA commented on HIVE-19572:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12923742/HIVE-19572.01.patch

{color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 14397 tests executed
*Failed tests:*
{noformat}
TestMinimrCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=94)
	[infer_bucket_sort_num_buckets.q,infer_bucket_sort_reducers_power_two.q,parallel_orderby.q,bucket_num_reducers_acid.q,scriptfile1.q,infer_bucket_sort_map_operators.q,infer_bucket_sort_merge.q,root_dir_external_table.q,infer_bucket_sort_dyn_part.q,udf_using.q]
org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_stage_max_tasks]
(batchId=255)
org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_task_failure] (batchId=255)
org.apache.hadoop.hive.cli.TestSparkPerfCliDriver.testCliDriver[query39] (batchId=255)
org.apache.hadoop.hive.ql.TestAutoPurgeTables.testExternalNoAutoPurge (batchId=233)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/10995/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/10995/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-10995/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12923742 - PreCommit-HIVE-Build

> Add option to mask stats and data size in q files
> -------------------------------------------------
>
>                 Key: HIVE-19572
>                 URL: https://issues.apache.org/jira/browse/HIVE-19572
>             Project: Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>    Affects Versions: 3.1.0
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Major
>             Fix For: 3.1.0
>
>         Attachments: HIVE-19572.01.patch
>
>
> Some tests are flaky because of minimal data size differences, e.g., one byte. However,
many times we do not actually care about these differences. One example is {{default_constraint.q}}.
> Patch adds the possibility to mask 1) printing of stats selectively on q files by adding
the {{-- MASK_STATS}} option, and 2) printing of data size stats selectively on q files by
adding the {{-- MASK_DATA_SIZE}} option.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message