hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6438) Sort query result for test, removing order by clause
Date Thu, 20 Feb 2014 08:34:19 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13906756#comment-13906756
] 

Navis commented on HIVE-6438:
-----------------------------

|| test  || before || after  || ratio ||
| alter_char1 | 27.326 | 9.149 | 33% |
| alter_varchar1 | 25.821 | 9.855 | 38% |
| auto_join26 | 7.073 | 4.049 | 57% |
| auto_smb_mapjoin_14 | 85.175 | 70.442 | 83% |
| auto_sortmerge_join_13 | 37.496 | 19.933 | 53% |
| auto_sortmerge_join_9 | 130.548 | 118.524 | 91% |
| avro_evolved_schemas | 3.495 | 0.539 | 15% |
| avro_joins | 6.613 | 3.723 | 56% |
| avro_partitioned | 9.64 | 6.66 | 69% |
| avro_sanity_test | 3.561 | 0.625 | 18% |
| ba_table1 | 6.828 | 3.822 | 56% |
| ba_table2 | 6.806 | 3.905 | 57% |
| ba_table_udfs | 10.683 | 10.426 | 98% |
| bucket1 | 6.736 | 3.905 | 58% |
| bucket2 | 7.056 | 6.772 | 96% |
| bucket3 | 11.037 | 10.75 | 97% |
| char_1 | 29.825 | 30.381 | 102% |
| char_join1 | 18.498 | 9.91 | 54% |
| column_access_stats | 80.685 | 64.514 | 80% |
| columnarserde_create_shortcut | 22.87 | 14.333 | 63% |
| combine1 | 6.546 | 6.599 | 101% |
| combine2_hadoop20 | 16.043 | 16.086 | 100% |
| correlationoptimizer10 | 48.366 | 31.195 | 64% |
| correlationoptimizer13 | 3.985 | 3.84 | 96% |
| correlationoptimizer15 | 18.137 | 12.084 | 67% |
| correlationoptimizer5 | 33.904 | 33.383 | 98% |
| correlationoptimizer6 | 182.366 | 131.649 | 72% |
| correlationoptimizer7 | 24.664 | 18.585 | 75% |
| correlationoptimizer8 | 37.466 | 25.747 | 69% |
| correlationoptimizer9 | 40.926 | 28.451 | 70% |
| create_like_view | 14.246 | 8.53 | 60% |
| ctas_colname | 49.982 | 29.768 | 60% |
| custom_input_output_format | 9.788 | 4.116 | 42% |
| database | 41.216 | 41.189 | 100% |
| groupby7_noskew_multi_single_reducer | 16.472 | 10.73 | 65% |
| groupby_complex_types_multi_single_reducer | 19.168 | 13.564 | 71% |
| groupby_cube1 | 39.928 | 29.051 | 73% |
| groupby_grouping_sets4 | 29.973 | 24.499 | 82% |
| groupby_multi_single_reducer | 42.596 | 18.881 | 44% |
| groupby_rollup1 | 39.786 | 28.719 | 72% |
| groupby_sort_1 | 146.289 | 89.08 | 61% |
| groupby_sort_2 | 10.793 | 7.812 | 72% |
| groupby_sort_3 | 17.082 | 11.575 | 68% |
| groupby_sort_4 | 17.563 | 11.685 | 67% |
| groupby_sort_5 | 32.027 | 23.319 | 73% |
| groupby_sort_6 | 21.132 | 11.791 | 56% |
| groupby_sort_7 | 10.995 | 8.234 | 75% |
| groupby_sort_skew_1 | 168.438 | 115.564 | 69% |
| index_auto | 19.104 | 19.767 | 103% |
| index_auto_file_format | 16.21 | 15.927 | 98% |
| index_auto_mult_tables | 38.724 | 33.041 | 85% |
| index_auto_mult_tables_compact | 41.608 | 35.675 | 86% |
| index_auto_multiple | 13.963 | 14.107 | 101% |
| index_auto_partitioned | 25.066 | 25.048 | 100% |
| index_auto_self_join | 22.586 | 16.444 | 73% |
| index_auto_unused | 27.822 | 27.41 | 99% |
| index_bitmap | 59.568 | 57.727 | 97% |
| index_bitmap1 | 15.728 | 13.16 | 84% |
| index_bitmap2 | 23.171 | 17.92 | 77% |
| index_bitmap_auto_partitioned | 21.868 | 22.339 | 102% |
| index_bitmap_compression | 9.998 | 11.741 | 117% |
| index_bitmap_rc | 77.58 | 74.744 | 96% |
| index_compact | 64.632 | 61.943 | 96% |
| index_compact_1 | 15.935 | 12.709 | 80% |
| index_compact_2 | 84.556 | 77.335 | 91% |
| index_compact_3 | 19.41 | 16.588 | 85% |
| index_compression | 9.991 | 9.945 | 100% |
| index_serde | 10.411 | 10.184 | 98% |
| innerjoin | 12.636 | 9.655 | 76% |
| input11_limit | 6.782 | 3.864 | 57% |
| input1_limit | 13.376 | 7.594 | 57% |
| input40 | 6.889 | 1.149 | 17% |
| input42 | 9.744 | 6.861 | 70% |
| input_lazyserde | 23.163 | 17.42 | 75% |
| input_part9 | 3.477 | 3.312 | 95% |
| insert1 | 24.575 | 18.72 | 76% |
| join18_multi_distinct | 12.342 | 9.309 | 75% |
| join25 | 6.704 | 3.821 | 57% |
| join26 | 7.149 | 4.06 | 57% |
| join27 | 6.759 | 4.167 | 62% |
| join28 | 6.808 | 4.026 | 59% |
| join29 | 12.951 | 9.743 | 75% |
| join30 | 7.123 | 3.996 | 56% |
| join31 | 16.105 | 12.895 | 80% |
| join32 | 7.132 | 4.18 | 59% |
| join32_lessSize | 60.27 | 41.925 | 70% |
| join33 | 6.991 | 4.247 | 61% |
| join34 | 6.98 | 4.19 | 60% |
| join35 | 13.1 | 10.66 | 81% |
| join36 | 13.841 | 11.159 | 81% |
| join37 | 6.745 | 3.867 | 57% |
| join39 | 8.657 | 5.801 | 67% |
| join_1to1 | 175.384 | 91.698 | 52% |
| join_casesensitive | 6.262 | 3.45 | 55% |
| join_filters_overlap | 38.889 | 39.421 | 101% |
| join_map_ppr | 20.85 | 15.375 | 74% |
| join_nulls | 206.852 | 148.439 | 72% |
| join_nullsafe | 97.615 | 72.651 | 74% |
| leftsemijoin | 12.525 | 11.248 | 90% |
| load_dyn_part14 | 18.488 | 16.752 | 91% |
| load_dyn_part2 | 11.011 | 5.552 | 50% |
| mapjoin_subquery | 6.541 | 6.764 | 103% |
| merge3 | 35.447 | 27.505 | 78% |
| merge_dynamic_partition | 22.097 | 14.232 | 64% |
| merge_dynamic_partition3 | 17.612 | 15.203 | 86% |
| multi_insert | 134.546 | 65.842 | 49% |
| multi_insert_gby | 20.426 | 8.363 | 41% |
| multi_insert_lateral_view | 86.077 | 46.963 | 55% |
| multi_insert_move_tasks_share_dependencies | 235.024 | 145.677 | 62% |
| newline | 57.86 | 45.289 | 78% |
| nonblock_op_deduplicate | 16.403 | 13.925 | 85% |
| orc_diff_part_cols | 13.177 | 10.586 | 80% |
| orc_empty_strings | 10.205 | 7.607 | 75% |
| orc_split_elimination | 96.17 | 93.675 | 97% |
| parallel | 33.535 | 17.761 | 53% |
| | 3968.875 | 2902.296 | 73% |

> Sort query result for test, removing order by clause 
> -----------------------------------------------------
>
>                 Key: HIVE-6438
>                 URL: https://issues.apache.org/jira/browse/HIVE-6438
>             Project: Hive
>          Issue Type: Improvement
>          Components: Testing Infrastructure
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Trivial
>         Attachments: HIVE-6438.1.patch.txt, HIVE-6438.2.patch.txt, HIVE-6438.3.patch.txt
>
>
> For acquiring conformed output in various hadoop versions, most queries have order-by
clause. If we support test declaration similar to SORT_BEFORE_DIFF which is for sorting output
per query. We can remove order-by clauses and reduce the test time.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message