hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-14990) run all tests for MM tables and fix the issues that are found
Date Fri, 10 Feb 2017 03:53:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668996#comment-15668996
] 

Sergey Shelukhin edited comment on HIVE-14990 at 2/10/17 3:53 AM:
------------------------------------------------------------------

Updated test list to fix/declare irrelevant before closing this. Only updated the CliDriver
list actually, haven't made my way thru it yet
{panel}
TestCliDriver:
-stats_list_bucket-
-show_tablestatus-
-vector_udf2-
-list_bucket_dml_14-
-autoColumnStats_9-
-stats_noscan_2-
-symlink_text_input_format-
-temp_table_precedence-
-offset_limit_global_optimizer-
-rand_partitionpruner2-
-materialized_view_authorization_sqlstd,materialized-
-merge_dynamic_partition, etc-
-orc_vectorization_ppd-
-parquet_join2-
-repl_3_exim_metadata-
-sample6-
-sample_islocalmode_hook-
smb_mapjoin_2,smb_mapjoin_3,smb_mapjoin_7
orc_createas1
exim_16_part_external,exim_17_part_managed,


TestEncryptedHDFSCliDriver:
encryption_ctas
encryption_drop_partition 
encryption_insert_values
encryption_join_unencrypted_tbl
encryption_load_data_to_encrypted_tables

MiniLlapLocal:
exchgpartition2lel
cbo_rp_lineage2
create_merge_compressed
deleteAnalyze
delete_where_no_match
delete_where_non_partitioned
dynpart_sort_optimization
escape2
insert1
lineage2
lineage3
orc_llap
schema_evol_orc_nonvec_part
schema_evol_orc_vec_part
schema_evol_text_nonvec_part
schema_evol_text_vec_part
schema_evol_text_vecrow_part
smb_mapjoin_6
tez_dml
union_fast_stats
update_all_types
update_tmp_table
update_where_no_match
update_where_non_partitioned
vector_outer_join1
vector_outer_join4

MiniLlap:
load_fs2
orc_ppd_basic
external_table_with_space_in_location_path
file_with_header_footer
import_exported_table
schemeAuthority,schemeAuthority2
table_nonprintable

Minimr:
infer_bucket_sort_map_operators
infer_bucket_sort_merge
infer_bucket_sort_reducers_power_two
root_dir_external_table
scriptfile1

TestSymlinkTextInputFormat#testCombine 
TestJdbcWithLocalClusterSpark, etc.
{panel}


was (Author: sershe):
Updated test list to fix/declare irrelevant before closing this. Only updated the CliDriver
list actually, haven't made my way thru it yet
{panel}
TestCliDriver:
-stats_list_bucket-
-show_tablestatus-
-vector_udf2-
-list_bucket_dml_14-
-autoColumnStats_9-
-stats_noscan_2-
-symlink_text_input_format-
-temp_table_precedence-
-offset_limit_global_optimizer-
-rand_partitionpruner2-
materialized_view_authorization_sqlstd,materialized_
-merge_dynamic_partition, etc-
-orc_vectorization_ppd-
parquet_join2
repl_3_exim_metadata
sample6
sample_islocalmode_hook
smb_mapjoin_2,smb_mapjoin_3,smb_mapjoin_7
orc_createas1
exim_16_part_external,exim_17_part_managed,


TestEncryptedHDFSCliDriver:
encryption_ctas
encryption_drop_partition 
encryption_insert_values
encryption_join_unencrypted_tbl
encryption_load_data_to_encrypted_tables

MiniLlapLocal:
exchgpartition2lel
cbo_rp_lineage2
create_merge_compressed
deleteAnalyze
delete_where_no_match
delete_where_non_partitioned
dynpart_sort_optimization
escape2
insert1
lineage2
lineage3
orc_llap
schema_evol_orc_nonvec_part
schema_evol_orc_vec_part
schema_evol_text_nonvec_part
schema_evol_text_vec_part
schema_evol_text_vecrow_part
smb_mapjoin_6
tez_dml
union_fast_stats
update_all_types
update_tmp_table
update_where_no_match
update_where_non_partitioned
vector_outer_join1
vector_outer_join4

MiniLlap:
load_fs2
orc_ppd_basic
external_table_with_space_in_location_path
file_with_header_footer
import_exported_table
schemeAuthority,schemeAuthority2
table_nonprintable

Minimr:
infer_bucket_sort_map_operators
infer_bucket_sort_merge
infer_bucket_sort_reducers_power_two
root_dir_external_table
scriptfile1

TestSymlinkTextInputFormat#testCombine 
TestJdbcWithLocalClusterSpark, etc.
{panel}

> run all tests for MM tables and fix the issues that are found
> -------------------------------------------------------------
>
>                 Key: HIVE-14990
>                 URL: https://issues.apache.org/jira/browse/HIVE-14990
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-14990.01.patch, HIVE-14990.02.patch, HIVE-14990.03.patch, HIVE-14990.04.patch,
HIVE-14990.04.patch, HIVE-14990.05.patch, HIVE-14990.05.patch, HIVE-14990.06.patch, HIVE-14990.06.patch,
HIVE-14990.07.patch, HIVE-14990.08.patch, HIVE-14990.09.patch, HIVE-14990.10.patch, HIVE-14990.10.patch,
HIVE-14990.10.patch, HIVE-14990.12.patch, HIVE-14990.13.patch, HIVE-14990.patch
>
>
> Expected failures 
> 1) All HCat tests (cannot write MM tables via the HCat writer)
> 2) Almost all merge tests (alter .. concat is not supported).
> 3) Tests that run dfs commands with specific paths (path changes).
> 4) Truncate column (not supported).
> 5) Describe formatted will have the new table fields in the output (before merging MM
with ACID).
> 6) Many tests w/explain extended - diff in partition "base file name" (path changes).
> 7) TestTxnCommands - all the conversion tests, as they check for bucket count using file
lists (path changes).
> 8) HBase metastore tests cause methods are not implemented.
> 9) Some load and ExIm tests that export a table and then rely on specific path for load
(path changes).
> 10) Bucket map join/etc. - diffs; disabled the optimization for MM tables due to how
it accounts for buckets
> 11) rand - different results due to different sequence of processing.
> 12) many (not all i.e. not the ones with just one insert) tests that have stats output,
such as file count, for obvious reasons
> 13) materialized views, not handled by design - the test check erroneously makes them
"mm", no easy way to tell them apart, I don't want to plumb more stuff thru just for this
test
> I'm filing jiras for some test failures that are not obvious and need an investigation
later



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message