impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Knupp (Code Review)" <ger...@cloudera.org>
Subject [Impala-ASF-CR] IMPALA-4482: Use ALTER TABLE / RECOVER PARTITIONS when loading tpcds.store sales
Date Fri, 13 Jan 2017 22:23:26 GMT
David Knupp has posted comments on this change.

Change subject: IMPALA-4482: Use ALTER TABLE / RECOVER PARTITIONS when loading tpcds.store_sales
......................................................................


Patch Set 6:

And just to confirm that this works:

./testdata/bin/generate-schema-statements.py --exploration_strategy=core --workload=tpcds
--scale_factor= --verbose --force_reload --hive_warehouse_dir=/test-warehouse --hdfs_namenode=localhost:20500
--backend=localhost:21000
  INFO:bootstrap_virtualenv:Installing Kudu into the virtualenv
  Target Dataset: tpcds
  HDFS path: /test-warehouse/tpcds.customer_demographics does not exists or is empty. Data
will be loaded.
  HDFS path: /test-warehouse/tpcds.date_dim does not exists or is empty. Data will be loaded.
  HDFS path: /test-warehouse/tpcds.time_dim does not exists or is empty. Data will be loaded.
  HDFS path: /test-warehouse/tpcds.item does not exists or is empty. Data will be loaded.
  HDFS path: /test-warehouse/tpcds.store does not exists or is empty. Data will be loaded.
  HDFS path: /test-warehouse/tpcds.customer does not exists or is empty. Data will be loaded.
  HDFS path: /test-warehouse/tpcds.promotion does not exists or is empty. Data will be loaded.
  HDFS path: /test-warehouse/tpcds.household_demographics does not exists or is empty. Data
will be loaded.
  HDFS path: /test-warehouse/tpcds.customer_address does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.store_sales_unpartitioned does not exists or is empty.
Data will be loaded.
  HDFS path: /test-warehouse/tpcds.store_sales does not exists or is empty. Data will be loaded.
  HDFS path: /test-warehouse/tpcds.customer_demographics_seq_snap does not exists or is empty.
Data will be loaded.
  HDFS path: /test-warehouse/tpcds.date_dim_seq_snap does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.time_dim_seq_snap does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.item_seq_snap does not exists or is empty. Data will be
loaded.
  HDFS path: /test-warehouse/tpcds.store_seq_snap does not exists or is empty. Data will be
loaded.
  HDFS path: /test-warehouse/tpcds.customer_seq_snap does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.promotion_seq_snap does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.household_demographics_seq_snap does not exists or is empty.
Data will be loaded.
  HDFS path: /test-warehouse/tpcds.customer_address_seq_snap does not exists or is empty.
Data will be loaded.
  Skipping 'tpcds_seq_snap.store_sales_unpartitioned' due to include constraint match.
  HDFS path: /test-warehouse/tpcds.store_sales_seq_snap does not exists or is empty. Data
will be loaded.
  HDFS path: /test-warehouse/tpcds.customer_demographics_parquet does not exists or is empty.
Data will be loaded.
  HDFS path: /test-warehouse/tpcds.date_dim_parquet does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.time_dim_parquet does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.item_parquet does not exists or is empty. Data will be
loaded.
  HDFS path: /test-warehouse/tpcds.store_parquet does not exists or is empty. Data will be
loaded.
  HDFS path: /test-warehouse/tpcds.customer_parquet does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.promotion_parquet does not exists or is empty. Data will
be loaded.
  HDFS path: /test-warehouse/tpcds.household_demographics_parquet does not exists or is empty.
Data will be loaded.
  HDFS path: /test-warehouse/tpcds.customer_address_parquet does not exists or is empty. Data
will be loaded.
  Skipping 'tpcds_parquet.store_sales_unpartitioned' due to include constraint match.
  HDFS path: /test-warehouse/tpcds.store_sales_parquet does not exists or is empty. Data will
be loaded.

-- 
To view, visit http://gerrit.cloudera.org:8080/5177
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Iaae97d1d44201aeeacacdd39adbae35753512950
Gerrit-PatchSet: 6
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: David Knupp <dknupp@cloudera.com>
Gerrit-Reviewer: David Knupp <dknupp@cloudera.com>
Gerrit-Reviewer: Dimitris Tsirogiannis <dtsirogiannis@cloudera.com>
Gerrit-Reviewer: Harrison Sheinblatt <hs7@hotmail.com>
Gerrit-Reviewer: Internal Jenkins
Gerrit-Reviewer: Jim Apple <jbapple-impala@apache.org>
Gerrit-HasComments: No

Mime
View raw message