impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Behm (Code Review)" <ger...@cloudera.org>
Subject [Impala-CR](cdh5-trunk) Consolidate test and cluster logs under a single directory.
Date Wed, 09 Mar 2016 08:00:00 GMT
Hello Michael Brown, Tim Armstrong,

I'd like you to reexamine a change.  Please visit

    http://gerrit.cloudera.org:8080/2456

to look at the new patch set (#4).

Change subject: Consolidate test and cluster logs under a single directory.
......................................................................

Consolidate test and cluster logs under a single directory.

All logs, test results and SQL files generated during data
loading and testing are now consolidated under a single new
directory $IMPALA_HOME/logs. The goal is to simplify archiving
in Jenkins runs and debugging.

The new structure is as follows:

$IMPALA_HOME/logs/cluster
- logs of Hadoop components and Impala

$IMPALA_HOME/logs/data_loading
- logs and SQL files produced in data loading

$IMPALA_HOME/logs/fe_tests
- logs and test output of Frontend unit tests

$IMPALA_HOME/logs/be_tests
- logs and test output of Backend unit tests

$IMPALA_HOME/logs/ee_tests
- logs and test output of end-to-end tests

$IMPALA_HOME/logs/custom_cluster_tests
- logs and test output of custom cluster tests

I tested this change with a full data load which
was successful.

Change-Id: Ief1f58f3320ec39d31b3c6bc6ef87f58ff7dfdfa
---
M .gitignore
A LOGS.md
M be/CMakeLists.txt
M be/src/rpc/authentication-test.cc
M be/src/util/thread-pool-test.cc
M bin/clean.sh
M bin/impala-config.sh
M bin/load-data.py
M bin/run-all-tests.sh
M bin/run-backend-tests.sh
M bin/start-impala-cluster.py
M buildall.sh
M fe/pom.xml
M fe/src/test/resources/hbase-site.xml.template
M fe/src/test/resources/hive-log4j.properties.template
M fe/src/test/resources/mysql-hive-site.xml.template
M fe/src/test/resources/postgresql-hive-site.xml.template
M testdata/bin/create-load-data.sh
M testdata/bin/generate-schema-statements.py
M testdata/bin/minikdc_env.sh
M testdata/bin/run-all.sh
M testdata/bin/run-hbase.sh
M testdata/bin/run-hive-server.sh
M testdata/cluster/admin
M tests/run-custom-cluster-tests.sh
25 files changed, 107 insertions(+), 61 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/56/2456/4
-- 
To view, visit http://gerrit.cloudera.org:8080/2456
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ief1f58f3320ec39d31b3c6bc6ef87f58ff7dfdfa
Gerrit-PatchSet: 4
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Alex Behm <alex.behm@cloudera.com>
Gerrit-Reviewer: Alex Behm <alex.behm@cloudera.com>
Gerrit-Reviewer: Michael Brown <mikeb@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <tarmstrong@cloudera.com>

Mime
View raw message