impala-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexander Behm (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (IMPALA-4845) TestDdlStatements.test_drop_cleans_hdfs_dirs fails with NoSuchObjectException: test_drop_cleans_hdfs_dirs_fdfd4f8
Date Mon, 01 May 2017 21:52:04 GMT

     [ https://issues.apache.org/jira/browse/IMPALA-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Alexander Behm resolved IMPALA-4845.
------------------------------------
    Resolution: Duplicate

Duplicates IMPALA-5177

> TestDdlStatements.test_drop_cleans_hdfs_dirs fails with NoSuchObjectException: test_drop_cleans_hdfs_dirs_fdfd4f8
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: IMPALA-4845
>                 URL: https://issues.apache.org/jira/browse/IMPALA-4845
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>    Affects Versions: Impala 2.9.0
>            Reporter: Lars Volker
>            Priority: Critical
>              Labels: broken-build, flaky
>
> {{TestDdlStatements.test_drop_cleans_hdfs_dirs}} fails and prints two errors. Since one
looks like it fails to create the database while the other one looks like it fails to drop
it, I suspect this could be a hidden race around DDL statement synchronization.
> [~dtsirogiannis] - I’m assigning this to you thinking you might have an idea what’s
going on here; feel free to find another person or assign back to me if you're swamped.
> {noformat}
> 03:37:25.073 ==================================== ERRORS ====================================
> 03:37:25.074 ______ ERROR at teardown of TestDdlStatements.test_drop_cleans_hdfs_dirs
_______
> 03:37:25.075 [gw1] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
> 03:37:25.075 conftest.py:274: in cleanup
> 03:37:25.075     {'sync_ddl': sync_ddl})
> 03:37:25.076 common/impala_test_suite.py:440: in wrapper
> 03:37:25.076     return function(*args, **kwargs)
> 03:37:25.076 common/impala_test_suite.py:447: in execute_query_expect_success
> 03:37:25.076     result = cls.__execute_query(impalad_client, query, query_options)
> 03:37:25.076 common/impala_test_suite.py:532: in __execute_query
> 03:37:25.077     return impalad_client.execute(query, user=user)
> 03:37:25.077 common/impala_connection.py:160: in execute
> 03:37:25.077     return self.__beeswax_client.execute(sql_stmt, user=user)
> 03:37:25.077 beeswax/impala_beeswax.py:173: in execute
> 03:37:25.077     handle = self.__execute_query(query_string.strip(), user=user)
> 03:37:25.078 beeswax/impala_beeswax.py:337: in __execute_query
> 03:37:25.078     handle = self.execute_query_async(query_string, user=user)
> 03:37:25.078 beeswax/impala_beeswax.py:333: in execute_query_async
> 03:37:25.078     return self.__do_rpc(lambda: self.imp_service.query(query,))
> 03:37:25.079 beeswax/impala_beeswax.py:458: in __do_rpc
> 03:37:25.079     raise ImpalaBeeswaxException(self.__build_error_message(b), b)
> 03:37:25.079 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
> 03:37:25.079 E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> 03:37:25.080 E    MESSAGE: 
> 03:37:25.080 E   ImpalaRuntimeException: Error making 'dropDatabase' RPC to Hive Metastore:

> 03:37:25.080 E   CAUSED BY: NoSuchObjectException: test_drop_cleans_hdfs_dirs_fdfd4f8
> 03:37:25.081 ---------------------------- Captured stderr setup -----------------------------
> 03:37:25.081 SET sync_ddl=False;
> 03:37:25.081 -- executing against localhost:21000
> 03:37:25.081 DROP DATABASE IF EXISTS `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;
> 03:37:25.081 
> 03:37:25.081 SET sync_ddl=False;
> 03:37:25.082 -- executing against localhost:21000
> 03:37:25.082 CREATE DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8`;
> 03:37:25.082 
> 03:37:25.082 MainThread: Created database "test_drop_cleans_hdfs_dirs_fdfd4f8" for test
ID "metadata/test_ddl.py::TestDdlStatements::()::test_drop_cleans_hdfs_dirs"
> 03:37:25.083 ----------------------------- Captured stderr call -----------------------------
> 03:37:25.083 -- executing against localhost:21000
> 03:37:25.083 use default;
> 03:37:25.083 
> 03:37:25.083 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.084 -- executing against localhost:21000
> 03:37:25.084 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
> 03:37:25.084 
> 03:37:25.084 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.084 -- executing against localhost:21000
> 03:37:25.084 drop table test_drop_cleans_hdfs_dirs_fdfd4f8.t1;
> 03:37:25.084 
> 03:37:25.084 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.085 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.085 -- executing against localhost:21000
> 03:37:25.085 drop database test_drop_cleans_hdfs_dirs_fdfd4f8;
> 03:37:25.085 
> 03:37:25.085 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.085 -- connecting to: localhost:21000
> 03:37:25.085 -- executing against localhost:21000
> 03:37:25.086 create database test_drop_cleans_hdfs_dirs_fdfd4f8 location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8.db';
> 03:37:25.086 
> 03:37:25.086 -- closing connection to: localhost:21000
> 03:37:25.086 -- executing against localhost:21000
> 03:37:25.086 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
> 03:37:25.086 
> 03:37:25.086 -- executing against localhost:21000
> 03:37:25.086 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t2(i int);
> 03:37:25.087 
> 03:37:25.087 -- executing against localhost:21000
> 03:37:25.087 create external table test_drop_cleans_hdfs_dirs_fdfd4f8.t3(i int) location
'/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8/t3/';
> 03:37:25.087 
> 03:37:25.087 -- executing against localhost:21000
> 03:37:25.087 drop database test_drop_cleans_hdfs_dirs_fdfd4f8 cascade;
> 03:37:25.088 
> 03:37:25.088 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.088 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.088 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.088 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.089 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.089 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.089 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.089 -- connecting to: localhost:21000
> 03:37:25.089 -- executing against localhost:21000
> 03:37:25.090 create database test_drop_cleans_hdfs_dirs_fdfd4f8 location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8.db';
> 03:37:25.090 
> 03:37:25.091 --------------------------- Captured stderr teardown ---------------------------
> 03:37:25.091 -- executing against localhost:21000
> 03:37:25.091 use default;
> 03:37:25.092 
> 03:37:25.092 SET sync_ddl=False;
> 03:37:25.092 -- executing against localhost:21000
> 03:37:25.092 DROP DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;
> 03:37:25.092 
> 03:37:25.093 =================================== FAILURES ===================================
> 03:37:25.093 _________________ TestDdlStatements.test_drop_cleans_hdfs_dirs _________________
> 03:37:25.094 [gw1] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
> 03:37:25.095 metadata/test_ddl.py:130: in test_drop_cleans_hdfs_dirs
> 03:37:25.095     self._create_db(unique_database)
> 03:37:25.095 metadata/test_ddl_base.py:64: in _create_db
> 03:37:25.095     impala_client.execute(ddl)
> 03:37:25.095 common/impala_connection.py:160: in execute
> 03:37:25.096     return self.__beeswax_client.execute(sql_stmt, user=user)
> 03:37:25.096 beeswax/impala_beeswax.py:173: in execute
> 03:37:25.096     handle = self.__execute_query(query_string.strip(), user=user)
> 03:37:25.096 beeswax/impala_beeswax.py:337: in __execute_query
> 03:37:25.096     handle = self.execute_query_async(query_string, user=user)
> 03:37:25.097 beeswax/impala_beeswax.py:333: in execute_query_async
> 03:37:25.097     return self.__do_rpc(lambda: self.imp_service.query(query,))
> 03:37:25.097 beeswax/impala_beeswax.py:458: in __do_rpc
> 03:37:25.097     raise ImpalaBeeswaxException(self.__build_error_message(b), b)
> 03:37:25.097 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
> 03:37:25.098 E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> 03:37:25.098 E    MESSAGE: AnalysisException: Database already exists: test_drop_cleans_hdfs_dirs_fdfd4f8
> 03:37:25.099 ---------------------------- Captured stderr setup -----------------------------
> 03:37:25.099 SET sync_ddl=False;
> 03:37:25.099 -- executing against localhost:21000
> 03:37:25.099 DROP DATABASE IF EXISTS `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;
> 03:37:25.099 
> 03:37:25.099 SET sync_ddl=False;
> 03:37:25.099 -- executing against localhost:21000
> 03:37:25.100 CREATE DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8`;
> 03:37:25.100 
> 03:37:25.100 MainThread: Created database "test_drop_cleans_hdfs_dirs_fdfd4f8" for test
ID "metadata/test_ddl.py::TestDdlStatements::()::test_drop_cleans_hdfs_dirs"
> 03:37:25.101 ----------------------------- Captured stderr call -----------------------------
> 03:37:25.101 -- executing against localhost:21000
> 03:37:25.101 use default;
> 03:37:25.101 
> 03:37:25.101 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.101 -- executing against localhost:21000
> 03:37:25.102 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
> 03:37:25.102 
> 03:37:25.102 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.102 -- executing against localhost:21000
> 03:37:25.102 drop table test_drop_cleans_hdfs_dirs_fdfd4f8.t1;
> 03:37:25.102 
> 03:37:25.102 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.102 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.102 -- executing against localhost:21000
> 03:37:25.103 drop database test_drop_cleans_hdfs_dirs_fdfd4f8;
> 03:37:25.103 
> 03:37:25.103 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.103 -- connecting to: localhost:21000
> 03:37:25.103 -- executing against localhost:21000
> 03:37:25.103 create database test_drop_cleans_hdfs_dirs_fdfd4f8 location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8.db';
> 03:37:25.103 
> 03:37:25.103 -- closing connection to: localhost:21000
> 03:37:25.103 -- executing against localhost:21000
> 03:37:25.104 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
> 03:37:25.104 
> 03:37:25.104 -- executing against localhost:21000
> 03:37:25.104 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t2(i int);
> 03:37:25.104 
> 03:37:25.104 -- executing against localhost:21000
> 03:37:25.104 create external table test_drop_cleans_hdfs_dirs_fdfd4f8.t3(i int) location
'/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8/t3/';
> 03:37:25.104 
> 03:37:25.104 -- executing against localhost:21000
> 03:37:25.105 drop database test_drop_cleans_hdfs_dirs_fdfd4f8 cascade;
> 03:37:25.105 
> 03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.106 MainThread: Starting new HTTP connection (1): 0.0.0.0
> 03:37:25.106 -- connecting to: localhost:21000
> 03:37:25.106 -- executing against localhost:21000
> 03:37:25.106 create database test_drop_cleans_hdfs_dirs_fdfd4f8 location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8.db';
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message