atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Péter Gergő Barna (JIRA) <j...@apache.org>
Subject [jira] [Commented] (ATLAS-2546) Fix unstable Hive Hook IT tests
Date Mon, 09 Apr 2018 14:22:00 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430589#comment-16430589
] 

Péter Gergő Barna commented on ATLAS-2546:
------------------------------------------

There is an other problem with testCreateTableHiveProcessNameAttribute, the query is invalid,
because there is a semicolon in it.

 
{noformat}
2018-04-09 15:00:11,860 ERROR - [main:] ~ FAILED: ParseException line 1:40 missing EOF at
';' near ')'
org.apache.hadoop.hive.ql.parse.ParseException: line 1:40 missing EOF at ';' near ')'
        at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:213)
        at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:166)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:396)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
        at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
        at org.apache.atlas.hive.HiveITBase.runCommandWithDelay(HiveITBase.java:170)
        at org.apache.atlas.hive.HiveITBase.runCommandWithDelay(HiveITBase.java:164)
        at org.apache.atlas.hive.HiveITBase.runCommand(HiveITBase.java:156)
        at org.apache.atlas.hive.bridge.HiveMetastoreBridgeIT.testCreateTableHiveProcessNameAttribute(HiveMetastoreBridgeIT.java:105)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:85)
        at org.testng.internal.Invoker.invokeMethod(Invoker.java:659)
        at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:845)
        at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1153)
        at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
        at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:108)
        at org.testng.TestRunner.privateRun(TestRunner.java:771)
        at org.testng.TestRunner.run(TestRunner.java:621)
        at org.testng.SuiteRunner.runTest(SuiteRunner.java:357)
        at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:352)
        at org.testng.SuiteRunner.privateRun(SuiteRunner.java:310)
        at org.testng.SuiteRunner.run(SuiteRunner.java:259)
        at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
        at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
        at org.testng.TestNG.runSuitesSequentially(TestNG.java:1199)
        at org.testng.TestNG.runSuitesLocally(TestNG.java:1124)
        at org.testng.TestNG.run(TestNG.java:1032)
        at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:115)
        at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeSingleClass(TestNGDirectoryTestSuite.java:129)
        at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:113)
        at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:111)
        at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
        at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
        at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
(SessionState$LogHelper:960){noformat}

> Fix unstable Hive Hook IT tests
> -------------------------------
>
>                 Key: ATLAS-2546
>                 URL: https://issues.apache.org/jira/browse/ATLAS-2546
>             Project: Atlas
>          Issue Type: Bug
>          Components: atlas-intg
>    Affects Versions: 1.0.0-alpha
>            Reporter: Péter Gergő Barna
>            Assignee: Péter Gergő Barna
>            Priority: Major
>
> Hive hook integration tests fail to initialize hive hook
>  
> Example https://builds.apache.org/blue/rest/organizations/jenkins/pipelines/Atlas-master-IntegrationTests/runs/991/log/?start=0
>  
> {noformat}
> 127.0.0.1 - - [09/Apr/2018:06:51:35 +0000] "GET //localhost:31000/api/atlas/v2/entity/guid/d643540d-dde8-4020-8cd9-2afb999b0afe
HTTP/1.1" 200 2095 "-" "Java/1.8.0_152"
> Tests run: 46, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 482.819 sec <<<
FAILURE! - in TestSuite
> testAlterTablePartitionColumnType(org.apache.atlas.hive.hook.HiveHookIT)  Time elapsed:
80.657 sec  <<< FAILURE!
> java.lang.AssertionError: Assertions failed. Failing after waiting for timeout 80000
msecs
> 	at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:388)
> 	at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:323)
> 	at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:228)
> 	at org.apache.atlas.AtlasClientV2.getEntityByAttribute(AtlasClientV2.java:264)
> 	at org.apache.atlas.hive.HiveITBase$1.evaluate(HiveITBase.java:209)
> 	at org.apache.atlas.hive.HiveITBase.waitFor(HiveITBase.java:266)
> 	at org.apache.atlas.hive.HiveITBase.assertEntityIsRegistered(HiveITBase.java:206)
> 	at org.apache.atlas.hive.hook.HiveHookIT.assertColumnIsRegistered(HiveHookIT.java:288)
> 	at org.apache.atlas.hive.hook.HiveHookIT.testAlterTablePartitionColumnType(HiveHookIT.java:1309)
> testAlterTableRename(org.apache.atlas.hive.hook.HiveHookIT)  Time elapsed: 14.214 sec
 <<< FAILURE!
> java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:657)
> 	at java.util.ArrayList.get(ArrayList.java:433)
> 	at org.apache.atlas.hive.hook.HiveHookIT.assertTrait(HiveHookIT.java:1018)
> 	at org.apache.atlas.hive.hook.HiveHookIT.testAlterTableRename(HiveHookIT.java:970)
> testCreateTableHiveProcessNameAttribute(org.apache.atlas.hive.bridge.HiveMetastoreBridgeIT)
 Time elapsed: 0.011 sec  <<< FAILURE!
> java.lang.AssertionError: expected [0] but found [40000]
> 	at org.testng.Assert.fail(Assert.java:94)
> 	at org.testng.Assert.failNotEquals(Assert.java:496)
> 	at org.testng.Assert.assertEquals(Assert.java:125)
> 	at org.testng.Assert.assertEquals(Assert.java:372)
> 	at org.testng.Assert.assertEquals(Assert.java:382)
> 	at org.apache.atlas.hive.HiveITBase.runCommandWithDelay(HiveITBase.java:154)
> 	at org.apache.atlas.hive.HiveITBase.runCommandWithDelay(HiveITBase.java:147)
> 	at org.apache.atlas.hive.HiveITBase.runCommand(HiveITBase.java:139)
> 	at org.apache.atlas.hive.bridge.HiveMetastoreBridgeIT.testCreateTableHiveProcessNameAttribute(HiveMetastoreBridgeIT.java:105)
> Results :
> Failed tests: 
>   HiveMetastoreBridgeIT.testCreateTableHiveProcessNameAttribute:105->HiveITBase.runCommand:139->HiveITBase.runCommandWithDelay:147->HiveITBase.runCommandWithDelay:154
expected [0] but found [40000]
>   HiveHookIT.testAlterTablePartitionColumnType:1309->assertColumnIsRegistered:288->HiveITBase.assertEntityIsRegistered:206->HiveITBase.waitFor:270
Assertions failed. Failing after waiting for timeout 80000 msecs
>   HiveHookIT.testAlterTableRename:970->assertTrait:1018 » IndexOutOfBounds Index...
> Tests run: 46, Failures: 3, Errors: 0, Skipped: 0
> [INFO] 
> [INFO] --- jetty-maven-plugin:9.3.14.v20161028:stop (stop-jetty) @ hive-bridge ---
> [INFO] Waiting 10 seconds for jetty to stop
> [INFO] Stopped ServerConnector@7ac4e393{HTTP/1.1,[http/1.1]}{0.0.0.0:31000}
> [INFO] Closing Spring root WebApplicationContext
> [INFO] Shutting down log4j
> [INFO] Stopped o.e.j.m.p.JettyWebAppContext@67820486{/,file:///home/jenkins/jenkins-slave/workspace/Atlas-master-IntegrationTests/webapp/target/atlas-webapp-1.0.0-SNAPSHOT/,UNAVAILABLE}{/home/jenkins/jenkins-slave/workspace/Atlas-master-IntegrationTests/webapp/target/atlas-webapp-1.0.0-SNAPSHOT.war}
> [INFO] Server reports itself as stopped
> [INFO] 
> [INFO] --- maven-source-plugin:2.4:jar-no-fork (attach-sources) @ hive-bridge ---
> [INFO] Building jar: /home/jenkins/jenkins-slave/workspace/Atlas-master-IntegrationTests/addons/hive-bridge/target/hive-bridge-1.0.0-SNAPSHOT-sources.jar
> [INFO] 
> [INFO] --- maven-source-plugin:2.4:test-jar-no-fork (attach-sources) @ hive-bridge ---
> [INFO] Building jar: /home/jenkins/jenkins-slave/workspace/Atlas-master-IntegrationTests/addons/hive-bridge/target/hive-bridge-1.0.0-SNAPSHOT-test-sources.jar
> [INFO] 
> [INFO] --- maven-failsafe-plugin:2.18.1:verify (verify) @ hive-bridge ---
> [INFO] Failsafe report directory: /home/jenkins/jenkins-slave/workspace/Atlas-master-IntegrationTests/addons/hive-bridge/target/failsafe-reports
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Apache Atlas Server Build Tools .................... SUCCESS [  0.554 s]
> [INFO] apache-atlas ....................................... SUCCESS [  3.461 s]
> [INFO] Apache Atlas Test Utility Tools .................... SUCCESS [  9.079 s]
> [INFO] Open Connector Framework (OCF) ..................... SUCCESS [  9.521 s]
> [INFO] Open Metadata Repository Services (OMRS) ........... SUCCESS [ 27.106 s]
> [INFO] Open Metadata and Governance (OMAG) Server APIs .... SUCCESS [  6.642 s]
> [INFO] Apache Atlas Integration ........................... SUCCESS [ 16.805 s]
> [INFO] Apache Atlas Common ................................ SUCCESS [  7.382 s]
> [INFO] Apache Atlas Client ................................ SUCCESS [  0.469 s]
> [INFO] atlas-client-common ................................ SUCCESS [  6.134 s]
> [INFO] atlas-client-v1 .................................... SUCCESS [  6.030 s]
> [INFO] Apache Atlas Server API ............................ SUCCESS [  5.028 s]
> [INFO] Apache Atlas Notification .......................... SUCCESS [  7.925 s]
> [INFO] atlas-client-v2 .................................... SUCCESS [  5.368 s]
> [INFO] Apache Atlas Graph Database Projects ............... SUCCESS [  0.382 s]
> [INFO] Apache Atlas Graph Database API .................... SUCCESS [  4.684 s]
> [INFO] Graph Database Common Code ......................... SUCCESS [  4.646 s]
> [INFO] Apache Atlas JanusGraph DB Impl .................... SUCCESS [ 12.590 s]
> [INFO] Apache Atlas Graph Database Implementation Dependencies SUCCESS [  2.340 s]
> [INFO] Shaded version of Apache hbase client .............. SUCCESS [  7.393 s]
> [INFO] Apache Atlas Titan 0.5.4 Graph DB Impl ............. SUCCESS [ 35.954 s]
> [INFO] Shaded version of Apache hbase server .............. SUCCESS [ 19.671 s]
> [INFO] Apache Atlas Authorization ......................... SUCCESS [  6.114 s]
> [INFO] Apache Atlas Repository ............................ SUCCESS [ 27.243 s]
> [INFO] Apache Atlas UI .................................... SUCCESS [01:07 min]
> [INFO] Apache Atlas Web Application ....................... SUCCESS [04:18 min]
> [INFO] Apache Atlas Documentation ......................... SUCCESS [  2.968 s]
> [INFO] Apache Atlas FileSystem Model ...................... SUCCESS [  2.476 s]
> [INFO] Apache Atlas Plugin Classloader .................... SUCCESS [  5.783 s]
> [INFO] Apache Atlas Hive Bridge Shim ...................... SUCCESS [  4.345 s]
> [INFO] Apache Atlas Hive Bridge ........................... FAILURE [08:53 min]
> [INFO] Apache Atlas Falcon Bridge Shim .................... SKIPPED
> [INFO] Apache Atlas Falcon Bridge ......................... SKIPPED
> [INFO] Apache Atlas Sqoop Bridge Shim ..................... SKIPPED
> [INFO] Apache Atlas Sqoop Bridge .......................... SKIPPED
> [INFO] Apache Atlas Storm Bridge Shim ..................... SKIPPED
> [INFO] Apache Atlas Storm Bridge .......................... SKIPPED
> [INFO] Apache Atlas Hbase Bridge Shim ..................... SKIPPED
> [INFO] Apache Atlas Hbase Bridge .......................... SKIPPED
> [INFO] Apache Atlas Migration Exporter .................... SKIPPED
> [INFO] Apache Atlas Distribution .......................... SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------{noformat}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message