falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srikanth Sundarrajan (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (FALCON-991) consolidate get coord actions in OozieWorkflowEngine
Date Tue, 07 Jul 2015 05:54:05 GMT

     [ https://issues.apache.org/jira/browse/FALCON-991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Srikanth Sundarrajan reopened FALCON-991:
-----------------------------------------

Reverting the commit. Build is broken. See FALCON-1307 for more details

{noformat}
Running org.apache.falcon.cli.FalconCLIIT
Tests run: 27, Failures: 5, Errors: 0, Skipped: 0, Time elapsed: 70.271 sec <<< FAILURE!
- in org.apache.falcon.cli.FalconCLIIT
testContinue(org.apache.falcon.cli.FalconCLIIT)  Time elapsed: 4.411 sec  <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<-1>
	at org.testng.Assert.fail(Assert.java:89)
	at org.testng.Assert.failNotEquals(Assert.java:489)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at org.testng.Assert.assertEquals(Assert.java:365)
	at org.testng.Assert.assertEquals(Assert.java:375)
	at org.apache.falcon.cli.FalconCLIIT.testContinue(FalconCLIIT.java:684)

testInstanceGetLogs(org.apache.falcon.cli.FalconCLIIT)  Time elapsed: 3.512 sec  <<<
FAILURE!
java.lang.AssertionError: expected:<0> but was:<-1>
	at org.testng.Assert.fail(Assert.java:89)
	at org.testng.Assert.failNotEquals(Assert.java:489)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at org.testng.Assert.assertEquals(Assert.java:365)
	at org.testng.Assert.assertEquals(Assert.java:375)
	at org.apache.falcon.cli.FalconCLIIT.testInstanceGetLogs(FalconCLIIT.java:772)

testInstanceRunningAndStatusCommands(org.apache.falcon.cli.FalconCLIIT)  Time elapsed: 3.546
sec  <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<-1>
	at org.testng.Assert.fail(Assert.java:89)
	at org.testng.Assert.failNotEquals(Assert.java:489)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at org.testng.Assert.assertEquals(Assert.java:365)
	at org.testng.Assert.assertEquals(Assert.java:375)
	at org.apache.falcon.cli.FalconCLIIT.testInstanceRunningAndStatusCommands(FalconCLIIT.java:308)

testInstanceRunningAndSummaryCommands(org.apache.falcon.cli.FalconCLIIT)  Time elapsed: 2.919
sec  <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<-1>
	at org.testng.Assert.fail(Assert.java:89)
	at org.testng.Assert.failNotEquals(Assert.java:489)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at org.testng.Assert.assertEquals(Assert.java:365)
	at org.testng.Assert.assertEquals(Assert.java:375)
	at org.apache.falcon.cli.FalconCLIIT.testInstanceRunningAndSummaryCommands(FalconCLIIT.java:429)

testSuspendResumeStatusEntityValidCommands(org.apache.falcon.cli.FalconCLIIT)  Time elapsed:
5.201 sec  <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<-1>
	at org.testng.Assert.fail(Assert.java:89)
	at org.testng.Assert.failNotEquals(Assert.java:489)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at org.testng.Assert.assertEquals(Assert.java:365)
	at org.testng.Assert.assertEquals(Assert.java:375)
	at org.apache.falcon.cli.FalconCLIIT.testSuspendResumeStatusEntityValidCommands(FalconCLIIT.java:224)

Running org.apache.falcon.cli.FalconCLISmokeIT
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.488 sec - in org.apache.falcon.cli.FalconCLISmokeIT
Running org.apache.falcon.late.LateDataHandlerIT
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.86 sec - in org.apache.falcon.late.LateDataHandlerIT
Running org.apache.falcon.lifecycle.FileSystemFeedReplicationIT
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.515 sec - in org.apache.falcon.lifecycle.FileSystemFeedReplicationIT
Running org.apache.falcon.lifecycle.TableStorageFeedEvictorIT
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.195 sec - in org.apache.falcon.lifecycle.TableStorageFeedEvictorIT
Running org.apache.falcon.lifecycle.TableStorageFeedReplicationIT
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.833 sec - in org.apache.falcon.lifecycle.TableStorageFeedReplicationIT
Running org.apache.falcon.process.PigProcessIT
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.5 sec - in org.apache.falcon.process.PigProcessIT
Running org.apache.falcon.process.TableStorageProcessIT
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.458 sec - in org.apache.falcon.process.TableStorageProcessIT
Running org.apache.falcon.resource.EntityManagerJerseyIT
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.569 sec - in org.apache.falcon.resource.EntityManagerJerseyIT
Running org.apache.falcon.resource.EntityManagerJerseySmokeIT
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.138 sec - in org.apache.falcon.resource.EntityManagerJerseySmokeIT
Running org.apache.falcon.resource.EntityManagerPaginationJerseyIT
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 12.966 sec <<< FAILURE!
- in org.apache.falcon.resource.EntityManagerPaginationJerseyIT
testPaginationEntitySummary(org.apache.falcon.resource.EntityManagerPaginationJerseyIT)  Time
elapsed: 2.272 sec  <<< FAILURE!
java.lang.AssertionError: expected:<200> but was:<400>
	at org.testng.Assert.fail(Assert.java:89)
	at org.testng.Assert.failNotEquals(Assert.java:489)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at org.testng.Assert.assertEquals(Assert.java:365)
	at org.testng.Assert.assertEquals(Assert.java:375)
	at org.apache.falcon.resource.EntityManagerPaginationJerseyIT.testPaginationEntitySummary(EntityManagerPaginationJerseyIT.java:148)
{noformat}

> consolidate get coord actions in OozieWorkflowEngine
> ----------------------------------------------------
>
>                 Key: FALCON-991
>                 URL: https://issues.apache.org/jira/browse/FALCON-991
>             Project: Falcon
>          Issue Type: Improvement
>            Reporter: Shwetha G S
>            Assignee: Ajay Yadava
>             Fix For: 0.7
>
>         Attachments: FALCON-991-v1.patch, FALCON-991-v2.patch, FALCON-991-v3.patch, FALCON-991.patch
>
>
> OozieWorkflowEngine.getCoordActions() gets instances by calling oozieclient.getCoordAction()
for each action. Its not efficient to call oozie API for each instance. Instead, doSummaryJobAction()
gets all instances in bulk using oozieclient.getCoordJobInfo(). But this uses offset which
won't work with purging of coord actions. A new API was added in oozie to get coord actions
between timestamps. We should use that for both usecases



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message