hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Saxena (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-6874) Supplement timestamp for min start/max end time columns in flow run table to avoid overwrite
Date Thu, 10 Aug 2017 09:11:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Varun Saxena updated YARN-6874:
-------------------------------
    Description: 
Following test case is failing in YARN-5355 branch.
This is coming because we are not supplementing the timestamp for FlowRunColumn i.e. min_start_time
and max_end_time columns, post YARN-6850 which can lead to a clash, if 2 writes for app created
events happen at the same time, which is true for this test case.
To fix this, we need to pass true flag into ColumnHelper constructor. I did encounter this
failure once earlier too.

{noformat}
testWriteFlowRunMinMax(org.apache.hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun)
 Time elapsed: 0.088 sec  <<< FAILURE!
java.lang.AssertionError: expected:<1425026900000> but was:<1425026901000>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.junit.Assert.assertEquals(Assert.java:542)
	at org.apache.hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun.testWriteFlowRunMinMax(TestHBaseStorageFlowRun.java:237)
{noformat}

  was:
{noformat}
testWriteFlowRunMinMax(org.apache.hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun)
 Time elapsed: 0.088 sec  <<< FAILURE!
java.lang.AssertionError: expected:<1425026900000> but was:<1425026901000>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.junit.Assert.assertEquals(Assert.java:542)
	at org.apache.hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun.testWriteFlowRunMinMax(TestHBaseStorageFlowRun.java:237)
{noformat}


> Supplement timestamp for min start/max end time columns in flow run table to avoid overwrite
> --------------------------------------------------------------------------------------------
>
>                 Key: YARN-6874
>                 URL: https://issues.apache.org/jira/browse/YARN-6874
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Varun Saxena
>            Assignee: Vrushali C
>             Fix For: YARN-5355, YARN-5355-branch-2
>
>         Attachments: YARN-6874-YARN-5355.0001.patch
>
>
> Following test case is failing in YARN-5355 branch.
> This is coming because we are not supplementing the timestamp for FlowRunColumn i.e.
min_start_time and max_end_time columns, post YARN-6850 which can lead to a clash, if 2 writes
for app created events happen at the same time, which is true for this test case.
> To fix this, we need to pass true flag into ColumnHelper constructor. I did encounter
this failure once earlier too.
> {noformat}
> testWriteFlowRunMinMax(org.apache.hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun)
 Time elapsed: 0.088 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<1425026900000> but was:<1425026901000>
> 	at org.junit.Assert.fail(Assert.java:88)
> 	at org.junit.Assert.failNotEquals(Assert.java:743)
> 	at org.junit.Assert.assertEquals(Assert.java:118)
> 	at org.junit.Assert.assertEquals(Assert.java:555)
> 	at org.junit.Assert.assertEquals(Assert.java:542)
> 	at org.apache.hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun.testWriteFlowRunMinMax(TestHBaseStorageFlowRun.java:237)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message