hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Work logged] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters
Date Tue, 08 Sep 2020 09:12:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-17158?focusedWorklogId=479959&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479959
]

ASF GitHub Bot logged work on HADOOP-17158:
-------------------------------------------

                Author: ASF GitHub Bot
            Created on: 08/Sep/20 09:11
            Start Date: 08/Sep/20 09:11
    Worklog Time Spent: 10m 
      Work Description: steveloughran commented on pull request #2272:
URL: https://github.com/apache/hadoop/pull/2272#issuecomment-688734784


   merged to trunk; if you want it in branch-3.3 do a cherrypick, retest and let me know it
worked


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 479959)
    Time Spent: 1h  (was: 50m)

> Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters
> ---------------------------------------------------------------------
>
>                 Key: HADOOP-17158
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17158
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs/azure
>    Affects Versions: 3.3.0
>            Reporter: Mehakmeet Singh
>            Assignee: Mehakmeet Singh
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> Intermittent test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters happening
due to race conditions in readAhead threads.
> Test error:
> {code:java}
> [ERROR] testReadAheadCounters(org.apache.hadoop.fs.azurebfs.ITestAbfsInputStreamStatistics) 
Time elapsed: 30.723 s  <<< ERROR!org.junit.runners.model.TestTimedOutException:
test timed out after 30000 milliseconds        at java.lang.Thread.sleep(Native Method)       
at org.apache.hadoop.fs.azurebfs.ITestAbfsInputStreamStatistics.testReadAheadCounters(ITestAbfsInputStreamStatistics.java:346)       
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)       
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)       
at java.lang.reflect.Method.invoke(Method.java:498)        at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)       
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)       
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)       
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)       
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)       
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)       
at java.util.concurrent.FutureTask.run(FutureTask.java:266)        at java.lang.Thread.run(Thread.java:748) {code}
> Possible Reasoning:
> - ReadAhead queue doesn't get completed and hence the counter values are not satisfied
in 30 seconds time for some systems.
> - The condition that readAheadBytesRead and remoteBytesRead counter values need to be
greater than or equal to 4KB and 32KB respectively doesn't occur in some machines due to the
fact that sometimes instead of reading for readAhead Buffer, remote reads are performed due
to Threads still being in the readAhead queue to fill that buffer. Thus resulting in either
of the 2 counter values to be not satisfying the condition and getting in an infinite loop
and hence timing out the test eventually.
> Possible Fixes:
> - Write better test(That would pass under all conditions).
> - Maybe UT instead of IT?
> Possible fix to better the test would be preferable and UT as the last resort.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message