spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-26333) FsHistoryProviderSuite failed because setReadable doesn't work in RedHat
Date Tue, 11 Dec 2018 08:28:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-26333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16716539#comment-16716539
] 

ASF GitHub Bot commented on SPARK-26333:
----------------------------------------

deshanxiao opened a new pull request #23282: [SPARK-26333][TEST]FsHistoryProviderSuite failed
because setReadable doesn't work in RedHat
URL: https://github.com/apache/spark/pull/23282
 
 
   ## What changes were proposed in this pull request?
   
   When I run all the tests in RedHat, the FsHistoryProviderSuite failed in case "SPARK-3697:
ignore files that cannot be read.". I try to invoke logFile2.canRead after invoking "setReadable(false,
false)" . And I find that the result of "logFile2.canRead" is true but in my ubuntu16.04 return
false.
   
   The environment´╝Ü
   
   RedHat:
   Linux version 3.10.0-693.2.2.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version
4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Tue Sep 12 22:26:13 UTC 2017
   
   JDK
   Java version: 1.8.0_151, vendor: Oracle Corporation
   
   ERROR:
    org.scalatest.exceptions.TestFailedException: 2 was not equal to 1
         at org.scalatest.MatchersHelper$.indicateFailure(MatchersHelper.scala:340)
         at org.scalatest.Matchers$ShouldMethodHelper$.shouldMatcher(Matchers.scala:6668)
         at org.scalatest.Matchers$AnyShouldWrapper.should(Matchers.scala:6704)
         at org.apache.spark.deploy.history.FsHistoryProviderSuite$$anonfun$12$$anonfun$apply$7.apply(FsHistoryProviderSuite.scala:183)
         at org.apache.spark.deploy.history.FsHistoryProviderSuite$$anonfun$12$$anonfun$apply$7.apply(FsHistoryProviderSuite.scala:182)
         at org.apache.spark.deploy.history.FsHistoryProviderSuite.org$apache$spark$deploy$history$FsHistoryProviderSuite$$updateAndCheck(FsHistoryProviderSuite.scala:841)
         at org.apache.spark.deploy.history.FsHistoryProviderSuite$$anonfun$12.apply(FsHistoryProviderSuite.scala:182)
         at org.apache.spark.deploy.history.FsHistoryProviderSuite$$anonfun$12.apply(FsHistoryProviderSuite.scala:148)
         at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
         at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
         at org.scalatest.Transformer.apply(Transformer.scala:22)
         at org.scalatest.Transformer.apply(Transformer.scala:20)
         at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:186)
         at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:68)
         at org.scalatest.FunSuiteLike$class.invokeWithFixture$1(FunSuiteLike.scala:183)
         at org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:196)
         at org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:196)
         at org.scalatest.SuperEngine.runTestImpl(Engine.scala:289)
         at org.scalatest.FunSuiteLike$class.runTest(FunSuiteLike.scala:196)
         at org.apache.spark.deploy.history.FsHistoryProviderSuite.org$scalatest$BeforeAndAfter$$super$runTest(FsHistoryProviderSuite.scala:51)
         at org.scalatest.BeforeAndAfter$class.runTest(BeforeAndAfter.scala:203)
         at org.apache.spark.deploy.history.FsHistoryProviderSuite.runTest(FsHistoryProviderSuite.scala:51)
         at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:229)
         at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:229)
         at org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:396)
         at org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:384)
         at scala.collection.immutable.List.foreach(List.scala:381)
         at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:384)
   
   ## How was this patch tested?
   
   Unit Test
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> FsHistoryProviderSuite failed because setReadable doesn't work in RedHat
> ------------------------------------------------------------------------
>
>                 Key: SPARK-26333
>                 URL: https://issues.apache.org/jira/browse/SPARK-26333
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.4.0
>            Reporter: deshanxiao
>            Priority: Major
>
> FsHistoryProviderSuite failed in case "SPARK-3697: ignore files that cannot be read.".
I try to invoke logFile2.canRead after invoking "setReadable(false, false)" . And I find that
the result of "logFile2.canRead" is true but in my ubuntu16.04 return false.
> The environment´╝Ü
> RedHat:
> Linux version 3.10.0-693.2.2.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version
4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Tue Sep 12 22:26:13 UTC 2017
> JDK
> Java version: 1.8.0_151, vendor: Oracle Corporation
> {code:java}
>  org.scalatest.exceptions.TestFailedException: 2 was not equal to 1
>       at org.scalatest.MatchersHelper$.indicateFailure(MatchersHelper.scala:340)
>       at org.scalatest.Matchers$ShouldMethodHelper$.shouldMatcher(Matchers.scala:6668)
>       at org.scalatest.Matchers$AnyShouldWrapper.should(Matchers.scala:6704)
>       at org.apache.spark.deploy.history.FsHistoryProviderSuite$$anonfun$12$$anonfun$apply$7.apply(FsHistoryProviderSuite.scala:183)
>       at org.apache.spark.deploy.history.FsHistoryProviderSuite$$anonfun$12$$anonfun$apply$7.apply(FsHistoryProviderSuite.scala:182)
>       at org.apache.spark.deploy.history.FsHistoryProviderSuite.org$apache$spark$deploy$history$FsHistoryProviderSuite$$updateAndCheck(FsHistoryProviderSuite.scala:841)
>       at org.apache.spark.deploy.history.FsHistoryProviderSuite$$anonfun$12.apply(FsHistoryProviderSuite.scala:182)
>       at org.apache.spark.deploy.history.FsHistoryProviderSuite$$anonfun$12.apply(FsHistoryProviderSuite.scala:148)
>       at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
>       at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
>       at org.scalatest.Transformer.apply(Transformer.scala:22)
>       at org.scalatest.Transformer.apply(Transformer.scala:20)
>       at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:186)
>       at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:68)
>       at org.scalatest.FunSuiteLike$class.invokeWithFixture$1(FunSuiteLike.scala:183)
>       at org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:196)
>       at org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:196)
>       at org.scalatest.SuperEngine.runTestImpl(Engine.scala:289)
>       at org.scalatest.FunSuiteLike$class.runTest(FunSuiteLike.scala:196)
>       at org.apache.spark.deploy.history.FsHistoryProviderSuite.org$scalatest$BeforeAndAfter$$super$runTest(FsHistoryProviderSuite.scala:51)
>       at org.scalatest.BeforeAndAfter$class.runTest(BeforeAndAfter.scala:203)
>       at org.apache.spark.deploy.history.FsHistoryProviderSuite.runTest(FsHistoryProviderSuite.scala:51)
>       at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:229)
>       at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:229)
>       at org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:396)
>       at org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:384)
>       at scala.collection.immutable.List.foreach(List.scala:381)
>       at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:384)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message