spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <>
Subject [GitHub] [spark] sarutak commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome
Date Tue, 22 Sep 2020 11:22:58 GMT

sarutak commented on a change in pull request #29827:

File path: .github/workflows/build_and_test.yml
@@ -273,6 +273,44 @@ jobs:
         cd docs
         jekyll build
+  webui-tests-with-chrome:
+    name: WebUI tests with chrome
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout Spark repository
+      uses: actions/checkout@v2
+    - name: Cache Maven local repository
+      uses: actions/cache@v2
+      with:
+        path: ~/.m2/repository
+        key: webui-tests-with-chrome-maven-${{ hashFiles('**/pom.xml') }}
+        restore-keys: |
+          webui-tests-with-chrome-maven-
+    - name: Install Java 11
+      uses: actions/setup-java@v1
+      with:
+        java-version: 11
+    - name: Install Chrome and ChromeDriver
+      run: |
+        sudo apt update
+        sudo apt install google-chrome-stable
+        sudo apt install chromium-chromedriver
+    - name: Run WebUI tests with Maven
+      run: |

Review comment:
       @HyukjinKwon I've tried including `ChromeUITest` tag in `core` on my repository but
as I expected, tests failed due to the Guava version compatibility.
   [info] org.apache.spark.deploy.history.ChromeUIHistoryServerSuite *** ABORTED *** (7 milliseconds)
   [info]   java.lang.NoSuchMethodError:;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V
   [info]   at org.openqa.selenium.remote.service.DriverService.findExecutable(
   [info]   at$000(
   [info]   at$Builder.findDefaultExecutable(
   [info]   at org.openqa.selenium.remote.service.DriverService$
   [info]   at
   [info]   at<init>(
   [info]   at org.apache.spark.deploy.history.ChromeUIHistoryServerSuite.beforeAll(ChromeUIHistoryServerSuite.scala:38)
   [info]   at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:212)
   [info]   at
   [info]   at$(BeforeAndAfterAll.scala:208)
   [info]   at
   [info]   at$scalatest$tools$Framework$$runSuite(Framework.scala:318)
   [info]   at$ScalaTestTask.execute(Framework.scala:513)
   [info]   at sbt.ForkMain$Run$
   [info]   at sbt.ForkMain$Run$
   [info]   at
   [info]   at java.util.concurrent.ThreadPoolExecutor.runWorker(
   [info]   at java.util.concurrent.ThreadPoolExecutor$
   [info]   at
   [error] Uncaught exception when running org.apache.spark.deploy.history.ChromeUIHistoryServerSuite:
   sbt.ForkMain$ForkError: java.lang.NoSuchMethodError:;Ljava/lang/Object;Ljava/lang/Object;Ljava/lang/Object;)V
   	at org.openqa.selenium.remote.service.DriverService.findExecutable(
   So, we need to specify `25.0-jre` only for tests tagged with `ChromeUITest`. Or, revert
SPARK-31765 as I mentioned [here](

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message