spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mengxr <...@git.apache.org>
Subject [GitHub] spark pull request: SPARK-1539: RDDPage.scala contains RddPage cla...
Date Sat, 19 Apr 2014 18:44:01 GMT
GitHub user mengxr opened a pull request:

    https://github.com/apache/spark/pull/454

    SPARK-1539: RDDPage.scala contains RddPage class

    SPARK-1386 changed RDDPage to RddPage but didn't change the filename. I tried sbt/sbt
publish-local. Inside the spark-core jar, the unit name is RDDPage.class and hence I got the
following error:
    
    ~~~
    [error] (run-main) java.lang.NoClassDefFoundError: org/apache/spark/ui/storage/RddPage
    java.lang.NoClassDefFoundError: org/apache/spark/ui/storage/RddPage
    	at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:59)
    	at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:52)
    	at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:42)
    	at org.apache.spark.SparkContext.<init>(SparkContext.scala:215)
    	at MovieLensALS$.main(MovieLensALS.scala:38)
    	at MovieLensALS.main(MovieLensALS.scala)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:606)
    Caused by: java.lang.ClassNotFoundException: org.apache.spark.ui.storage.RddPage
    	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    	at java.security.AccessController.doPrivileged(Native Method)
    	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    	at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:59)
    	at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:52)
    	at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:42)
    	at org.apache.spark.SparkContext.<init>(SparkContext.scala:215)
    	at MovieLensALS$.main(MovieLensALS.scala:38)
    	at MovieLensALS.main(MovieLensALS.scala)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:606)
    ~~~
    
    This can be fixed after renaming RddPage to RDDPage, or renaming RDDPage.scala to RddPage.scala.
I chose the former since the name `RDD` is common in Spark code. 

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mengxr/spark rddpage-fix

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/454.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #454
    
----
commit f75e5446b03de84d9322ff7a152b292507b88acc
Author: Xiangrui Meng <meng@databricks.com>
Date:   2014-04-19T18:41:32Z

    rename RddPage to RDDPage

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message