spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-22659) remove sun.misc.Cleaner references
Date Thu, 30 Nov 2017 03:35:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-22659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

liyunzhang updated SPARK-22659:
-------------------------------
    Description: 
build with scala-2.12 with following steps
1. change the pom.xml with scala-2.12
{code}
 ./dev/change-scala-version.sh 2.12
{code}
2.build with -Pscala-2.12
{code}
./dev/make-distribution.sh   --tgz -Pscala-2.12 -Phadoop-2.7  -Pyarn -Pparquet-provided -Dhadoop.version=2.7.3
{code}

get the error
{code}
/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:172: error: cannot find
      symbol
    Cleaner cleaner = Cleaner.create(buffer, () -> freeMemory(memory));
{code}
This is because sun.misc.Cleaner has been moved to new location in JDK9. HADOOP-12760 will
be the long term fix

  was:
the artifactId of common/tags/pom.xml and streaming/pom.xml is spark-tags_2.11 and spark_streaming_2.11
which will causes fail when building with -Pscala-2.12.

Suggest to {{scala.binary.version}} to solve





> remove sun.misc.Cleaner references
> ----------------------------------
>
>                 Key: SPARK-22659
>                 URL: https://issues.apache.org/jira/browse/SPARK-22659
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build
>    Affects Versions: 2.2.0
>            Reporter: liyunzhang
>
> build with scala-2.12 with following steps
> 1. change the pom.xml with scala-2.12
> {code}
>  ./dev/change-scala-version.sh 2.12
> {code}
> 2.build with -Pscala-2.12
> {code}
> ./dev/make-distribution.sh   --tgz -Pscala-2.12 -Phadoop-2.7  -Pyarn -Pparquet-provided
-Dhadoop.version=2.7.3
> {code}
> get the error
> {code}
> /common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:172: error: cannot
find       symbol
>     Cleaner cleaner = Cleaner.create(buffer, () -> freeMemory(memory));
> {code}
> This is because sun.misc.Cleaner has been moved to new location in JDK9. HADOOP-12760
will be the long term fix



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message