kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangxianbin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-3714) com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException: Class is not registered: scala.reflect.ManifestFactory$$anon$2
Date Mon, 10 Dec 2018 08:00:00 GMT
wangxianbin created KYLIN-3714:
----------------------------------

             Summary: com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException:
Class is not registered: scala.reflect.ManifestFactory$$anon$2
                 Key: KYLIN-3714
                 URL: https://issues.apache.org/jira/browse/KYLIN-3714
             Project: Kylin
          Issue Type: Bug
          Components: Job Engine
    Affects Versions: v2.5.1
         Environment: kylin2.5.1
spark2.1.2
            Reporter: wangxianbin
         Attachments: Class is not registered.png

Class is not registered in step "Extract Fact Table Distinct Columns", when use spark as build
engine, error as follow:

com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException: Class is not
registered: scala.reflect.ManifestFactory$$anon$2 Note: To register this class use: kryo.register(scala.reflect.ManifestFactory$$anon$2.class);
Serialization trace: evidence$1 (org.apache.spark.util.collection.CompactBuffer) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:101)
at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:518) at
com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:628) at org.apache.spark.serializer.KryoSerializationStream.writeObject(KryoSerializer.scala:207)
at org.apache.spark.serializer.SerializationStream.writeValue(Serializer.scala:135) at org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:239)
at org.apache.spark.util.collection.ExternalAppendOnlyMap.org$apache$spark$util$collection$ExternalAppendOnlyMap$$spillMemoryIteratorToDisk(ExternalAppendOnlyMap.scala:227)
at org.apache.spark.util.collection.ExternalAppendOnlyMap.spill(ExternalAppendOnlyMap.scala:186)
at org.apache.spark.util.collection.ExternalAppendOnlyMap.spill(ExternalAppendOnlyMap.scala:56)
at org.apache.spark.util.collection.Spillable.maybeSpill(Spillable.scala:97) at org.apache.spark.util.collection.ExternalAppendOnlyMap.insertAll(ExternalAppendOnlyMap.scala:160)
at org.apache.spark.Aggregator.combineValuesByKey(Aggregator.scala:41) at org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:91)
at org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:109) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323) at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:99) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.IllegalArgumentException: Class
is not registered: scala.reflect.ManifestFactory$$anon$2 Note: To register this class use:
kryo.register(scala.reflect.ManifestFactory$$anon$2.class); at com.esotericsoftware.kryo.Kryo.getRegistration(Kryo.java:488)
at com.esotericsoftware.kryo.util.DefaultClassResolver.writeClass(DefaultClassResolver.java:97)
at com.esotericsoftware.kryo.Kryo.writeClass(Kryo.java:517) at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:76)
... 27 more



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message