spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lionel Luffy <lionelu...@gmail.com>
Subject NoSuchMethodError CatalogTable.copy
Date Thu, 24 Aug 2017 13:32:06 GMT
Hi, any one knows how to fix below error?

java.lang.NoSuchMethodError:
org.apache.spark.sql.catalyst.catalog.CatalogTable.copy(Lorg/apache/spark/sql/catalyst/TableIdentifier;Lorg/apache/spark/sql/catalyst/catalog/CatalogTableType;Lorg/apache/spark/sql/catalyst/catalog/CatalogStorageFormat;Lorg/apache/spark/sql/types/StructType;Lscala/Option;Lscala/collection/Seq;Lscala/Option;Ljava/lang/String;JJLscala/collection/immutable/Map;Lscala/Option;Lscala/Option;Lscala/Option;Lscala/Option;Lscala/collection/Seq;Z)Lorg/apache/spark/sql/catalyst/catalog/CatalogTable;

it occurred when execute below code...

catalogTable.copy(storage = newStorage)

the catalyst jar is spark-catalyst_2.11-2.1.0.cloudera1.jar

CatalogTable is a case class:

case class CatalogTable(

    identifier: TableIdentifier,

    tableType: CatalogTableType,

    storage: CatalogStorageFormat,

    schema: StructType,

    provider: Option[String] = None,

    partitionColumnNames: Seq[String] = Seq.empty,

    bucketSpec: Option[BucketSpec] = None,

    owner: String = "",

    createTime: Long = System.currentTimeMillis,

    lastAccessTime: Long = -1,

    properties: Map[String, String] = Map.empty,

    stats: Option[Statistics] = None,

    viewOriginalText: Option[String] = None,

    viewText: Option[String] = None,

    comment: Option[String] = None,

    unsupportedFeatures: Seq[String] = Seq.empty,

    tracksPartitionsInCatalog: Boolean = false,

    schemaPreservesCase: Boolean = true)

Mime
View raw message