spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Fletcher <stephen.fletc...@gmail.com>
Subject attempting to map Dataset[Row]
Date Sun, 26 Feb 2017 12:31:19 GMT
I'm attempting to perform a map on a Dataset[Row] but getting an error on
decode when attempting to pass a custom encoder.
 My code looks similar to the following:


val source =
spark.read.format("parquet").load("/emrdata/sources/very_large_ds")



source.map{ row => {
      val key = row(0)

   }
}

Mime
View raw message