spark-user mailing list archives: March 2019

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
yuvraj singh error in sprark sql Fri, 01 Mar, 07:36
Nuno Silva [Spark SQL]: sql.DataFrame.replace to accept regexp Fri, 01 Mar, 10:21
Andrey Dudin spark.python.worker.memory VS spark.executor.pyspark.memory Fri, 01 Mar, 13:24
oskarryn Spark Streaming loading kafka source value column type Fri, 01 Mar, 13:38
Richard Garris Re: [Spark SQL]: sql.DataFrame.replace to accept regexp Fri, 01 Mar, 14:39
Gabor Somogyi Re: to_avro and from_avro not working with struct type in spark 2.4 Fri, 01 Mar, 14:54
Kristopher Kane Spark 2.4 Structured Streaming Kafka assign API polling same offsets Fri, 01 Mar, 15:10
Kristopher Kane Re: Spark 2.4 Structured Streaming Kafka assign API polling same offsets Fri, 01 Mar, 16:35
kant kodali Is there a way to validate the syntax of raw spark sql query? Fri, 01 Mar, 16:44
Matt Cheah Re: Spark on k8s - map persistentStorage for data spilling Fri, 01 Mar, 19:30
Tomasz Krol Re: Spark on k8s - map persistentStorage for data spilling Fri, 01 Mar, 19:56
Gourav Sengupta Re: [Spark SQL]: sql.DataFrame.replace to accept regexp Fri, 01 Mar, 20:38
Tomasz Krol Re: Spark on k8s - map persistentStorage for data spilling Fri, 01 Mar, 20:44
Gourav Sengupta SPARK Streaming Graphs Fri, 01 Mar, 20:47
Xiao Li Re: spark.python.worker.memory VS spark.executor.pyspark.memory Fri, 01 Mar, 21:19
swastik mittal updateBytesRead() Sat, 02 Mar, 04:30
swastik mittal Milliseconds in timestamp Sat, 02 Mar, 18:53
Andrey Dudin disable spark disk cache Sun, 03 Mar, 21:46
Hien Luu Re: disable spark disk cache Mon, 04 Mar, 00:25
Bruno Faria Shuffle service with more than one executor Mon, 04 Mar, 02:51
mayangyang02 Spark SQL doesn't produce output while hive does Mon, 04 Mar, 06:18
JF Chen spark df.write.partitionBy run very slow Mon, 04 Mar, 10:02
Jürgen Thomann Timeout between driver and application master (Thrift Server) Mon, 04 Mar, 12:49
Nicolas Paris Connect to hive 3 from spark Mon, 04 Mar, 13:58
Chunpeng Wang Re: Spark SQL doesn't produce output while hive does Mon, 04 Mar, 14:34
Patrik Medvedev Re: Spark SQL doesn't produce output while hive does Mon, 04 Mar, 14:49
Yeikel Difference between One map vs multiple maps Tue, 05 Mar, 03:13
Huon.Wil...@data61.csiro.au [SQL] 64-bit hash function, and seeding Tue, 05 Mar, 04:30
Qian He subscribe Tue, 05 Mar, 05:48
Shyam P Re: spark df.write.partitionBy run very slow Tue, 05 Mar, 07:05
Shyam P Re: error in sprark sql Tue, 05 Mar, 07:07
Akhilanand Join selection Tue, 05 Mar, 07:20
Shyam P [No Subject] Tue, 05 Mar, 07:54
Nuthan Reddy How to add more imports at the start of REPL Tue, 05 Mar, 11:14
Mkal C++ script on Spark Cluster throws exit status 132 Tue, 05 Mar, 11:25
Jesús Vásquez Re: How to add more imports at the start of REPL Tue, 05 Mar, 11:46
Nuthan Reddy Re: How to add more imports at the start of REPL Tue, 05 Mar, 11:54
Akshay Bhardwaj Re: Is there a way to validate the syntax of raw spark sql query? Tue, 05 Mar, 12:14
lokeshkumar Why does Apache Spark Master shutdown when Zookeeper expires the session Tue, 05 Mar, 13:02
Thomas Ryck [PySpark] TypeError: expected string or bytes-like object Tue, 05 Mar, 15:08
Chandu Kavar [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:46
Chandu Kavar Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:51
Gabor Somogyi Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 15:58
Chandu Kavar Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service Tue, 05 Mar, 16:05
kant kodali Re: Is there a way to validate the syntax of raw spark sql query? Tue, 05 Mar, 17:08
Nicolas Paris Re: [SQL] 64-bit hash function, and seeding Tue, 05 Mar, 20:47
Huon.Wil...@data61.csiro.au Re: [SQL] 64-bit hash function, and seeding Tue, 05 Mar, 23:33
JF Chen Re: spark df.write.partitionBy run very slow Wed, 06 Mar, 03:03
JF Chen "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 03:08
Shyam P Re: How to group dataframe year-wise and iterate through groups and send each year to dataframe to executor? Wed, 06 Mar, 06:31
Shyam P Re: spark df.write.partitionBy run very slow Wed, 06 Mar, 06:39
Shyam P Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 06:40
Akshay Bhardwaj Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 07:56
Akshay Bhardwaj Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 08:01
JF Chen Re: "java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error Wed, 06 Mar, 08:45
Jungtaek Lim Re: Why does Apache Spark Master shutdown when Zookeeper expires the session Wed, 06 Mar, 09:37
Rich Bowen 4 Apache Events in 2019: DC Roadshow soon; next up Chicago, Las Vegas, and Berlin! Wed, 06 Mar, 14:00
Pankaj Wahane Structured Streaming to Kafka Topic Wed, 06 Mar, 16:58
William Creger PysPark date_add function suggestion Wed, 06 Mar, 18:51
Lian Jiang spark structured streaming crash due to decompressing gzip file failure Thu, 07 Mar, 05:58
Akshay Bhardwaj Re: Structured Streaming to Kafka Topic Thu, 07 Mar, 07:21
JF Chen Re: spark df.write.partitionBy run very slow Thu, 07 Mar, 08:21
Sommer Tobias Hadoop free spark on kubernetes => NoClassDefFound Thu, 07 Mar, 09:09
Sommer Tobias [SparkSQL, user-defined Hadoop, K8s] Hadoop free spark on kubernetes => NoClassDefFound Thu, 07 Mar, 09:23
Akshay Bhardwaj Re: spark structured streaming crash due to decompressing gzip file failure Thu, 07 Mar, 13:05
Akshay Mendole Re: mapreduce.input.fileinputformat.split.maxsize not working for spark 2.4.0 Thu, 07 Mar, 14:47
Lian Jiang Re: spark structured streaming crash due to decompressing gzip file failure Thu, 07 Mar, 14:53
Battini Lakshman Difference between 'cores' config params: spark submit on k8s Thu, 07 Mar, 21:53
JF Chen Re: spark df.write.partitionBy run very slow Fri, 08 Mar, 08:46
linr...@itri.org.tw A spark streaming problem about shuffle operation Fri, 08 Mar, 08:55
Shyam P Re: spark df.write.partitionBy run very slow Fri, 08 Mar, 12:54
zjzzjz Optimize tables used more than once: make dataframe persistent or save as parquet Sun, 10 Mar, 01:10
zjzzjz How to know if a machine in a Spark cluster 'participate's a job Sun, 10 Mar, 01:14
Lian Jiang use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 18:54
Arun Mahadevan Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 19:51
Georg Heiler Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 20:58
Jungtaek Lim Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 21:39
Lian Jiang Re: use rocksdb for spark structured streaming (SSS) Sun, 10 Mar, 21:46
shicheng31...@gmail.com returning type of function that needs to be passed to method 'mapWithState' Mon, 11 Mar, 08:42
Byron Lee unsubscribe Mon, 11 Mar, 17:40
Lian Jiang read json and write into parquet in executors Tue, 12 Mar, 02:52
JF Chen Re: spark df.write.partitionBy run very slow Tue, 12 Mar, 03:38
wangfei [SHUFFLE]FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle Tue, 12 Mar, 06:19
Jan Brabec (janbrabe) Mutating broadcast variable from executors, any risks even if done in a thread-safe manner? Tue, 12 Mar, 09:39
l...@china-inv.cn [SPARK SQL] How to overwrite a Hive table with spark sql (SPARK2) Tue, 12 Mar, 11:13
Vadim Semenov Re: [SHUFFLE]FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle Tue, 12 Mar, 14:36
Imran Rashid Re: [SHUFFLE]FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle Tue, 12 Mar, 15:22
puneetloya K8s for spark-2.2.3 Tue, 12 Mar, 18:49
swastik mittal Build spark source code with scala 2.11 Tue, 12 Mar, 23:26
Stephen Boesch Re: Build spark source code with scala 2.11 Tue, 12 Mar, 23:30
swastik mittal Re: Build spark source code with scala 2.11 Tue, 12 Mar, 23:39
Stephen Boesch Re: Build spark source code with scala 2.11 Tue, 12 Mar, 23:45
Anbazhagan Muthuramalingam subscribe Thu, 14 Mar, 02:52
Anbazhagan Muthuramalingam subscribe Thu, 14 Mar, 02:56
Anbazhagan Muthuramalingam [No Subject] Thu, 14 Mar, 02:59
Anbazhagan Muthuramalingam SUBSCRIBE Thu, 14 Mar, 03:28
anbu Windowing LAG function Usage in Spark2.2 Dataset scala Thu, 14 Mar, 03:55
anbu Spark scala Date Usage Thu, 14 Mar, 03:59
Shyam P Re: spark df.write.partitionBy run very slow Thu, 14 Mar, 06:26
Ido Friedman Multiple context in one Driver Thu, 14 Mar, 06:37
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Apr 2019177
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137