spark-user mailing list archives: February 2021

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Sachit Murarka Re: EOF Exception Spark Structured Streams - Kubernetes Mon, 01 Feb, 04:52
Prashant Sharma Re: EOF Exception Spark Structured Streams - Kubernetes Mon, 01 Feb, 08:27
Aaron.K.Math...@wellsfargo.com.INVALID Java/Spark Mon, 01 Feb, 15:08
Sean Owen Re: Java/Spark Mon, 01 Feb, 15:13
Arpan Bhandari Re: Spark SQL query Mon, 01 Feb, 15:38
Arpan Bhandari Re: Spark SQL query Mon, 01 Feb, 15:40
Aaron.K.Math...@wellsfargo.com.INVALID RE: Java/Spark Mon, 01 Feb, 16:01
Sean Owen Re: Java/Spark Mon, 01 Feb, 16:04
Sachit Murarka Re: Spark SQL query Mon, 01 Feb, 16:40
Arpan Bhandari Re: Spark SQL query Mon, 01 Feb, 16:46
Sachit Murarka Re: Spark SQL query Mon, 01 Feb, 17:11
Mich Talebzadeh Re: Spark SQL query Mon, 01 Feb, 23:00
Rahul Kumar Re: Implementing TableProvider in Spark 3.0 Tue, 02 Feb, 02:31
Sachit Murarka Re: EOF Exception Spark Structured Streams - Kubernetes Tue, 02 Feb, 04:31
Arpan Bhandari Re: Spark SQL query Tue, 02 Feb, 04:54
Arpan Bhandari Re: Spark SQL query Tue, 02 Feb, 04:58
Mich Talebzadeh Re: Spark SQL query Tue, 02 Feb, 14:24
Arpan Bhandari Re: Spark SQL query Tue, 02 Feb, 14:41
Mich Talebzadeh Re: Spark SQL query Tue, 02 Feb, 15:04
Arpan Bhandari Re: Spark SQL query Tue, 02 Feb, 15:13
Rahul Kumar Spark 3 datasource v2: Can't extract user provided schema Dataframewriter save operation Tue, 02 Feb, 19:29
Mich Talebzadeh Re: Spark SQL query Tue, 02 Feb, 19:58
David Morin S3a Committer Tue, 02 Feb, 20:26
Artemis User Exception on Avro Schema Object Serialization Tue, 02 Feb, 20:31
Sean Owen Re: Exception on Avro Schema Object Serialization Tue, 02 Feb, 20:36
Henoc Re: S3a Committer Tue, 02 Feb, 20:41
David Morin Re: S3a Committer Tue, 02 Feb, 20:47
Artemis User Re: Exception on Avro Schema Object Serialization Tue, 02 Feb, 20:49
Arpan Bhandari Re: Spark SQL query Wed, 03 Feb, 05:04
Boris Litvak RE: S3a Committer Wed, 03 Feb, 06:43
YoungKun Min Re: S3a Committer Wed, 03 Feb, 07:34
Gourav Sengupta Re: S3a Committer Wed, 03 Feb, 08:58
Mich Talebzadeh Re: Spark SQL query Wed, 03 Feb, 09:46
Arpan Bhandari Re: Spark SQL query Wed, 03 Feb, 10:11
Mich Talebzadeh Re: Spark SQL query Wed, 03 Feb, 11:32
Mich Talebzadeh Assertion of return value of dataframe in pytest Wed, 03 Feb, 15:12
Mich Talebzadeh Re: Assertion of return value of dataframe in pytest Wed, 03 Feb, 16:50
Sofia’s World Re: Assertion of return value of dataframe in pytest Wed, 03 Feb, 18:11
Mich Talebzadeh Re: Assertion of return value of dataframe in pytest Wed, 03 Feb, 18:43
James Yu Poor performance caused by coalesce to 1 Wed, 03 Feb, 18:54
Silvio Fiorito Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:05
Stéphane Verlet Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:06
Sean Owen Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:07
James Yu Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:19
Mich Talebzadeh Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 19:26
Gourav Sengupta Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 20:53
Silvio Fiorito Re: Poor performance caused by coalesce to 1 Wed, 03 Feb, 21:27
xgong [Spark on Kubernetes] Spark Application dependency management Question. Thu, 04 Feb, 00:04
yinghua...@163.com Flink 1.11.3从Kafka提取数据到Hive问题求助 Thu, 04 Feb, 00:32
Akshat Bordia Large Scheduler Delay Causing Performance Issue in Spark Application Thu, 04 Feb, 16:57
Raymond Tan Re: Spark Event Log Forwarding and Offset Tracking Thu, 04 Feb, 17:14
Dávid Szakállas Exporting all Executor Metrics in Prometheus format in K8s cluster Thu, 04 Feb, 20:29
Erica Lin Databricks Spark Parallelism and Shuffle Partitions Thu, 04 Feb, 22:27
Subhash Sriram Re: Databricks Spark Parallelism and Shuffle Partitions Thu, 04 Feb, 22:44
Eric Beabes Re: Data source v2 streaming sinks does not support Update mode Fri, 05 Feb, 00:34
Soheil Pourbafrani Converting RelationalGroupedDataSet to DataFrame Sat, 06 Feb, 22:45
Stephane Verlet Re: Converting RelationalGroupedDataSet to DataFrame Sun, 07 Feb, 19:39
galliaproject Introducing Gallia: a Scala+Spark library for data manipulation Mon, 08 Feb, 17:23
shahab Getting : format(target_id, ".", name), value) .. error Mon, 08 Feb, 20:43
Terry Kim Announcing Hyperspace v0.4.0 - an indexing subsystem for Apache Spark™ Mon, 08 Feb, 20:50
Mich Talebzadeh Testing ETL with Spark using Pytest Tue, 09 Feb, 15:17
Jerry Vinokurov Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 15:47
Mich Talebzadeh Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 16:14
Jerry Vinokurov Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 16:34
Rishabh Jain Issue with accessing S3 from EKS spark pod Tue, 09 Feb, 16:46
Vladimir Prus Re: Issue with accessing S3 from EKS spark pod Tue, 09 Feb, 17:14
Mich Talebzadeh Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 17:37
Sofia’s World Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 18:09
Mich Talebzadeh Re: Testing ETL with Spark using Pytest Tue, 09 Feb, 18:33
Rishabh Jain Re: Issue with accessing S3 from EKS spark pod Wed, 10 Feb, 08:43
Vladimir Prus Re: Issue with accessing S3 from EKS spark pod Wed, 10 Feb, 08:56
Ranju Jain Spark Kubernetes 3.0.1 | podcreationTimeout not working Wed, 10 Feb, 13:02
Ricardo Sardenberg unsubscribe Wed, 10 Feb, 15:41
Jacek Laskowski Re: Spark Kubernetes 3.0.1 | podcreationTimeout not working Wed, 10 Feb, 17:27
Rishabh Jain Re: Issue with accessing S3 from EKS spark pod Wed, 10 Feb, 17:50
javaguy Java Spark as an application server cache Wed, 10 Feb, 20:48
Kuttaiah Robin How to handle spark state which is growing too big even with timeout set. Thu, 11 Feb, 08:00
Abhishek Gupta Trigger on GroupStateTimeout with no new data in group Thu, 11 Feb, 12:56
Attila Zsolt Piros Re: understanding spark shuffle file re-use better Thu, 11 Feb, 15:38
Sunil Prabhakara Unsubscribe Fri, 12 Feb, 05:10
act_coder Spark structured streaming with periodical persist and unpersist Fri, 12 Feb, 06:16
Attila Zsolt Piros Re: understanding spark shuffle file re-use better Fri, 12 Feb, 10:13
Attila Zsolt Piros Re: Spark Kubernetes 3.0.1 | podcreationTimeout not working Fri, 12 Feb, 10:47
Haijia Zhou Does Spark 3.0 support parquet predicate pushdown for array of structures Mon, 15 Feb, 03:56
Jungtaek Lim Re: How to handle spark state which is growing too big even with timeout set. Mon, 15 Feb, 03:58
Haijia Zhou [SPARK-SQL] Does Spark 3.0 support parquet predicate pushdown for array of structs? Mon, 15 Feb, 04:23
Attila Zsolt Piros Re: K8S spark-submit Loses Successful Driver Completion Mon, 15 Feb, 16:00
HARSH TAKKAR Using Custom Scala Spark ML Estimator in PySpark Tue, 16 Feb, 05:22
VenkateshDurai Using DataFrame to Read Avro files Tue, 16 Feb, 06:22
Mich Talebzadeh Re: Using Custom Scala Spark ML Estimator in PySpark Tue, 16 Feb, 08:36
Jahar Tyagi vm.swappiness value for Spark on Kubernetes Tue, 16 Feb, 11:27
Sean Owen Re: vm.swappiness value for Spark on Kubernetes Tue, 16 Feb, 14:07
Sean Owen Re: Using Custom Scala Spark ML Estimator in PySpark Tue, 16 Feb, 14:55
HARSH TAKKAR Re: Using Custom Scala Spark ML Estimator in PySpark Tue, 16 Feb, 16:25
galliaproject Re: Introducing Gallia: a Scala+Spark library for data manipulation Tue, 16 Feb, 19:42
aupres KafkaUtils module not found on spark 3 pyspark Wed, 17 Feb, 07:19
Jungtaek Lim Re: KafkaUtils module not found on spark 3 pyspark Wed, 17 Feb, 08:01
Ivan Petrov Spark SQL Dataset and BigDecimal Wed, 17 Feb, 12:48
Takeshi Yamamuro Re: Spark SQL Dataset and BigDecimal Wed, 17 Feb, 23:33
Ivan Petrov Re: Spark SQL Dataset and BigDecimal Thu, 18 Feb, 09:39
Message list1 · 2 · Next »Thread · Author · Date
Box list
Apr 2021175
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137