spark-user mailing list archives: May 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Mike Wheeler Schema Evolution for nested Dataset[T] Mon, 01 May, 04:12
Steve Loughran Re: removing columns from file Mon, 01 May, 13:26
Saulo Ricci Reading table from sql database to apache spark dataframe/RDD Mon, 01 May, 14:50
vincent gromakowski Re: Reading table from sql database to apache spark dataframe/RDD Mon, 01 May, 15:13
Everett Anderson Re: Calculate mode separately for multiple columns in row Mon, 01 May, 16:47
Michael Armbrust Re: Schema Evolution for nested Dataset[T] Mon, 01 May, 17:29
Michael Armbrust Re: Schema Evolution for nested Dataset[T] Mon, 01 May, 17:31
Saulo Ricci Loading postgresql table to spark SyntaxError Mon, 01 May, 19:49
Lavelle, Shawn RE: Spark-SQL Query Optimization: overlapping ranges Mon, 01 May, 22:00
Daniel Santana Re: RDD blocks on Spark Driver Tue, 02 May, 00:33
Yanbo Liang Re: Initialize Gaussian Mixture Model using Spark ML dataframe API Tue, 02 May, 04:01
颜发才(Yan Facai) Re: Could any one please tell me why this takes forever to finish? Tue, 02 May, 05:34
TwUxTLi51Nus OutOfMemoryError Tue, 02 May, 07:07
Nan Zhu --jars does not take remote jar? Tue, 02 May, 15:43
Marcelo Vanzin Re: --jars does not take remote jar? Tue, 02 May, 16:00
Nan Zhu Re: --jars does not take remote jar? Tue, 02 May, 16:07
Marcelo Vanzin Re: --jars does not take remote jar? Tue, 02 May, 16:12
Nan Zhu Re: --jars does not take remote jar? Tue, 02 May, 16:14
kant kodali do we need to enable writeAheadLogs for DirectStream as well or is it only for indirect stream? Tue, 02 May, 16:32
KhajaAsmath Mohammed Joins in Spark Tue, 02 May, 18:22
Angel Francisco Orta Re: Joins in Spark Tue, 02 May, 18:27
KhajaAsmath Mohammed Re: Joins in Spark Tue, 02 May, 18:29
Angel Francisco Orta Re: Joins in Spark Tue, 02 May, 18:38
Mike Wheeler Re: Schema Evolution for nested Dataset[T] Tue, 02 May, 18:44
Everett Anderson Re: Driver spins hours in query plan optimization Tue, 02 May, 18:44
Tim Smith Re: Initialize Gaussian Mixture Model using Spark ML dataframe API Tue, 02 May, 18:48
Cody Koeninger Re: do we need to enable writeAheadLogs for DirectStream as well or is it only for indirect stream? Tue, 02 May, 18:50
Nipun Arora [Spark Streaming] Dynamic Broadcast Variable Update Tue, 02 May, 18:56
Tim Smith Re: [Spark Streaming] Dynamic Broadcast Variable Update Tue, 02 May, 19:14
Michael Armbrust Re: Schema Evolution for nested Dataset[T] Tue, 02 May, 19:29
KhajaAsmath Mohammed Re: Joins in Spark Tue, 02 May, 19:44
Angel Francisco Orta Re: Joins in Spark Tue, 02 May, 19:59
Michael Armbrust [ANNOUNCE] Apache Spark 2.1.1 Tue, 02 May, 22:18
issues solution spark 1.6 .0 and gridsearchcv Wed, 03 May, 07:45
peay map/foreachRDD equivalent for pyspark Structured Streaming Wed, 03 May, 08:51
pklemenkov Benchmark of XGBoost, Vowpal Wabbit and Spark ML on Criteo 1TB Dataset Wed, 03 May, 09:42
Tathagata Das Re: map/foreachRDD equivalent for pyspark Structured Streaming Wed, 03 May, 10:05
Miguel Figueiredo Redefining Spark native UDFs Wed, 03 May, 13:41
Steve Loughran Re: parquet optimal file structure - flat vs nested Wed, 03 May, 13:55
JayeshLalwani Refreshing a persisted RDD Wed, 03 May, 14:30
Sidney Feiner [Spark Streaming] - Killing application from within code Wed, 03 May, 15:44
francis....@smartsheet.com Francis Lau has shared a document on Google Docs with you Wed, 03 May, 18:32
p..@occamsmachete.com Pat Ferrel has shared a document on Google Docs with you Wed, 03 May, 19:23
Tathagata Das Re: [Spark Streaming] - Killing application from within code Wed, 03 May, 19:25
kant kodali What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Wed, 03 May, 20:38
Michael Armbrust Re: What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Wed, 03 May, 21:25
kant kodali Re: What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Wed, 03 May, 21:54
JayeshLalwani Re: In-order processing using spark streaming Wed, 03 May, 22:18
Tathagata Das Re: Refreshing a persisted RDD Wed, 03 May, 22:32
Zeming Yu Spark books Wed, 03 May, 22:35
JayeshLalwani Re: Spark-SQL collect function Wed, 03 May, 22:37
JayeshLalwani Re: Synonym handling replacement issue with UDF in Apache Spark Wed, 03 May, 22:51
Lalwani, Jayesh Re: Refreshing a persisted RDD Wed, 03 May, 23:13
Tobi Bosede Re: Spark books Wed, 03 May, 23:30
Tathagata Das Re: Refreshing a persisted RDD Wed, 03 May, 23:30
Michael Armbrust Re: What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Wed, 03 May, 23:36
ayan guha Re: Spark books Thu, 04 May, 00:07
Neelesh Salian Re: Spark books Thu, 04 May, 00:16
Kun Liu What is the correct JSON parameter format used to to submit Spark2 apps with YARN REST API? Thu, 04 May, 00:17
Stephen Fletcher Re: Spark books Thu, 04 May, 00:52
Pushkar.Gujar Re: Spark books Thu, 04 May, 01:33
Lohith Samaga M Spark 2.1.0 and Hive 2.1.1 Thu, 04 May, 05:04
Yanbo Liang [CFP] DataWorks Summit/Hadoop Summit Sydney - Call for abstracts Thu, 04 May, 05:15
Manohar753 any support to use Spark UDF in HIVE Thu, 04 May, 07:03
kant kodali Re: What are Analysis Errors With respect to Spark Sql DataFrames and DataSets? Thu, 04 May, 07:34
Vikash Pareek Re: Hive on Spark is not populating correct records Thu, 04 May, 07:40
kant kodali unable to find how to integrate SparkSession with a Custom Receiver. Thu, 04 May, 07:43
issues solution Create multiple columns in pyspak with one shot Thu, 04 May, 07:55
Tathagata Das Re: unable to find how to integrate SparkSession with a Custom Receiver. Thu, 04 May, 07:58
Rick Moritz Re: Create multiple columns in pyspak with one shot Thu, 04 May, 08:06
matd Kerberos impersonation of a Spark Context at runtime Thu, 04 May, 09:13
Sidney Feiner RE: [Spark Streaming] - Killing application from within code Thu, 04 May, 10:41
issues solution Normalize columns items for Onehotencoder Thu, 04 May, 12:29
Saisai Shao Re: Kerberos impersonation of a Spark Context at runtime Thu, 04 May, 13:01
Abel Rincón Re: Kerberos impersonation of a Spark Context at runtime Thu, 04 May, 14:22
kant kodali Re: unable to find how to integrate SparkSession with a Custom Receiver. Thu, 04 May, 14:31
yiskylee scalastyle violation on mvn install but not on mvn package Thu, 04 May, 14:45
Gene Pang Re: [Spark Streaming] Dynamic Broadcast Variable Update Thu, 04 May, 16:18
Dominik Safaric Spark Streaming 2.1 - slave parallel recovery Thu, 04 May, 20:00
Afshin, Bardia long running jobs with Spark Thu, 04 May, 21:45
Mark Hamstra Re: scalastyle violation on mvn install but not on mvn package Fri, 05 May, 00:11
peay Re: map/foreachRDD equivalent for pyspark Structured Streaming Fri, 05 May, 06:36
issues solution imbalance classe inside RANDOMFOREST CLASSIFIER Fri, 05 May, 07:58
Jone Zhang org.apache.hadoop.fs.FileSystem: Provider tachyon.hadoop.TFS could not be instantiated Fri, 05 May, 08:53
DB Tsai Re: imbalance classe inside RANDOMFOREST CLASSIFIER Fri, 05 May, 09:08
mathieu ferlay hbase + spark + hdfs Fri, 05 May, 13:13
Nick Chammas Reading ORC file - fine on 1.6; GC timeout on 2+ Fri, 05 May, 13:55
Patrick McGloin Structured Streaming + initialState Fri, 05 May, 14:35
A Shaikh how to get assertDataFrameEquals ignore nullable Fri, 05 May, 14:39
issues solution Crossvalidator after fit Fri, 05 May, 14:40
dar...@ontrenet.com Where is release 2.1.1? Fri, 05 May, 14:40
A Shaikh how to get assertDataFrameEquals ignore nullable Fri, 05 May, 14:48
dar...@ontrenet.com Re: Where is release 2.1.1? Fri, 05 May, 15:10
Pierce Lamb Re: [Spark Streaming] Dynamic Broadcast Variable Update Fri, 05 May, 17:04
Jacek Laskowski Re: Spark books Fri, 05 May, 17:25
kant kodali is Spark Application code dependent on which mode we run? Fri, 05 May, 17:39
Tathagata Das Re: Structured Streaming + initialState Fri, 05 May, 21:49
Bryan Cutler Re: Crossvalidator after fit Fri, 05 May, 23:16
Patrick McGloin Re: Structured Streaming + initialState Sat, 06 May, 08:14
saulshanabrook Re: Join streams Apache Spark Sat, 06 May, 18:31
Message list1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Box list
May 2018292
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017184
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137