spark-user mailing list archives: August 2016

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Re: How to write contents of RDD to HDFS as separate file for each item in RDD (PySpark)
Andrew Ehrlich   Re: How to write contents of RDD to HDFS as separate file for each item in RDD (PySpark) Mon, 01 Aug, 00:18
Re: Tuning level of Parallelism: Increase or decrease?
Andrew Ehrlich   Re: Tuning level of Parallelism: Increase or decrease? Mon, 01 Aug, 00:27
Jestin Ma     Re: Tuning level of Parallelism: Increase or decrease? Mon, 01 Aug, 01:41
Nikolay Zhebet       Re: Tuning level of Parallelism: Increase or decrease? Mon, 01 Aug, 08:15
Jestin Ma         Re: Tuning level of Parallelism: Increase or decrease? Mon, 01 Aug, 15:56
Nikolay Zhebet           Re: Tuning level of Parallelism: Increase or decrease? Mon, 01 Aug, 16:52
Sonal Goyal             Re: Tuning level of Parallelism: Increase or decrease? Tue, 02 Aug, 07:59
Jacek Laskowski           Re: Tuning level of Parallelism: Increase or decrease? Tue, 02 Aug, 22:54
Jestin Ma             Re: Tuning level of Parallelism: Increase or decrease? Tue, 02 Aug, 23:11
Jacek Laskowski               Re: Tuning level of Parallelism: Increase or decrease? Wed, 03 Aug, 11:31
Yong Zhang             Re: Tuning level of Parallelism: Increase or decrease? Wed, 03 Aug, 11:01
Re: Spark recovery takes long
NB   Re: Spark recovery takes long Mon, 01 Aug, 00:34
ayan guha Windows - Spark 2 - Standalone - Worker not able to connect to Master Mon, 01 Aug, 01:24
Nikolay Zhebet   Re: Windows - Spark 2 - Standalone - Worker not able to connect to Master Mon, 01 Aug, 08:22
ayan guha     Re: Windows - Spark 2 - Standalone - Worker not able to connect to Master Mon, 01 Aug, 11:35
Nikolay Zhebet       Re: Windows - Spark 2 - Standalone - Worker not able to connect to Master Mon, 01 Aug, 13:48
Re: spark java - convert string to date
Hyukjin Kwon   Re: spark java - convert string to date Mon, 01 Aug, 01:46
Re: [Spark 2.0] Why MutableInt cannot be cast to MutableLong?
Chanh Le   Re: [Spark 2.0] Why MutableInt cannot be cast to MutableLong? Mon, 01 Aug, 02:21
Chanh Le     Re: [Spark 2.0] Why MutableInt cannot be cast to MutableLong? Mon, 01 Aug, 03:52
ayan guha is Hadoop need to be installed? Mon, 01 Aug, 03:20
Re: Writing custom Transformers and Estimators like Tokenizer in spark ML
janardhan shetty   Re: Writing custom Transformers and Estimators like Tokenizer in spark ML Mon, 01 Aug, 03:27
janardhan shetty     Re: Writing custom Transformers and Estimators like Tokenizer in spark ML Mon, 01 Aug, 18:30
Steve Rowe       Re: Writing custom Transformers and Estimators like Tokenizer in spark ML Tue, 02 Aug, 00:25
Re: sql to spark scala rdd
Sri   Re: sql to spark scala rdd Mon, 01 Aug, 06:04
Mich Talebzadeh     Re: sql to spark scala rdd Mon, 01 Aug, 06:16
Sri       Re: sql to spark scala rdd Mon, 01 Aug, 07:07
sri hari kali charan Tummala         Re: sql to spark scala rdd Tue, 02 Aug, 02:25
zhangjp           unsubscribe Tue, 02 Aug, 03:00
Jacek Laskowski           Re: sql to spark scala rdd Tue, 02 Aug, 10:27
Sri             Re: sql to spark scala rdd Tue, 02 Aug, 12:39
kevin spark.read.format("jdbc") Mon, 01 Aug, 06:30
kevin   Re: spark.read.format("jdbc") Mon, 01 Aug, 06:37
Nikolay Zhebet     Re: spark.read.format("jdbc") Mon, 01 Aug, 07:24
kevin       Re: spark.read.format("jdbc") Tue, 02 Aug, 01:47
Xiao Li         Re: spark.read.format("jdbc") Tue, 02 Aug, 03:55
Re: multiple spark streaming contexts
Sumit Khanna   Re: multiple spark streaming contexts Mon, 01 Aug, 06:39
Nikolay Zhebet     Re: multiple spark streaming contexts Mon, 01 Aug, 07:38
Sumit Khanna       Re: multiple spark streaming contexts Mon, 01 Aug, 07:41
Nikolay Zhebet         Re: multiple spark streaming contexts Mon, 01 Aug, 09:28
Subhajit Purkayastha Getting error, when I do df.show() Mon, 01 Aug, 08:22
Saisai Shao   Re: Getting error, when I do df.show() Mon, 01 Aug, 08:57
Re: JettyUtils.createServletHandler Method not Found?
bg_spark   Re: JettyUtils.createServletHandler Method not Found? Mon, 01 Aug, 08:37
Ted Yu     Re: JettyUtils.createServletHandler Method not Found? Mon, 01 Aug, 10:38
Re: spark 2.0 readStream from a REST API
Ayoub Benali   Re: spark 2.0 readStream from a REST API Mon, 01 Aug, 09:01
Jacek Laskowski     Re: spark 2.0 readStream from a REST API Mon, 01 Aug, 11:44
Amit Sela       Re: spark 2.0 readStream from a REST API Mon, 01 Aug, 16:44
Ayoub Benali         Re: spark 2.0 readStream from a REST API Tue, 02 Aug, 08:59
Jacek Laskowski           Re: spark 2.0 readStream from a REST API Tue, 02 Aug, 09:50
Sela, Amit           Re: spark 2.0 readStream from a REST API Thu, 11 Aug, 07:39
Ayoub Benali       Re: spark 2.0 readStream from a REST API Tue, 02 Aug, 08:49
pseudo oduesp java.net.UnknownHostException Mon, 01 Aug, 09:51
pseudo oduesp   Re: java.net.UnknownHostException Tue, 02 Aug, 09:22
Yang Cao     Re: java.net.UnknownHostException Tue, 02 Aug, 09:25
Noorul Islam K M Testing --supervise flag Mon, 01 Aug, 10:51
Noorul Islam Kamal Malmiyoda   Re: Testing --supervise flag Tue, 02 Aug, 12:07
Re: ERROR Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues. Check driver logs for WARN messages.
Ted Yu   Re: ERROR Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues. Check driver logs for WARN messages. Mon, 01 Aug, 10:55
Windows operation orderBy desc
Ashok Kumar   Windows operation orderBy desc Mon, 01 Aug, 13:56
Mich Talebzadeh     Re: Windows operation orderBy desc Mon, 01 Aug, 14:39
Selvam Raman       Re: Windows operation orderBy desc Thu, 25 Aug, 05:53
David Kaufman Need Advice: Spark-Streaming Setup Mon, 01 Aug, 14:47
Andrés Ivaldi Spark 2 and Solr Mon, 01 Aug, 14:56
Re: Possible to push sub-queries down into the DataSource impl?
Timothy Potter   Re: Possible to push sub-queries down into the DataSource impl? Mon, 01 Aug, 15:45
Everett Anderson Plans for improved Spark DataFrame/Dataset unit testing? Mon, 01 Aug, 16:02
Koert Kuipers   Re: Plans for improved Spark DataFrame/Dataset unit testing? Mon, 01 Aug, 16:22
Holden Karau     Re: Plans for improved Spark DataFrame/Dataset unit testing? Mon, 01 Aug, 22:23
Everett Anderson       Re: Plans for improved Spark DataFrame/Dataset unit testing? Fri, 19 Aug, 23:25
Bedrytski Aliaksandr   Re: Plans for improved Spark DataFrame/Dataset unit testing? Sun, 21 Aug, 10:08
Everett Anderson     Re: Plans for improved Spark DataFrame/Dataset unit testing? Sun, 21 Aug, 16:30
Bedrytski Aliaksandr       Re: Plans for improved Spark DataFrame/Dataset unit testing? Mon, 22 Aug, 08:16
Re: sampling operation for DStream
Martin Le   Re: sampling operation for DStream Mon, 01 Aug, 16:24
Cody Koeninger     Re: sampling operation for DStream Mon, 01 Aug, 16:43
Martin Le       Re: sampling operation for DStream Mon, 01 Aug, 20:22
Cody Koeninger         Re: sampling operation for DStream Mon, 01 Aug, 21:01
Re: Problems initializing SparkUI
Maximiliano Patricio Méndez   Re: Problems initializing SparkUI Mon, 01 Aug, 16:44
Mich Talebzadeh     Re: Problems initializing SparkUI Mon, 01 Aug, 16:49
Maximiliano Patricio Méndez       Re: Problems initializing SparkUI Mon, 01 Aug, 18:08
Mich Talebzadeh         Re: Problems initializing SparkUI Mon, 01 Aug, 19:07
Maximiliano Patricio Méndez           Re: Problems initializing SparkUI Mon, 01 Aug, 20:23
Mich Talebzadeh             Re: Problems initializing SparkUI Mon, 01 Aug, 20:27
Maximiliano Patricio Méndez               Re: Problems initializing SparkUI Mon, 01 Aug, 21:03
Mich Talebzadeh                 Re: Problems initializing SparkUI Mon, 01 Aug, 21:06
Maximiliano Patricio Méndez                   Re: Problems initializing SparkUI Mon, 01 Aug, 21:23
Mich Talebzadeh                     Re: Problems initializing SparkUI Mon, 01 Aug, 21:34
Andy Davidson python 'Jupyter' data frame problem with autocompletion Mon, 01 Aug, 17:08
Mich Talebzadeh The equivalent for INSTR in Spark FP Mon, 01 Aug, 17:24
Mich Talebzadeh   Re: The equivalent for INSTR in Spark FP Mon, 01 Aug, 20:29
Jacek Laskowski   Re: The equivalent for INSTR in Spark FP Mon, 01 Aug, 21:13
Mich Talebzadeh     Re: The equivalent for INSTR in Spark FP Mon, 01 Aug, 21:18
Jacek Laskowski       Re: The equivalent for INSTR in Spark FP Mon, 01 Aug, 22:02
Mich Talebzadeh         Re: The equivalent for INSTR in Spark FP Mon, 01 Aug, 22:43
Mich Talebzadeh           Re: The equivalent for INSTR in Spark FP Tue, 02 Aug, 07:52
Mich Talebzadeh             Re: The equivalent for INSTR in Spark FP Tue, 02 Aug, 07:58
Jacek Laskowski               Re: The equivalent for INSTR in Spark FP Tue, 02 Aug, 09:57
Mich Talebzadeh                 Re: The equivalent for INSTR in Spark FP Tue, 02 Aug, 10:18
Mich Talebzadeh                   Re: The equivalent for INSTR in Spark FP Tue, 02 Aug, 10:20
Sandeep Joshi SQL predicate pushdown on parquet or other columnar formats Mon, 01 Aug, 18:17
Mich Talebzadeh   Re: SQL predicate pushdown on parquet or other columnar formats Mon, 01 Aug, 19:11
itai.efrati Mlib RandomForest (Spark 2.0) predict a single vector Mon, 01 Aug, 19:32
Re: Java Recipes for Spark
Marco Mistroni   Re: Java Recipes for Spark Mon, 01 Aug, 20:03
Gourav Sengupta     Re: Java Recipes for Spark Mon, 01 Aug, 20:16
Andrei Ivanov Spark 2.0 History Server Storage Mon, 01 Aug, 21:10
Andrei Ivanov   Re: Spark 2.0 History Server Storage Tue, 02 Aug, 18:07
Andrei Ivanov     Re: Spark 2.0 History Server Storage Tue, 02 Aug, 18:27
Hao Ren [MLlib] Term Frequency in TF-IDF seems incorrect Mon, 01 Aug, 22:29
Yanbo Liang   Re: [MLlib] Term Frequency in TF-IDF seems incorrect Tue, 02 Aug, 03:44
Nick Pentreath     Re: [MLlib] Term Frequency in TF-IDF seems incorrect Tue, 02 Aug, 09:25
Re: tpcds for spark2.0
kevin   Re: tpcds for spark2.0 Tue, 02 Aug, 01:49
Selvam Raman Sqoop On Spark Tue, 02 Aug, 04:52
Takeshi Yamamuro   Re: Sqoop On Spark Tue, 02 Aug, 04:59
Rohit L What are using Spark for Tue, 02 Aug, 05:48
Xiao Li   Re: What are using Spark for Tue, 02 Aug, 05:51
Rodrick Brown   Re: What are using Spark for Tue, 02 Aug, 05:52
Sonal Goyal   Re: What are using Spark for Tue, 02 Aug, 07:54
Rohit L     Re: What are using Spark for Tue, 02 Aug, 18:10
Deepak Sharma       Re: What are using Spark for Tue, 02 Aug, 18:13
Karthik Ramakrishnan       Re: What are using Spark for Tue, 02 Aug, 18:17
Mich Talebzadeh         Re: What are using Spark for Tue, 02 Aug, 19:29
Daniel Siegmann           Re: What are using Spark for Tue, 02 Aug, 19:49
Divya Gehlot Spark GraphFrames Tue, 02 Aug, 05:50
Kazuaki Ishizaki   Re: Spark GraphFrames Tue, 02 Aug, 08:04
Kazuaki Ishizaki     Re: Spark GraphFrames Tue, 02 Aug, 08:15
Denny Lee       Re: Spark GraphFrames Tue, 02 Aug, 17:41
Chanh Le Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 07:41
Mich Talebzadeh   Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 07:55
Chanh Le     Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 08:13
Mich Talebzadeh       Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 08:33
Chanh Le         Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 09:18
Mich Talebzadeh           Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 09:50
Chanh Le             Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 11:00
ayan guha             Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 11:03
Chanh Le               Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 11:09
Mich Talebzadeh                 Re: Does it has a way to config limit in query on STS by default? Tue, 02 Aug, 11:29
Chen Song                   Re: Does it has a way to config limit in query on STS by default? Tue, 30 Aug, 14:55
Rychnovsky, Dusan Application not showing in Spark History Tue, 02 Aug, 08:53
Noorul Islam Kamal Malmiyoda   Re: Application not showing in Spark History Tue, 02 Aug, 09:09
Sun Rui   Re: Application not showing in Spark History Tue, 02 Aug, 09:26
陈宇航 issue with coalesce in Spark 2.0.0 Tue, 02 Aug, 09:57
Michael Armbrust   Re: issue with coalesce in Spark 2.0.0 Wed, 03 Aug, 17:06
Are join/groupBy operations with wide Java Beans using Dataset API much slower than using RDD API?
dueckm   Are join/groupBy operations with wide Java Beans using Dataset API much slower than using RDD API? Tue, 02 Aug, 12:12
dueckm   Are join/groupBy operations with wide Java Beans using Dataset API much slower than using RDD API? Wed, 03 Aug, 06:06
dueckm   Are join/groupBy operations with wide Java Beans using Dataset API much slower than using RDD API? Thu, 04 Aug, 11:27
unsubscribe
doovs...@sina.com   unsubscribe Tue, 02 Aug, 13:11
Daniel Lopes     Re: unsubscribe Wed, 03 Aug, 20:21
Sohil Jain   unsubscribe Wed, 10 Aug, 16:48
Matei Zaharia     Re: unsubscribe Wed, 10 Aug, 16:55
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
May 2018268
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017184
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137