spark-user mailing list archives: January 2015

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Re: Big performance difference between "client" and "cluster" deployment mode; is this expected?
Tathagata Das   Re: Big performance difference between "client" and "cluster" deployment mode; is this expected? Thu, 01 Jan, 00:21
Enno Shioji     Re: Big performance difference between "client" and "cluster" deployment mode; is this expected? Thu, 01 Jan, 07:52
Kevin Burton limit vs sample for indexing a small amount of data quickly? Thu, 01 Jan, 03:00
Fernando O.   Re: limit vs sample for indexing a small amount of data quickly? Thu, 01 Jan, 05:36
rapelly kartheek NullPointerException Thu, 01 Jan, 06:24
Josh Rosen   Re: NullPointerException Thu, 01 Jan, 06:34
rapelly kartheek     Re: NullPointerException Thu, 01 Jan, 06:35
rapelly kartheek       Fwd: NullPointerException Thu, 01 Jan, 06:43
Josh Rosen       Re: NullPointerException Thu, 01 Jan, 06:47
rapelly kartheek         Re: NullPointerException Thu, 01 Jan, 06:53
Kevin Burton spark ignoring all memory settings and defaulting to 512MB? Thu, 01 Jan, 06:35
Kevin Burton   Re: spark ignoring all memory settings and defaulting to 512MB? Thu, 01 Jan, 06:43
Ilya Ganelin     Re: spark ignoring all memory settings and defaulting to 512MB? Thu, 01 Jan, 07:41
Sean Owen   Re: spark ignoring all memory settings and defaulting to 512MB? Thu, 01 Jan, 08:43
Kevin Burton     Re: spark ignoring all memory settings and defaulting to 512MB? Thu, 01 Jan, 18:20
Re: Some Serious Issue with Spark Streaming ? Blocks Getting Removed and Jobs have Failed..
zgm   Re: Some Serious Issue with Spark Streaming ? Blocks Getting Removed and Jobs have Failed.. Thu, 01 Jan, 08:16
Sean Owen   Re: Some Serious Issue with Spark Streaming ? Blocks Getting Removed and Jobs have Failed.. Thu, 01 Jan, 08:38
Re: Trying to make spark-jobserver work with yarn
Akhil Das   Re: Trying to make spark-jobserver work with yarn Thu, 01 Jan, 08:22
Fernando O.     Re: Trying to make spark-jobserver work with yarn Thu, 01 Jan, 21:15
Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream
Akhil Das   Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Thu, 01 Jan, 08:28
Christophe Billiard     Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Fri, 02 Jan, 11:16
Akhil Das       Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Fri, 02 Jan, 11:27
Akhil Das         Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Fri, 02 Jan, 11:50
Pankaj Narang   Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Sat, 03 Jan, 03:11
Christophe Billiard     Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Tue, 06 Jan, 11:49
Pankaj Narang       Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream Tue, 06 Jan, 12:50
Re: spark stream + cassandra (execution on event)
Akhil Das   Re: spark stream + cassandra (execution on event) Thu, 01 Jan, 08:32
Re: Spark app performance
Akhil Das   Re: Spark app performance Thu, 01 Jan, 08:35
Raghavendra Pandey     Re: Spark app performance Fri, 02 Jan, 02:13
Re: Reading nested JSON data with Spark SQL
Pankaj Narang   Re: Reading nested JSON data with Spark SQL Thu, 01 Jan, 08:36
Pankaj Narang     Re: Reading nested JSON data with Spark SQL Thu, 01 Jan, 12:17
Pankaj Narang       Re: Reading nested JSON data with Spark SQL Thu, 01 Jan, 12:40
Tapas Swain Only One Kafka receiver is running in spark irrespective of multiple DStreams Thu, 01 Jan, 09:59
Re: FlatMapValues
Hitesh Khamesra   Re: FlatMapValues Thu, 01 Jan, 17:46
Sanjay Subramanian     Re: FlatMapValues Thu, 01 Jan, 20:39
Sanjay Subramanian       Re: FlatMapValues Sat, 03 Jan, 07:52
Sean Owen   Re: FlatMapValues Mon, 05 Jan, 11:19
Sanjay Subramanian     Re: FlatMapValues Mon, 05 Jan, 18:30
Re: JdbcRDD and ClassTag issue
Sujee   Re: JdbcRDD and ClassTag issue Thu, 01 Jan, 18:10
Re: JdbcRDD
Sujee   Re: JdbcRDD Thu, 01 Jan, 18:18
How to propagate the value set in SparkContext.setCallSite() to all executors?
RK   How to propagate the value set in SparkContext.setCallSite() to all executors? Thu, 01 Jan, 18:27
RK   How to propagate the value set in SparkContext.setCallSite() to all executors? Thu, 01 Jan, 19:29
Aniket Bhatnagar sparkContext.textFile does not honour the minPartitions argument Thu, 01 Jan, 18:43
Rishi Yadav   Re: sparkContext.textFile does not honour the minPartitions argument Fri, 02 Jan, 01:43
Aniket Bhatnagar     Re: sparkContext.textFile does not honour the minPartitions argument Fri, 02 Jan, 17:31
RK Incorrect information in the UI about data received by KafkaReceiver??? Thu, 01 Jan, 19:26
Re: Gradual slow down of the Streaming job (getCallSite at DStream.scala:294)
RK   Re: Gradual slow down of the Streaming job (getCallSite at DStream.scala:294) Thu, 01 Jan, 19:36
Gerard Maas     Re: Gradual slow down of the Streaming job (getCallSite at DStream.scala:294) Mon, 05 Jan, 14:35
Tathagata Das       Re: Gradual slow down of the Streaming job (getCallSite at DStream.scala:294) Mon, 05 Jan, 19:15
DAG info
shahid ashraf   DAG info Fri, 02 Jan, 06:33
shahid   DAG info Fri, 02 Jan, 07:02
Josh Rosen     Re: DAG info Fri, 02 Jan, 07:35
Robineast     Re: DAG info Fri, 02 Jan, 08:21
madhu phatak       Re: DAG info Sat, 03 Jan, 08:34
Re: Compile error from Spark 1.2.0
Akhil Das   Re: Compile error from Spark 1.2.0 Fri, 02 Jan, 06:45
zigen     Re: Compile error from Spark 1.2.0 Fri, 02 Jan, 07:21
Re: DecisionTree Algorithm used in Spark MLLib
Manish Amde   Re: DecisionTree Algorithm used in Spark MLLib Fri, 02 Jan, 07:41
Wouter Samaey Is it possible to do incremental training using ALSModel (MLlib)? Fri, 02 Jan, 09:40
Peng Cheng   Re: Is it possible to do incremental training using ALSModel (MLlib)? Sat, 03 Jan, 04:28
Reza Zadeh     Re: Is it possible to do incremental training using ALSModel (MLlib)? Sat, 03 Jan, 05:04
Sean Owen     Re: Is it possible to do incremental training using ALSModel (MLlib)? Sat, 03 Jan, 09:36
Wouter Samaey       Re: Is it possible to do incremental training using ALSModel (MLlib)? Sat, 03 Jan, 12:04
Sean Owen         Re: Is it possible to do incremental training using ALSModel (MLlib)? Mon, 05 Jan, 12:13
Wouter Samaey           Re: Is it possible to do incremental training using ALSModel (MLlib)? Mon, 05 Jan, 12:17
Nick Pentreath             Re: Is it possible to do incremental training using ALSModel (MLlib)? Wed, 07 Jan, 10:08
Wouter Samaey               Re: Is it possible to do incremental training using ALSModel (MLlib)? Wed, 07 Jan, 10:09
MLLIB and Openblas library in non-default dir
Tomas Hudik   MLLIB and Openblas library in non-default dir Fri, 02 Jan, 11:41
xhudik   MLLIB and Openblas library in non-default dir Fri, 02 Jan, 14:28
Xiangrui Meng     Re: MLLIB and Openblas library in non-default dir Mon, 05 Jan, 21:35
Tomas Hudik       Re: MLLIB and Openblas library in non-default dir Tue, 06 Jan, 19:40
Xiangrui Meng         Re: MLLIB and Openblas library in non-default dir Wed, 07 Jan, 05:13
Antony Mayi pyspark executor PYTHONPATH Fri, 02 Jan, 12:49
Antony Mayi   Re: pyspark executor PYTHONPATH Fri, 02 Jan, 16:14
elliott cordo JdbcRdd for Python Fri, 02 Jan, 13:17
Tim Schweichler   Re: JdbcRdd for Python Fri, 02 Jan, 20:59
elliott cordo     Re: JdbcRdd for Python Fri, 02 Jan, 21:22
Cody Koeninger       Re: JdbcRdd for Python Mon, 05 Jan, 15:09
Michael Armbrust         Re: JdbcRdd for Python Tue, 06 Jan, 02:26
Re: NoClassDefFoundError when trying to run spark application
Pankaj Narang   Re: NoClassDefFoundError when trying to run spark application Fri, 02 Jan, 15:34
Pankaj (send this email to subscribe) Fri, 02 Jan, 15:36
Ted Yu   Re: (send this email to subscribe) Fri, 02 Jan, 15:43
KafkaReceiver executor in spark streaming job on YARN suddenly killed by ResourceManager
Jun Ki Kim   KafkaReceiver executor in spark streaming job on YARN suddenly killed by ResourceManager Fri, 02 Jan, 16:13
Junki Kim   KafkaReceiver executor in spark streaming job on YARN suddenly killed by ResourceManager Fri, 02 Jan, 16:17
Koert Kuipers different akka versions and spark Fri, 02 Jan, 17:11
Ted Yu   Re: different akka versions and spark Sat, 03 Jan, 05:11
Koert Kuipers     Re: different akka versions and spark Sat, 03 Jan, 17:22
Cody Koeninger       Re: different akka versions and spark Mon, 05 Jan, 14:56
Koert Kuipers         Re: different akka versions and spark Mon, 05 Jan, 16:27
Marcelo Vanzin           Re: different akka versions and spark Mon, 05 Jan, 22:08
Koert Kuipers             Re: different akka versions and spark Tue, 06 Jan, 15:29
Koert Kuipers               Re: different akka versions and spark Thu, 15 Jan, 23:22
Re: Apache Spark, Hadoop 2.2.0 without Yarn Integration
Moep   Re: Apache Spark, Hadoop 2.2.0 without Yarn Integration Fri, 02 Jan, 20:06
Sandy Ryza     Re: Apache Spark, Hadoop 2.2.0 without Yarn Integration Sun, 04 Jan, 19:50
Jerry Lam Spark or Tachyon: capture data lineage Fri, 02 Jan, 20:24
Haoyuan Li   Re: Spark or Tachyon: capture data lineage Fri, 02 Jan, 20:32
Sven Krasser     Re: Spark or Tachyon: capture data lineage Fri, 02 Jan, 21:43
Corey Nolet Submitting spark jobs through yarn-client Fri, 02 Jan, 21:20
Corey Nolet   Re: Submitting spark jobs through yarn-client Fri, 02 Jan, 22:02
Corey Nolet     Re: Submitting spark jobs through yarn-client Fri, 02 Jan, 22:46
Corey Nolet       Re: Submitting spark jobs through yarn-client Sat, 03 Jan, 04:35
Corey Nolet         Re: Submitting spark jobs through yarn-client Sat, 03 Jan, 07:59
Koert Kuipers           Re: Submitting spark jobs through yarn-client Sat, 03 Jan, 16:28
tfrisk Publishing streaming results to web interface Fri, 02 Jan, 22:45
Pankaj Narang   Re: Publishing streaming results to web interface Sat, 03 Jan, 02:20
Sathish Kumaran Vairavelu     Re: Publishing streaming results to web interface Sat, 03 Jan, 03:56
Silvio Fiorito   RE: Publishing streaming results to web interface Sat, 03 Jan, 13:50
RP How to convert String data to RDD. Sat, 03 Jan, 00:31
Ted Yu   Re: How to convert String data to RDD. Sat, 03 Jan, 03:57
Niranda Perera SparkSQL 1.2.0 sources API error Sat, 03 Jan, 05:36
Cheng Lian   Re: SparkSQL 1.2.0 sources API error Sat, 03 Jan, 06:01
Walrus theCat     Re: SparkSQL 1.2.0 sources API error Sun, 18 Jan, 07:37
Cheng, Hao       RE: SparkSQL 1.2.0 sources API error Mon, 19 Jan, 00:49
Ted Yu         Re: SparkSQL 1.2.0 sources API error Mon, 19 Jan, 00:59
rapelly kartheek Spark-1.2.0 build error Sat, 03 Jan, 06:03
Hafiz Mujadid getting number of partition per topic in kafka Sat, 03 Jan, 08:24
Akhil Das   Re: getting number of partition per topic in kafka Sat, 03 Jan, 17:28
Manoj Kumar Unable to build spark from source Sat, 03 Jan, 10:16
Sean Owen   Re: Unable to build spark from source Sat, 03 Jan, 10:23
bit1...@163.com   Re: Unable to build spark from source Sat, 03 Jan, 10:39
Manoj Kumar     Re: Unable to build spark from source Sat, 03 Jan, 11:38
Sean Owen     Re: Unable to build spark from source Sat, 03 Jan, 17:00
Manoj Kumar       Re: Unable to build spark from source Sat, 03 Jan, 17:10
Manoj Kumar         Re: Unable to build spark from source Sat, 03 Jan, 17:27
Simon Elliston Ball           Re: Unable to build spark from source Sat, 03 Jan, 17:59
Michael Armbrust             Re: Unable to build spark from source Sat, 03 Jan, 18:24
Manoj Kumar               Re: Unable to build spark from source Sun, 04 Jan, 06:47
bit1...@163.com sqlContext is undefined in the Spark Shell Sat, 03 Jan, 11:03
bit1...@163.com   Re: sqlContext is undefined in the Spark Shell Sat, 03 Jan, 11:18
Re: saveAsTextFile
Pankaj Narang   Re: saveAsTextFile Sat, 03 Jan, 12:07
Sanjay Subramanian     Re: saveAsTextFile Sat, 03 Jan, 16:44
Prannoy     Re: saveAsTextFile Thu, 15 Jan, 13:47
ankits   Re: saveAsTextFile Fri, 16 Jan, 02:03
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
May 2018230
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017184
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137