spark-user mailing list archives: August 2014

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Re: Spark job finishes then command shell is blocked/hangs?
bumble123   Re: Spark job finishes then command shell is blocked/hangs? Fri, 01 Aug, 00:14
Re: Example standalone app error!
Tathagata Das   Re: Example standalone app error! Fri, 01 Aug, 00:36
Alex Minnaar   RE: Example standalone app error! Fri, 01 Aug, 18:01
Re: spark.scheduler.pool seems not working in spark streaming
Tathagata Das   Re: spark.scheduler.pool seems not working in spark streaming Fri, 01 Aug, 00:37
Tathagata Das     Re: spark.scheduler.pool seems not working in spark streaming Fri, 01 Aug, 00:41
durin sbt package failed: wrong libraryDependencies for spark-streaming? Fri, 01 Aug, 00:48
Tathagata Das   Re: sbt package failed: wrong libraryDependencies for spark-streaming? Fri, 01 Aug, 01:12
durin     Re: sbt package failed: wrong libraryDependencies for spark-streaming? Fri, 01 Aug, 01:18
durin       Re: sbt package failed: wrong libraryDependencies for spark-streaming? Fri, 01 Aug, 01:55
Tathagata Das         Re: sbt package failed: wrong libraryDependencies for spark-streaming? Fri, 01 Aug, 02:19
durin           Re: sbt package failed: wrong libraryDependencies for spark-streaming? Fri, 01 Aug, 02:33
Sung Hwan Chung Accessing spark context from executors? Fri, 01 Aug, 01:16
Sung Hwan Chung   Re: Accessing spark context from executors? Fri, 01 Aug, 01:39
Sean Owen   Re: Accessing spark context from executors? Fri, 01 Aug, 10:33
Re: spark.shuffle.consolidateFiles seems not working
Aaron Davidson   Re: spark.shuffle.consolidateFiles seems not working Fri, 01 Aug, 01:58
Jianshi Huang     Re: spark.shuffle.consolidateFiles seems not working Fri, 01 Aug, 16:34
SK Extracting an element from the feature vector in LabeledPoint Fri, 01 Aug, 02:01
Yanbo Liang   Re: Extracting an element from the feature vector in LabeledPoint Fri, 01 Aug, 02:24
Sean Owen   Re: Extracting an element from the feature vector in LabeledPoint Fri, 01 Aug, 10:19
SK     Re: Extracting an element from the feature vector in LabeledPoint Fri, 01 Aug, 17:22
Sean Owen       Re: Extracting an element from the feature vector in LabeledPoint Fri, 01 Aug, 17:47
LPG         Re: Extracting an element from the feature vector in LabeledPoint Fri, 22 Aug, 10:19
Re: HiveContext is creating metastore warehouse locally instead of in hdfs
chenjie   Re: HiveContext is creating metastore warehouse locally instead of in hdfs Fri, 01 Aug, 02:09
Andrew Lee     Re: HiveContext is creating metastore warehouse locally instead of in hdfs Fri, 01 Aug, 03:17
chenjie       Re: HiveContext is creating metastore warehouse locally instead of in hdfs Fri, 01 Aug, 08:39
salemi spark-submit registers the driver twice Fri, 01 Aug, 02:16
Re: Fwd: pyspark crash on mesos
daijia   Re: Fwd: pyspark crash on mesos Fri, 01 Aug, 02:29
Brad Miller     Re: Fwd: pyspark crash on mesos Fri, 01 Aug, 20:14
Re: Issue with Spark on EC2 using spark-ec2 script
ratabora   Re: Issue with Spark on EC2 using spark-ec2 script Fri, 01 Aug, 02:37
Dean Wampler     Re: Issue with Spark on EC2 using spark-ec2 script Fri, 01 Aug, 13:32
Nick Pentreath       Re: Issue with Spark on EC2 using spark-ec2 script Thu, 07 Aug, 11:39
rkishore999         Re: Issue with Spark on EC2 using spark-ec2 script Sat, 16 Aug, 15:38
Re: SQLCtx cacheTable
Michael Armbrust   Re: SQLCtx cacheTable Fri, 01 Aug, 02:42
Gurvinder Singh     Re: SQLCtx cacheTable Fri, 01 Aug, 06:26
Michael Armbrust       Re: SQLCtx cacheTable Sun, 03 Aug, 00:33
Gurvinder Singh         Re: SQLCtx cacheTable Mon, 04 Aug, 06:35
Michael Armbrust           Re: SQLCtx cacheTable Mon, 04 Aug, 20:57
Gurvinder Singh             Re: SQLCtx cacheTable Tue, 05 Aug, 06:52
Bin [GraphX] The best way to construct a graph Fri, 01 Aug, 03:23
shijiaxin   Re: [GraphX] The best way to construct a graph Fri, 01 Aug, 04:47
Bin     Re:Re: [GraphX] The best way to construct a graph Fri, 01 Aug, 05:11
shijiaxin       Re: Re:Re: [GraphX] The best way to construct a graph Fri, 01 Aug, 06:38
Bin         Re:Re: Re:Re: [GraphX] The best way to construct a graph Fri, 01 Aug, 06:40
Ankur Dave   Re: [GraphX] The best way to construct a graph Fri, 01 Aug, 07:33
Re:Re: java.util.concurrent.TimeoutException: Futures timed out after [30 seconds]
Bin   Re:Re: java.util.concurrent.TimeoutException: Futures timed out after [30 seconds] Fri, 01 Aug, 03:28
Haiyang Fu     Re: Re: java.util.concurrent.TimeoutException: Futures timed out after [30 seconds] Fri, 01 Aug, 04:05
Re: configuration needed to run twitter(25GB) dataset
shijiaxin   Re: configuration needed to run twitter(25GB) dataset Fri, 01 Aug, 04:40
Ankur Dave     Re: configuration needed to run twitter(25GB) dataset Fri, 01 Aug, 07:16
shijiaxin       Re: configuration needed to run twitter(25GB) dataset Fri, 01 Aug, 09:12
Ankur Dave         Re: configuration needed to run twitter(25GB) dataset Fri, 01 Aug, 10:45
gpatcham Issue using kryo serilization Fri, 01 Aug, 05:23
Andrew Ash   Re: Issue using kryo serilization Fri, 01 Aug, 05:45
gpatcham     Re: Issue using kryo serilization Fri, 01 Aug, 05:51
ratabora       Re: Issue using kryo serilization Fri, 01 Aug, 06:15
gpatcham         Re: Issue using kryo serilization Fri, 01 Aug, 06:20
gpatcham           Re: Issue using kryo serilization Fri, 01 Aug, 18:54
Re: java.lang.OutOfMemoryError: Java heap space
Haiyang Fu   Re: java.lang.OutOfMemoryError: Java heap space Fri, 01 Aug, 05:29
Haiyang Fu     Re: java.lang.OutOfMemoryError: Java heap space Fri, 01 Aug, 05:29
dizzy5112 graphx and subgraph query Fri, 01 Aug, 06:42
Re: Ports required for running spark
Andrew Ash   Re: Ports required for running spark Fri, 01 Aug, 06:46
Re: Hbase
Akhil Das   Re: Hbase Fri, 01 Aug, 06:47
Madabhattula Rajesh Kumar     Re: Hbase Fri, 01 Aug, 11:14
Akhil Das       Re: Hbase Fri, 01 Aug, 14:27
Madabhattula Rajesh Kumar         Re: Hbase Fri, 01 Aug, 20:08
Aniket Bhatnagar RDD to DStream Fri, 01 Aug, 08:25
Aniket Bhatnagar   Re: RDD to DStream Fri, 01 Aug, 17:21
Mayur Rustagi     Re: RDD to DStream Fri, 01 Aug, 22:37
Aniket Bhatnagar       Re: RDD to DStream Mon, 04 Aug, 07:43
Tathagata Das         Re: RDD to DStream Thu, 07 Aug, 01:32
Andrei Iterator over RDD in PySpark Fri, 01 Aug, 08:38
Aaron Davidson   Re: Iterator over RDD in PySpark Fri, 01 Aug, 17:49
Andrei     Re: Iterator over RDD in PySpark Fri, 01 Aug, 22:04
Aaron Davidson       Re: Iterator over RDD in PySpark Sat, 02 Aug, 01:46
Andrei         Re: Iterator over RDD in PySpark Sat, 02 Aug, 10:14
Dariusz Kobylarz Spark-sql with Tachyon cache Fri, 01 Aug, 08:42
Michael Armbrust   Re: Spark-sql with Tachyon cache Sun, 03 Aug, 01:44
redocpot Environment Variables question Fri, 01 Aug, 09:02
Martin Goodson Reading from HDFS no faster than reading from S3 - how to tell if data locality respected? Fri, 01 Aug, 09:44
Martin Goodson   Re: Reading from HDFS no faster than reading from S3 - how to tell if data locality respected? Mon, 04 Aug, 15:36
Ankur Dave Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Fri, 01 Aug, 10:42
nit   Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Fri, 01 Aug, 18:15
Holden Karau     Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Fri, 01 Aug, 22:15
Holden Karau       Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Fri, 01 Aug, 22:15
Patrick Wendell         Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Fri, 01 Aug, 22:27
Shivaram Venkataraman           Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Fri, 01 Aug, 22:30
Shivaram Venkataraman         Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Fri, 01 Aug, 22:28
Patrick Wendell           Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Fri, 01 Aug, 22:31
DB Tsai             Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Sat, 02 Aug, 21:30
Patrick Wendell               Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2 Sun, 03 Aug, 17:47
Re: Readin from Amazon S3 behaves inconsistently: return different number of lines...
Sean Owen   Re: Readin from Amazon S3 behaves inconsistently: return different number of lines... Fri, 01 Aug, 11:00
nit     Re: Readin from Amazon S3 behaves inconsistently: return different number of lines... Fri, 01 Aug, 15:09
Chris Fregly       Re: Readin from Amazon S3 behaves inconsistently: return different number of lines... Sun, 31 Aug, 05:56
Arun Kumar Spark 0.9.2 sbt build issue Fri, 01 Aug, 11:16
Re: access hdfs file name in map()
Roberto Torella   Re: access hdfs file name in map() Fri, 01 Aug, 11:38
Xu (Simon) Chen     Re: access hdfs file name in map() Fri, 01 Aug, 17:42
Roberto Torella       Re: access hdfs file name in map() Mon, 04 Aug, 10:17
Re: streaming window not behaving as advertised (v1.0.1)
Venkat Subramanian   Re: streaming window not behaving as advertised (v1.0.1) Fri, 01 Aug, 14:12
RodrigoB   Re: streaming window not behaving as advertised (v1.0.1) Fri, 01 Aug, 14:37
Tathagata Das     Re: streaming window not behaving as advertised (v1.0.1) Wed, 06 Aug, 02:37
Patrick McGloin Spark SQL, Parquet and Impala Fri, 01 Aug, 14:18
Patrick McGloin   Re: Spark SQL, Parquet and Impala Fri, 01 Aug, 14:20
Michael Armbrust     Re: Spark SQL, Parquet and Impala Fri, 01 Aug, 17:32
Patrick McGloin       Re: Spark SQL, Parquet and Impala Sat, 02 Aug, 08:30
Andrew Lee   RE: Spark SQL, Parquet and Impala Sat, 02 Aug, 21:32
salemi Tasks fail when ran in cluster but they work fine when submited using local local Fri, 01 Aug, 14:30
salemi   Re: Tasks fail when ran in cluster but they work fine when submited using local local Mon, 04 Aug, 03:28
Julien Naour Accumulator and Accumulable vs classic MR Fri, 01 Aug, 14:38
Mayur Rustagi   Re: Accumulator and Accumulable vs classic MR Fri, 01 Aug, 22:44
Re: how to publish spark inhouse?
Koert Kuipers   Re: how to publish spark inhouse? Fri, 01 Aug, 15:38
Re: Number of partitions and Number of concurrent tasks
Daniel Siegmann   Re: Number of partitions and Number of concurrent tasks Fri, 01 Aug, 15:49
Nicholas Chammas     Re: Number of partitions and Number of concurrent tasks Fri, 01 Aug, 16:05
Daniel Siegmann       Re: Number of partitions and Number of concurrent tasks Fri, 01 Aug, 20:21
Nicholas Chammas What should happen if we try to cache more data than the cluster can hold in memory? Fri, 01 Aug, 16:24
Sean Owen   Re: What should happen if we try to cache more data than the cluster can hold in memory? Fri, 01 Aug, 16:39
Nicholas Chammas     Re: What should happen if we try to cache more data than the cluster can hold in memory? Fri, 01 Aug, 17:17
Patrick Wendell       Re: What should happen if we try to cache more data than the cluster can hold in memory? Mon, 04 Aug, 08:10
Patrick Wendell         Re: What should happen if we try to cache more data than the cluster can hold in memory? Mon, 04 Aug, 08:11
Nicholas Chammas         Re: What should happen if we try to cache more data than the cluster can hold in memory? Mon, 04 Aug, 18:37
RE: Data from Mysql using JdbcRDD
srinivas   RE: Data from Mysql using JdbcRDD Fri, 01 Aug, 16:25
chutium     RE: Data from Mysql using JdbcRDD Mon, 04 Aug, 15:39
N.Venkata Naga Ravi Spark SQL Query Plan optimization Fri, 01 Aug, 17:13
Michael Armbrust   Re: Spark SQL Query Plan optimization Sun, 03 Aug, 01:49
Kanwaldeep Spark Streaming : Could not compute split, block not found Fri, 01 Aug, 17:55
Tathagata Das   Re: Spark Streaming : Could not compute split, block not found Fri, 01 Aug, 18:56
Kanwaldeep     Re: Spark Streaming : Could not compute split, block not found Fri, 01 Aug, 21:16
Tathagata Das       Re: Spark Streaming : Could not compute split, block not found Fri, 01 Aug, 21:41
Kanwaldeep         Re: Spark Streaming : Could not compute split, block not found Fri, 01 Aug, 22:52
Tathagata Das           Re: Spark Streaming : Could not compute split, block not found Fri, 01 Aug, 22:58
Kanwaldeep             Re: Spark Streaming : Could not compute split, block not found Fri, 01 Aug, 23:10
Tathagata Das               Re: Spark Streaming : Could not compute split, block not found Sat, 02 Aug, 02:04
Kanwaldeep                 Re: Spark Streaming : Could not compute split, block not found Sat, 02 Aug, 05:26
Tathagata Das                   Re: Spark Streaming : Could not compute split, block not found Tue, 05 Aug, 00:01
Sujee Maniyam persisting RDD in memory Fri, 01 Aug, 17:59
Mayur Rustagi   Re: persisting RDD in memory Fri, 01 Aug, 20:52
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
May 2018322
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017184
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137