spark-user mailing list archives: December 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Daniel Haviv Re: Could not find the main class: org.apache.spark.deploy.SparkSubmit Tue, 16 Dec, 16:03
Ashish Rangole Re: Why so many tasks? Tue, 16 Dec, 16:04
manasdebashiskar Re: Spark 1.2 + Avro does not work in HDP2.2 Tue, 16 Dec, 16:19
Aniket Bhatnagar Re: Streaming | Partition count mismatch exception while saving data in RDD Tue, 16 Dec, 16:35
Sean Owen Re: Spark 1.2 + Avro does not work in HDP2.2 Tue, 16 Dec, 16:49
Akhil Das Re: Could not find the main class: org.apache.spark.deploy.SparkSubmit Tue, 16 Dec, 16:50
Luis Ángel Vicente Sánchez Kafka Receiver not recreated after executor died Tue, 16 Dec, 16:53
Luis Ángel Vicente Sánchez Re: Kafka Receiver not recreated after executor died Tue, 16 Dec, 16:56
Daniel Haviv Re: Could not find the main class: org.apache.spark.deploy.SparkSubmit Tue, 16 Dec, 17:03
Akhil Das Re: Could not find the main class: org.apache.spark.deploy.SparkSubmit Tue, 16 Dec, 17:05
Daniel Haviv Re: Could not find the main class: org.apache.spark.deploy.SparkSubmit Tue, 16 Dec, 17:16
Akhil Das Re: Could not find the main class: org.apache.spark.deploy.SparkSubmit Tue, 16 Dec, 17:18
Daniel Haviv Re: Could not find the main class: org.apache.spark.deploy.SparkSubmit Tue, 16 Dec, 17:22
Daniel Haviv Re: Could not find the main class: org.apache.spark.deploy.SparkSubmit Tue, 16 Dec, 17:33
bethesda Re: Appending an incrental value to each RDD record Tue, 16 Dec, 17:34
Tim Schweichler Re: integrating long-running Spark jobs with Thriftserver Tue, 16 Dec, 17:35
Jim Carroll No disk single pass RDD aggregation Tue, 16 Dec, 17:50
Zhan Zhang Re: Spark 1.2 + Avro file does not work in HDP2.2 Tue, 16 Dec, 17:51
Jim Carroll Re: No disk single pass RDD aggregation Tue, 16 Dec, 17:58
Jim Carroll Re: No disk single pass RDD aggregation Tue, 16 Dec, 18:17
Jim Carroll Spark handling of a file://xxxx.gz Uri Tue, 16 Dec, 18:22
Ganelin, Ilya Understanding disk usage with Accumulators Tue, 16 Dec, 18:23
Ganelin, Ilya Re: Understanding disk usage with Accumulators Tue, 16 Dec, 18:26
Aniket Bhatnagar Re: Spark 1.1.0 does not spawn more than 6 executors in yarn-client mode and ignores --num-executors Tue, 16 Dec, 18:27
Rahul Swaminathan Running Spark Job on Yarn from Java Code Tue, 16 Dec, 18:45
Imran Rashid Re: Multiple Filter Effiency Tue, 16 Dec, 18:49
Sam Flint Spark Sql on Yarn using python Tue, 16 Dec, 19:01
Judy Nash RE: Spark SQL API Doc & IsCached as SQL command Tue, 16 Dec, 19:02
tsu-wt Re: streaming linear regression is not building the model Tue, 16 Dec, 19:11
tsu-wt Cannot parse ListBuffer - StreamingLinearRegression Tue, 16 Dec, 19:29
Imran Rashid Re: NumberFormatException Tue, 16 Dec, 19:44
Shuai Zheng Control default partition when load a RDD from HDFS Tue, 16 Dec, 20:15
Ryan Williams Re: Data Loss - Spark streaming Tue, 16 Dec, 20:31
Davies Liu Re: Error when Applying schema to a dictionary with a Tuple as key Tue, 16 Dec, 20:44
Corey Nolet Spark eating exceptions in multi-threaded local mode Tue, 16 Dec, 20:56
Davies Liu Re: Error when Applying schema to a dictionary with a Tuple as key Tue, 16 Dec, 21:43
Harry Brundage Re: Spark handling of a file://xxxx.gz Uri Tue, 16 Dec, 21:57
cfregly Re: pyspark exception catch Tue, 16 Dec, 22:01
Sebastián Ramírez Re: Pyspark 1.1.1 error with large number of records - serializer.dump_stream(func(split_index, iterator), outfile) Tue, 16 Dec, 22:04
Jim Re: Spark handling of a file://xxxx.gz Uri Tue, 16 Dec, 22:13
Sebastián Ramírez Re: pyspark sc.textFile uses only 4 out of 32 threads per node Tue, 16 Dec, 22:25
durga S3 globbing Tue, 16 Dec, 23:35
Jim Carroll How do I stop the automatic partitioning of my RDD? Tue, 16 Dec, 23:43
buring "toArray","first" get the different result from one element RDD Wed, 17 Dec, 00:55
Jim Carroll Re: How do I stop the automatic partitioning of my RDD? Wed, 17 Dec, 00:56
Pala M Muthaia Re: Executor memory Wed, 17 Dec, 01:45
张建轶 when will the spark 1.3.0 be released? Wed, 17 Dec, 03:43
Marco Shaw Re: when will the spark 1.3.0 be released? Wed, 17 Dec, 03:56
Harihar Nahak Re: RDDs being cleaned too fast Wed, 17 Dec, 04:15
Ma,Xi 答复: 答复: Fetch Failed caused job failed. Wed, 17 Dec, 04:33
Jerry Raj Spark SQL DSL for joins? Wed, 17 Dec, 05:43
Andrew Ash Re: when will the spark 1.3.0 be released? Wed, 17 Dec, 05:44
Kyle Lin Re: Running Spark Job on Yarn from Java Code Wed, 17 Dec, 06:14
Sun, Rui RE: Control default partition when load a RDD from HDFS Wed, 17 Dec, 06:29
Jerry Raj Re: Spark SQL DSL for joins? Wed, 17 Dec, 06:35
Kenichi Maehashi Rolling upgrade Spark cluster Wed, 17 Dec, 06:40
Sun, Rui RE: pyspark sc.textFile uses only 4 out of 32 threads per node Wed, 17 Dec, 06:41
Tobias Pfeiffer Re: Spark SQL DSL for joins? Wed, 17 Dec, 06:42
buring Re: "toArray","first" get the different result from one element RDD Wed, 17 Dec, 06:50
Akhil Das Re: S3 globbing Wed, 17 Dec, 07:04
Kyle Lin Re: Unable to start Spark 1.3 after building:java.lang. NoClassDefFoundError: org/codehaus/jackson/map/deser/std/StdDeserializer Wed, 17 Dec, 07:07
Shixiong Zhu Re: NullPointerException on cluster mode when using foreachPartition Wed, 17 Dec, 07:56
aecc Locality Level Kryo Wed, 17 Dec, 07:56
Bhaskar Dutta Re: Rolling upgrade Spark cluster Wed, 17 Dec, 08:39
Larry Liu wordcount job slow while input from NFS mount Wed, 17 Dec, 08:47
Madabhattula Rajesh Kumar Re: when will the spark 1.3.0 be released? Wed, 17 Dec, 09:11
Nicholas Chammas Re: pyspark sc.textFile uses only 4 out of 32 threads per node Wed, 17 Dec, 10:14
Nicholas Chammas Re: Unable to start Spark 1.3 after building:java.lang. NoClassDefFoundError: org/codehaus/jackson/map/deser/std/StdDeserializer Wed, 17 Dec, 10:19
Xuelin Cao When will Spark SQL support building DB index natively? Wed, 17 Dec, 10:25
Hao Ren SchemaRDD.sample problem Wed, 17 Dec, 10:28
Sean Owen Re: Unable to start Spark 1.3 after building:java.lang. NoClassDefFoundError: org/codehaus/jackson/map/deser/std/StdDeserializer Wed, 17 Dec, 10:54
Morbious Re: java.lang.IllegalStateException: unread block data Wed, 17 Dec, 11:11
Marius Soutier Re: Intermittent test failures Wed, 17 Dec, 11:18
Morbious Hadoop and spark together Wed, 17 Dec, 11:19
Sun, Rui weird bytecode incompatability issue between spark-core jar from mvn repo and official spark prebuilt binary Wed, 17 Dec, 12:07
Sean Owen Re: weird bytecode incompatability issue between spark-core jar from mvn repo and official spark prebuilt binary Wed, 17 Dec, 12:39
sivarani Re: java.lang.IllegalStateException: unread block data Wed, 17 Dec, 12:43
Daniel Darabos Re: when will the spark 1.3.0 be released? Wed, 17 Dec, 12:46
Ashic Mahtab Are lazy values created once per node or once per partition? Wed, 17 Dec, 13:01
Amit Singh Hora Apache Spark 1.1.1 with Hbase 0.98.8-hadoop2 and hadoop 2.3.0 Wed, 17 Dec, 13:43
Gerard Maas Re: spark streaming kafa best practices ? Wed, 17 Dec, 13:43
Al Thompson spark-ec2 starts hdfs1, tachyon but not spark Wed, 17 Dec, 13:58
Aniket Bhatnagar Re: Are lazy values created once per node or once per partition? Wed, 17 Dec, 14:32
Shuai Zheng RE: Control default partition when load a RDD from HDFS Wed, 17 Dec, 15:00
Ted Yu Re: Apache Spark 1.1.1 with Hbase 0.98.8-hadoop2 and hadoop 2.3.0 Wed, 17 Dec, 15:49
Diego García Valverde RE: Control default partition when load a RDD from HDFS Wed, 17 Dec, 16:03
Guillermo Ortiz Get the value of DStream[(String, Iterable[String])] Wed, 17 Dec, 16:11
Jerry Lam Spark SQL 1.1.1 reading LZO compressed json files Wed, 17 Dec, 16:21
Steve Lewis Who is using Spark and related technologies for bioinformatics applications? Wed, 17 Dec, 16:27
Ted Yu Re: Spark SQL 1.1.1 reading LZO compressed json files Wed, 17 Dec, 16:27
Gerard Maas Re: Get the value of DStream[(String, Iterable[String])] Wed, 17 Dec, 16:28
Jerry Lam Re: Spark SQL 1.1.1 reading LZO compressed json files Wed, 17 Dec, 16:33
Ted Yu Re: Spark SQL 1.1.1 reading LZO compressed json files Wed, 17 Dec, 16:42
Juan Rodríguez Hortalá Implementing a spark version of Haskell's partition Wed, 17 Dec, 16:56
andy petrella Re: Implementing a spark version of Haskell's partition Wed, 17 Dec, 17:15
Larry Liu wordcount job slow while input from NFS mount Wed, 17 Dec, 17:35
Larryliu wordcount job slow while input from NFS mount Wed, 17 Dec, 17:38
Guillermo Ortiz Re: Get the value of DStream[(String, Iterable[String])] Wed, 17 Dec, 17:43
Nicholas Chammas Re: Unable to start Spark 1.3 after building:java.lang. NoClassDefFoundError: org/codehaus/jackson/map/deser/std/StdDeserializer Wed, 17 Dec, 17:49
Guillermo Ortiz Re: Get the value of DStream[(String, Iterable[String])] Wed, 17 Dec, 18:00
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Box list
Jan 2021141
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137