spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Nitschinger (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-5921) Task/Stage always in pending on foreachPartition
Date Fri, 20 Feb 2015 09:53:11 GMT

     [ https://issues.apache.org/jira/browse/SPARK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Michael Nitschinger updated SPARK-5921:
---------------------------------------
    Summary: Task/Stage always in pending on foreachPartition  (was: Task/Stage always in
pending with 1 partition on foreachPartition)

> Task/Stage always in pending on foreachPartition
> ------------------------------------------------
>
>                 Key: SPARK-5921
>                 URL: https://issues.apache.org/jira/browse/SPARK-5921
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 1.2.0, 1.2.1
>         Environment: OS X, standalone cluster with 1 or more slaves.
>            Reporter: Michael Nitschinger
>
> I've got some very simple code:
> sc
>  .parallelize(Seq("foo", "bar), 1)
>  .foreachPartition({ iter =>
>   println(iter)
> })
> when I run this against a standalone cluster the application itself completes, but the
job is always active (never completes),because the stage is always pending.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message