spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "KaiXinXIaoLei (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-22794) Spark Job failed, but the state is succeeded in Yarn Web
Date Fri, 15 Dec 2017 07:53:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-22794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

KaiXinXIaoLei updated SPARK-22794:
----------------------------------
    Description: 
I run a job in yarn mode, the job is failed:

{noformat}
17/12/15 11:55:16 INFO SharedState: Warehouse path is '/apps/hive/warehouse'.
Exception in thread "main" org.apache.spark.sql.AnalysisException: Path does not exist: hdfs://node1.huleilei.h3c.com:8020/user/hdfs/sss;
	at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:382)
	at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:370)
{noformat}


but in the yarn web, the job state is succeeded.

  was:
I run a job in yarn mode, the job is failed:

{noformat}
17/12/15 11:55:16 INFO SharedState: Warehouse path is '/apps/hive/warehouse'.
Exception in thread "main" org.apache.spark.sql.AnalysisException: Path does not exist: hdfs://node1.huleilei.h3c.com:8020/user/hdfs/sss;
	at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:382)
	at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:370)
{noformat}


but in the yarn web, the job state is succeeded:
!C:\Users\g15071\Downloads\task_is_succeeded_in_yarn_web.png!


> Spark Job failed, but the state is succeeded in Yarn Web
> --------------------------------------------------------
>
>                 Key: SPARK-22794
>                 URL: https://issues.apache.org/jira/browse/SPARK-22794
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 2.2.1
>            Reporter: KaiXinXIaoLei
>
> I run a job in yarn mode, the job is failed:
> {noformat}
> 17/12/15 11:55:16 INFO SharedState: Warehouse path is '/apps/hive/warehouse'.
> Exception in thread "main" org.apache.spark.sql.AnalysisException: Path does not exist:
hdfs://node1.huleilei.h3c.com:8020/user/hdfs/sss;
> 	at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:382)
> 	at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:370)
> {noformat}
> but in the yarn web, the job state is succeeded.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message