falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-2071) Falcon Spark SQL failing with Yarn Client Mode
Date Tue, 12 Jul 2016 12:16:20 GMT

    [ https://issues.apache.org/jira/browse/FALCON-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372788#comment-15372788
] 

ASF GitHub Bot commented on FALCON-2071:
----------------------------------------

GitHub user peeyushb opened a pull request:

    https://github.com/apache/falcon/pull/220

    FALCON-2071 : Falcon Spark SQL failing with Yarn Client Mode

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/peeyushb/falcon FALCON-2071

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/falcon/pull/220.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #220
    
----
commit 246622c6f4ed09a861252ef0e51f52f2599fbff3
Author: peeyush b <pbishnoi@hortonworks.com>
Date:   2016-07-12T12:13:51Z

    FALCON-2071 : Falcon Spark SQL failing with Yarn Client Mode

----


> Falcon Spark SQL failing with Yarn Client Mode 
> -----------------------------------------------
>
>                 Key: FALCON-2071
>                 URL: https://issues.apache.org/jira/browse/FALCON-2071
>             Project: Falcon
>          Issue Type: Bug
>          Components: process
>    Affects Versions: trunk
>            Reporter: Murali Ramasami
>            Assignee: Peeyush Bishnoi
>            Priority: Critical
>             Fix For: trunk
>
>
> Falcon Spark SQL failing with Yarn Client Mode with error message "Only local python
files are supported". Please see the error message below from application log:
> {noformat}
> Error: Only local python files are supported: Parsed arguments:
>   master                  yarn-client
>   deployMode              client
>   executorMemory          null
>   executorCores           null
>   totalExecutorCores      null
>   propertiesFile          null
>   driverMemory            null
>   driverCores             null
>   driverExtraClassPath    $PWD/*
>   driverExtraLibraryPath  /usr/hdp/current/hadoop-client/lib/native
>   driverExtraJavaOptions  -Dlog4j.configuration=spark-log4j.properties
>   supervise               false
>   queue                   null
>   numExecutors            null
> {noformat}
> Process
> {noformat}
> <?xml version="1.0" encoding="UTF-8"?>
> <process name="spark-hivesql-client" xmlns="uri:falcon:process:0.1">
>     <clusters>
>         <cluster name="primaryCluster">
>             <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
>         </cluster>
>     </clusters>
>     <parallel>1</parallel>
>     <order>FIFO</order>
>     <frequency>minutes(5)</frequency>
>     <timezone>UTC</timezone>
>     <workflow engine="spark" path="/user/hrt_qa/falcon-regression/spark_hivesql"/>
>     <spark-attributes>
>         <master>yarn-client</master>
>         <name>Spark-Hive</name>
>         <class>Spark Hive</class>
>         <jar>/user/hrt_qa/falcon-regression/spark_hivesql/spark-hivesql.py</jar>
>     </spark-attributes>
>     <retry policy="periodic" delay="minutes(3)" attempts="3"/>
>     <ACL owner="hrt_qa" group="users" permission="0x755"/>
> </process>
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message