falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Murali Ramasami (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FALCON-2071) Falcon Spark SQL failing with Yarn Client Mode
Date Mon, 11 Jul 2016 15:22:11 GMT
Murali Ramasami created FALCON-2071:

             Summary: Falcon Spark SQL failing with Yarn Client Mode 
                 Key: FALCON-2071
                 URL: https://issues.apache.org/jira/browse/FALCON-2071
             Project: Falcon
          Issue Type: Bug
          Components: process
    Affects Versions: trunk
            Reporter: Murali Ramasami
            Priority: Critical
             Fix For: trunk

Falcon Spark SQL failing with Yarn Client Mode Only local python files are supported. Please
see the error message below from application log:

Error: Only local python files are supported: Parsed arguments:
  master                  yarn-client
  deployMode              client
  executorMemory          null
  executorCores           null
  totalExecutorCores      null
  propertiesFile          null
  driverMemory            null
  driverCores             null
  driverExtraClassPath    $PWD/*
  driverExtraLibraryPath  /usr/hdp/current/hadoop-client/lib/native
  driverExtraJavaOptions  -Dlog4j.configuration=spark-log4j.properties
  supervise               false
  queue                   null
  numExecutors            null

<?xml version="1.0" encoding="UTF-8"?>
<process name="spark-hivesql-client" xmlns="uri:falcon:process:0.1">
        <cluster name="primaryCluster">
            <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
    <workflow engine="spark" path="/user/hrt_qa/falcon-regression/spark_hivesql"/>
        <class>Spark Hive</class>
    <retry policy="periodic" delay="minutes(3)" attempts="3"/>
    <ACL owner="hrt_qa" group="users" permission="0x755"/>


This message was sent by Atlassian JIRA

View raw message