Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 45DE3106AC for ; Tue, 17 Mar 2015 10:27:24 +0000 (UTC) Received: (qmail 6887 invoked by uid 500); 17 Mar 2015 10:27:20 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 6817 invoked by uid 500); 17 Mar 2015 10:27:20 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 6807 invoked by uid 99); 17 Mar 2015 10:27:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Mar 2015 10:27:20 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ophchu@gmail.com designates 209.85.215.53 as permitted sender) Received: from [209.85.215.53] (HELO mail-la0-f53.google.com) (209.85.215.53) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Mar 2015 10:26:54 +0000 Received: by labjg1 with SMTP id jg1so4376589lab.2 for ; Tue, 17 Mar 2015 03:25:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=22r5b9FJ2paduYDjTFlH/KIT10gRMiy45pfJNYPxM14=; b=RKo5Iuc+14XK1S2YK4fNIB5lwXf9kpLUBv3WzqL43OQXVknWJ3Ps034EvUUy0ywiTT puAE8EBTr2lnP+YJANXhv7MkWDtzWZaBoCsjtRFbsTH2nLobLByVUG0xY5Wfi9UmbinL t0Uhct3HHy0AjrKNGAOYmor/w2oPNSuCdZ+IbVLyqVzL3p8jHWG0hHlON8rSaY5U6Gc2 gIM9Na0R7kMijKI1AKdtN3QLqwBleJZpCiVaM0eZmRnULqOEcW4pxk8KLgWtC2yaU7Uk pLByvzEX+yL/CYBEoDl4qnwA363MAqPEfv0fPYIB8S+Cpm6rmnX5odwXSeKV3DEWEMfy HsSw== X-Received: by 10.152.22.200 with SMTP id g8mr57952431laf.96.1426587923253; Tue, 17 Mar 2015 03:25:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.199.168 with HTTP; Tue, 17 Mar 2015 03:25:02 -0700 (PDT) From: Ophir Cohen Date: Tue, 17 Mar 2015 12:25:02 +0200 Message-ID: Subject: TreeNodeException: Unresolved plan found To: user@spark.apache.org Content-Type: multipart/alternative; boundary=089e0158c31a680f7205117962bf X-Virus-Checked: Checked by ClamAV on apache.org --089e0158c31a680f7205117962bf Content-Type: text/plain; charset=UTF-8 Hi Guys and great job! I encounter a weird problem on local mode and I'll be glad to solve it out... When trying to save ScehmaRDD into Hive table it fails with 'TreeNodeException: Unresolved plan found' I have found similar issue in Jira: https://issues.apache.org/jira/browse/SPARK-4825 but I'm using Spark 1.2.1 and I get the same error. In cluster mode it works as it should but failed in local mode. The code I'm using: *val hc = new HiveContext(new SparkContext(new SparkConf().setMaster("local[*]").setAppName("test-app")))val file = hc.parquetFile("")file.saveAsTable("my_table_name")* And I get the following error: *An exception or error caused a run to abort: Unresolved plan found, tree:'CreateTableAsSelect None, dailyprice, false, None ParquetRelation /home/ophchu/opr/repos/opr-spark/src/test/resources/aapl/derived/splits_divs/reuters/split_adj.pq/part-r-1.parquet, Some(Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml), org.apache.spark.sql.hive.HiveContext@a02632b, [] org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Unresolved plan found, tree:'CreateTableAsSelect None, dailyprice, false, None ParquetRelation /home/ophchu/opr/repos/opr-spark/src/test/resources/aapl/derived/splits_divs/reuters/split_adj.pq/part-r-1.parquet, Some(Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml), org.apache.spark.sql.hive.HiveContext@a02632b, []* Again, its happened only when running on local mode. Thanks! Ophir --089e0158c31a680f7205117962bf Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Guys and great job!
I= encounter a weird problem on local mode and I'll be glad to solve it o= ut...
When trying to save ScehmaRDD into Hive table it fails with = 'TreeNodeException: Unresolved plan found'
I have found si= milar issue in Jira: https://issues.apache.org/jira/browse/SPARK-4825 but I'm usi= ng Spark 1.2.1 and I get the same error.
In cluster mode it works = as it should but failed in local mode.
The code I'm using:
=
val hc =3D new HiveContext(new SparkContext(new SparkConf().setMaste= r("local[*]").setAppName("test-app")))
val file =3D = hc.parquetFile("<path to my file>")
file.saveAsTable(&qu= ot;my_table_name")


And I get the f= ollowing error:

An exception or error caused a run= to abort: Unresolved plan found, tree:
'CreateTableAsSelect None, d= ailyprice, false, None
=C2=A0ParquetRelation /home/ophchu/opr/repos/opr-= spark/src/test/resources/aapl/derived/splits_divs/reuters/split_adj.pq/part= -r-1.parquet, Some(Configuration: core-default.xml, core-site.xml, mapred-d= efault.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.= xml, hdfs-site.xml), org.apache.spark.sql.hive.HiveContext@a02632b, []
= org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Unresolved = plan found, tree:
'CreateTableAsSelect None, dailyprice, false, None=
=C2=A0ParquetRelation /home/ophchu/opr/repos/opr-spark/src/test/resourc= es/aapl/derived/splits_divs/reuters/split_adj.pq/part-r-1.parquet, Some(Con= figuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-sit= e.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml), o= rg.apache.spark.sql.hive.HiveContext@a02632b, []


= Again, its happened only when running on local mode.
Thanks!<= br>
Ophir
--089e0158c31a680f7205117962bf--