Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id DA3C4200C5B for ; Thu, 27 Apr 2017 22:27:04 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D8E21160BB2; Thu, 27 Apr 2017 20:27:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2D558160B9E for ; Thu, 27 Apr 2017 22:27:04 +0200 (CEST) Received: (qmail 99909 invoked by uid 500); 27 Apr 2017 20:27:03 -0000 Mailing-List: contact issues-help@carbondata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.apache.org Delivered-To: mailing list issues@carbondata.apache.org Received: (qmail 99900 invoked by uid 99); 27 Apr 2017 20:27:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Apr 2017 20:27:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 02FE2180BB5 for ; Thu, 27 Apr 2017 20:27:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.02 X-Spam-Level: X-Spam-Status: No, score=-4.02 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id V8xLVAkyJQPA for ; Thu, 27 Apr 2017 20:27:02 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id B60BB5FCCB for ; Thu, 27 Apr 2017 20:27:01 +0000 (UTC) Received: (qmail 99880 invoked by uid 99); 27 Apr 2017 20:27:00 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Apr 2017 20:27:00 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id D474FE01BC; Thu, 27 Apr 2017 20:27:00 +0000 (UTC) From: jackylk To: issues@carbondata.incubator.apache.org Reply-To: issues@carbondata.incubator.apache.org References: In-Reply-To: Subject: [GitHub] incubator-carbondata pull request #849: [CARBONDATA-992] Fix error of Exampl... Content-Type: text/plain Message-Id: <20170427202700.D474FE01BC@git1-us-west.apache.org> Date: Thu, 27 Apr 2017 20:27:00 +0000 (UTC) archived-at: Thu, 27 Apr 2017 20:27:05 -0000 Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/849#discussion_r113794079 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/CarbonDatasourceHadoopRelation.scala --- @@ -75,4 +75,16 @@ case class CarbonDatasourceHadoopRelation( ", " + "Table name :" + carbonTable.getFactTableName + ", Schema :" + tableSchema + " ]" } + override def insert(data: DataFrame, overwrite: Boolean): Unit = { + if (carbonRelation.output.size > CarbonCommonConstants.DEFAULT_MAX_NUMBER_OF_COLUMNS) { + sys.error("Maximum supported column by carbon is: " + + CarbonCommonConstants.DEFAULT_MAX_NUMBER_OF_COLUMNS) + } + if(data.logicalPlan.output.size >= carbonRelation.output.size) { + LoadTableByInsert(this, data.logicalPlan).run(sparkSession) + } else { + sys.error("Cannot insert into target table because column number are different") --- End diff -- Better to give more detail information in the log to describe the schema difference --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---