Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 60369200BAE for ; Fri, 14 Oct 2016 04:47:30 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5ECFF160AF6; Fri, 14 Oct 2016 02:47:30 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A6378160AE4 for ; Fri, 14 Oct 2016 04:47:29 +0200 (CEST) Received: (qmail 7634 invoked by uid 500); 14 Oct 2016 02:47:28 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 7625 invoked by uid 99); 14 Oct 2016 02:47:28 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Oct 2016 02:47:28 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 5C1641A0036 for ; Fri, 14 Oct 2016 02:47:28 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -6.219 X-Spam-Level: X-Spam-Status: No, score=-6.219 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id wV58X5b5QGl9 for ; Fri, 14 Oct 2016 02:47:27 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 96E1E5F396 for ; Fri, 14 Oct 2016 02:47:26 +0000 (UTC) Received: (qmail 6602 invoked by uid 99); 14 Oct 2016 02:47:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Oct 2016 02:47:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id A8B722C4C7B for ; Fri, 14 Oct 2016 02:47:20 +0000 (UTC) Date: Fri, 14 Oct 2016 02:47:20 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@carbondata.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CARBONDATA-285) Use path parameter in Spark datasource API MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 14 Oct 2016 02:47:30 -0000 [ https://issues.apache.org/jira/browse/CARBONDATA-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573945#comment-15573945 ] ASF GitHub Bot commented on CARBONDATA-285: ------------------------------------------- Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/212#discussion_r83350430 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -861,9 +861,11 @@ private[sql] case class CreateTable(cm: tableModel) extends RunnableCommand { val tablePath = catalog.createTableFromThrift(tableInfo, dbName, tbName, null)(sqlContext) try { sqlContext.sql( - s"""CREATE TABLE $dbName.$tbName USING carbondata""" + - s""" OPTIONS (tableName "$dbName.$tbName", tablePath "$tablePath") """) - .collect + s""" + | CREATE TABLE $dbName.$tbName + | USING carbondata + | OPTIONS (path "$tablePath") --- End diff -- There would be backward compatability issues here. Old tables cannot work because `path` was not present. > Use path parameter in Spark datasource API > ------------------------------------------ > > Key: CARBONDATA-285 > URL: https://issues.apache.org/jira/browse/CARBONDATA-285 > Project: CarbonData > Issue Type: Improvement > Components: spark-integration > Affects Versions: 0.1.0-incubating > Reporter: Jacky Li > Fix For: 0.2.0-incubating > > > Currently, when using carbon with spark datasource API, it need to give database name and table name as parameter, it is not the normal way of datasource API usage. In this PR, database name and table name is not required to give, user need to specify the `path` parameter (indicating the path to table folder) only when using datasource API -- This message was sent by Atlassian JIRA (v6.3.4#6332)