Mailing-List: contact issues-help@carbondata.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@carbondata.apache.org
Date: Fri, 7 Jul 2017 08:27:01 +0000 (UTC)
From: "Vandana Yadav (JIRA)" <jira@apache.org>
To: issues@carbondata.apache.org
Message-ID: <JIRA.13068663.1493794240000.192164.1499416021023@Atlassian.JIRA>
In-Reply-To: <JIRA.13068663.1493794240000@Atlassian.JIRA>
References: <JIRA.13068663.1493794240000@Atlassian.JIRA> <JIRA.13068663.1493794240286@jira-lw-us.apache.org>
Subject: [jira] [Closed] (CARBONDATA-1013) Unexpected characters displays in
 results while using join query.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Fri, 07 Jul 2017 08:27:09 -0000


     [ https://issues.apache.org/jira/browse/CARBONDATA-1013?page=3Dcom.atl=
assian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vandana Yadav closed CARBONDATA-1013.
-------------------------------------

This issue has been resolved and PR is merged


> Unexpected characters displays in results while using join query.
> -----------------------------------------------------------------
>
>                 Key: CARBONDATA-1013
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-101=
3
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-query
>    Affects Versions: 1.1.0
>         Environment: spark 2.1
>            Reporter: Vandana Yadav
>            Assignee: Srigopal Mohanty
>            Priority: Minor
>             Fix For: 1.1.0
>
>         Attachments: customer_C1.csv, payment_C1.csv, unwanted characters=
.png
>
>          Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> Unexpected characters displays in result-set while using join query.
> Steps to reproduce:
> 1) Create tables:
> a) In carbondata:
> table 1 : create table Comp_TABLE_ONE_JOIN (customer_uid String,customer_=
id int, gender String, first_name String, middle_name String, last_name Str=
ing,customer_address String, country String) STORED BY 'org.apache.carbonda=
ta.format' TBLPROPERTIES('DICTIONARY_EXCLUDE'=3D'customer_uid')
> table 2: create table Comp_TABLE_TWO_JOIN (customer_payment_id String,cus=
tomer_id int,payment_amount Decimal(15,5), payment_mode String,payment_deta=
ils String) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES('DICTION=
ARY_EXCLUDE'=3D'customer_payment_id')
> b) In hive:
> table 1: create table Comp_TABLE_ONE_JOIN_h (customer_uid String,customer=
_id int, gender String, first_name String, middle_name String, last_name St=
ring,customer_address String, country String)ROW FORMAT DELIMITED FIELDS TE=
RMINATED BY ",";
> table 2:create table Comp_TABLE_TWO_JOIN_h (customer_payment_id String,cu=
stomer_id int,payment_amount Decimal(15,5), payment_mode String,payment_det=
ails String) ROW FORMAT DELIMITED FIELDS TERMINATED BY ",";
> 2) Load Data :
> a) In Carbondata:
> table 1 : LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/customer_C1.csv' INTO=
 table Comp_TABLE_ONE_JOIN options ('DELIMITER'=3D',','QUOTECHAR'=3D'"','BA=
D_RECORDS_ACTION'=3D'FORCE','FILEHEADER'=3D'customer_uid,customer_id,gender=
,first_name,middle_name,last_name,customer_address,country')
> table 2:LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/payment_C1.csv' INTO ta=
ble Comp_TABLE_TWO_JOIN options ('DELIMITER'=3D',','QUOTECHAR'=3D'"','BAD_R=
ECORDS_ACTION'=3D'FORCE','FILEHEADER'=3D'customer_payment_id ,customer_id,p=
ayment_amount ,payment_mode, payment_details')
> b) In hive:
> table 1: LOAD DATA LOCAL INPATH '/home/knoldus/Desktop/csv/TestData2/Data=
/customer_C1.csv' INTO table Comp_TABLE_ONE_JOIN_h;
> table 2: LOAD DATA LOCAL INPATH '/home/knoldus/Desktop/csv/TestData2/Data=
/payment_C1.csv' INTO table Comp_TABLE_TWO_JOIN_h;
> 3)Execute query:
> select * from Comp_TABLE_ONE_JOIN join Comp_TABLE_TWO_JOIN on Comp_TABLE_=
ONE_JOIN.customer_id=3DComp_TABLE_TWO_JOIN.customer_id limit  2;
> Actual Result:
> a) In Carbondata:
> +---------------+--------------+---------+-------------+--------------+--=
----------+-------------------+------------+-----------------------+-------=
-------+-----------------+---------------+-----------------------------+--+
> | customer_uid  | customer_id  | gender  | first_name  | middle_name  | l=
ast_name  | customer_address  |  country   |  customer_payment_id  | custom=
er_id  | payment_amount  | payment_mode  |       payment_details       |
> +---------------+--------------+---------+-------------+--------------+--=
----------+-------------------+------------+-----------------------+-------=
-------+-----------------+---------------+-----------------------------+--+
> | UID31a31      | 31           | female  | fname31     | mname31      | l=
name31    | address 31        | country31  | Cust_payment_ID31a31  | 31    =
       | 193288.72000    |           |p=1F=06  |
> | UID31a31      | 31           | female  | fname31     | mname31      | l=
name31    | address 31        | country31  | Cust_payment_ID31a31  | 31    =
       | 193288.72000    |           |p=1F=06  |
> +---------------+--------------+---------+-------------+--------------+--=
----------+-------------------+------------+-----------------------+-------=
-------+-----------------+---------------+-----------------------------+--+
> 2 rows selected (0.499 seconds)
> b) In Hive
> ---------------+--------------+---------+-------------+--------------+---=
---------+-------------------+-----------+----------------------+----------=
----+-----------------+---------------+---------------------------------+--=
+
> | customer_uid  | customer_id  | gender  | first_name  | middle_name  | l=
ast_name  | customer_address  |  country  | customer_payment_id  | customer=
_id  | payment_amount  | payment_mode  |         payment_details         |
> +---------------+--------------+---------+-------------+--------------+--=
----------+-------------------+-----------+----------------------+---------=
-----+-----------------+---------------+---------------------------------+-=
-+
> | UID1a1        | 1            | female  | fname1      | mname1       | l=
name1     | address 1         | country1  | Cust_payment_ID1a1   | 1       =
     | 6235.12000      | debit         | details of the payment for : 1  |
> | UID1a1        | 1            | female  | fname1      | mname1       | l=
name1     | address 1         | country1  | Cust_payment_ID1a1   | 1       =
     | 6235.12000      | debit         | details of the payment for : 1  |
> +---------------+--------------+---------+-------------+--------------+--=
----------+-------------------+-----------+----------------------+---------=
-----+-----------------+---------------+---------------------------------+-=
-+
> 2 rows selected (0.224 seconds)
> Expected result: unwanted characters should not be displayed.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)