Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2C1F3200C09 for ; Wed, 25 Jan 2017 13:36:34 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 27F52160B50; Wed, 25 Jan 2017 12:36:34 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id F25EA160B4E for ; Wed, 25 Jan 2017 13:36:32 +0100 (CET) Received: (qmail 95578 invoked by uid 500); 25 Jan 2017 12:36:32 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 95569 invoked by uid 99); 25 Jan 2017 12:36:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Jan 2017 12:36:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id A7CA31A063B for ; Wed, 25 Jan 2017 12:36:31 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.592 X-Spam-Level: * X-Spam-Status: No, score=1.592 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_BADIPHTTP=2, KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-2.999, UPPERCASE_50_75=0.791] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 3qYC1YMq0zRt for ; Wed, 25 Jan 2017 12:36:28 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id B4C3D5FC9C for ; Wed, 25 Jan 2017 12:36:27 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id C7CCDE0312 for ; Wed, 25 Jan 2017 12:36:26 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 74C1F25288 for ; Wed, 25 Jan 2017 12:36:26 +0000 (UTC) Date: Wed, 25 Jan 2017 12:36:26 +0000 (UTC) From: "Manish Gupta (JIRA)" To: issues@carbondata.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CARBONDATA-668) Dataloads fails for this particular query MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 25 Jan 2017 12:36:34 -0000 [ https://issues.apache.org/jira/browse/CARBONDATA-668?page=3Dcom.atlas= sian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D= 15837650#comment-15837650 ]=20 Manish Gupta commented on CARBONDATA-668: ----------------------------------------- [~swati.rao]...I have added the test case in CI with the same queries in ji= ra and there is no failure in CI. Please check the link below. http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/org.apache.carbondata= $carbondata-spark-common-test/717/testReport/org.apache.carbondata.spark.te= stsuite.dataload/TestDataLoadWithColumnsMoreThanSchema/test_for_duplicate_c= olumn_name_in_the_Fileheader_options_in_load_command/ Can you please re-verify once with the latest code. > Dataloads fails for this particular query > ------------------------------------------ > > Key: CARBONDATA-668 > URL: https://issues.apache.org/jira/browse/CARBONDATA-668 > Project: CarbonData > Issue Type: Bug > Components: data-load > Affects Versions: 1.0.0-incubating > Environment: Spark-1.6 > Reporter: SWATI RAO > Assignee: Manish Gupta > Priority: Minor > Fix For: 1.0.0-incubating > > Attachments: seq_500Records.csv > > Time Spent: 40m > Remaining Estimate: 0h > > Dataloads fail when no. of column in load query is greater than the no. = of column in create table > Create Query: create table smart_500_DE (MSISDN string,IMSI string,IMEI s= tring,INTERFACEID int,GROUPID int,GGSN_ID double,SGSN_ID double,SESSION_IND= ICATOR int,BEGIN_TIME double,BEGIN_TIME_MSEL int,END_TIME double,END_TIME_M= SEL int,PROT_CATEGORY int,PROT_TYPE int,L7_CARRIER_PROT int,SUB_PROT_TYPE i= nt,SID double,PROBEID double,ENCRYPT_VERSION int,ROAMING_TYPE int,ROAM_DIRE= CTION int,MS_IP string,SERVER_IP string,MS_PORT int,SERVER_DECIMAL Decimal,= APN string,SGSN_SIG_IP string,GGSN_SIG_IP_BigInt_NEGATIVE bigint,SGSN_USER_= IP string,GGSN_USER_IP string,MCC string,MNC string,RAT int,LAC string,RAC = string,SAC string,CI string,BROWSER_TIMESTAMP timestamp,TCP_CONN_STATES int= ,TCP_STATES_BIGINTPOSITIVE int,TCP_WIN_SIZE int,TCP_MSS int,TCP_CONN_TIMES = int,TCP_CONN_2_FAILED_TIMES int,TCP_CONN_3_FAILED_TIMES int,HOST string,STR= EAMING_URL string,GET_STREAMING_FAILED_CODE int,GET_STREAMING_FLAG int,GET_= NUM int,GET_SUCCEED_NUM int,GET_RETRANS_NUM int,GET_TIMEOUT_NUM int,INTBUFF= ER_FST_FLAG int,INTBUFFER_FULL_FLAG int,STALL_NUM int,VIDEO_FRAME_RATE int,= VIDEO_CODEC_ID string,VIDEO_WIDTH int,VIDEO_HEIGHT int,AUDIO_CODEC_ID strin= g,MEDIA_FILE_TYPE int,PLAY_STATE int,STREAMING_FLAG int,TCP_STATUS_INDICATO= R int,DISCONNECTION_FLAG int,FAILURE_CODE int,FLAG int,TAC string,ECI strin= g,TCP_SYN_TIME_MSEL int,TCP_FST_SYN_DIRECTION int,RAN_NE_USER_IP string,HOM= EMCC string,HOMEMNC string,CHARGE_FLAG int,PREPAID_FLAG int,USER_AGENT stri= ng,MS_WIN_STAT_TOTAL_NUM int,MS_WIN_STAT_SMALL_NUM int,MS_ACK_TO_1STGET_DEL= AY int,SERVER_ACK_TO_1STDATA_DELAY int,STREAMING_TYPE int,SOURCE_VIDEO_QUAL= ITY int,TETHERING_FLAG int,CARRIER_ID double,LAYER1ID int,LAYER2ID int,LAYE= R3ID int,LAYER4ID int,LAYER5ID int,LAYER6ID int,CHARGING_RULE_BASE_NAME str= ing,SP string,EXTENDED_URL string,SV string,FIRST_SAI_CGI_ECGI string,EXTEN= DED_URL_OTHER string,SIGNALING_USE_FLAG int,DNS_RETRANS_NUM int,DNS_FAIL_CO= DE int,FIRST_RAT int,MS_INDICATOR string,LAST_SAI_CGI_ECGI string,LAST_RAT = int,FIRST_LONGITUDE double,FIRST_LATITUDE double,FIRST_ALTITUDE int,FIRST_R= ASTERLONGITUDE double,FIRST_RASTERLATITUDE double,FIRST_RASTERALTITUDE int,= FIRST_FREQUENCYSPOT int,FIRST_CLUTTER int,FIRST_USERBEHAVIOR int,FIRST_SPEE= D int,FIRST_CREDIBILITY int,LAST_LONGITUDE double,LAST_LATITUDE double,LAST= _ALTITUDE int,LAST_RASTERLONGITUDE double,LAST_RASTERLATITUDE double,LAST_R= ASTERALTITUDE int,LAST_FREQUENCYSPOT int,LAST_CLUTTER int,LAST_USERBEHAVIOR= int,LAST_SPEED int,LAST_CREDIBILITY int,IMEI_CIPHERTEXT string,APP_ID int,= DOMAIN_NAME string,STREAMING_CACHE_IP string,STOP_LONGER_THAN_MIN_THRESHOLD= int,STOP_LONGER_THAN_MAX_THRESHOLD int,PLAY_END_STAT int,STOP_START_TIME1 = double,STOP_END_TIME1 double,STOP_START_TIME2 double,STOP_END_TIME2 double,= STOP_START_TIME3 double,STOP_END_TIME3 double,STOP_START_TIME4 double,STOP_= END_TIME4 double,STOP_START_TIME5 double,STOP_END_TIME5 double,STOP_START_T= IME6 double,STOP_END_TIME6 double,STOP_START_TIME7 double,STOP_END_TIME7 do= uble,STOP_START_TIME8 double,STOP_END_TIME8 double,STOP_START_TIME9 double,= STOP_END_TIME9 double,STOP_START_TIME10 double,STOP_END_TIME10 double,FAIL_= CLASS double,RECORD_TYPE double,NODATA_COUNT double,VIDEO_NODATA_DURATION d= ouble,VIDEO_SMOOTH_DURATION double,VIDEO_SD_DURATION double,VIDEO_HD_DURATI= ON double,VIDEO_UHD_DURATION double,VIDEO_FHD_DURATION double,FLUCTUATION d= ouble,START_DOWNLOAD_THROUGHPUT double,L7_UL_GOODPUT_FULL_MSS double,SESSIO= NKEY string,FIRST_UCELLID double,LAST_UCELLID double,UCELLID1 double,LONGIT= UDE1 double,LATITUDE1 double,UCELLID2 double,LONGITUDE2 double,LATITUDE2 do= uble,UCELLID3 double,LONGITUDE3 double,LATITUDE3 double,UCELLID4 double,LON= GITUDE4 double,LATITUDE4 double,UCELLID5 double,LONGITUDE5 double,LATITUDE5= double,UCELLID6 double,LONGITUDE6 double,LATITUDE6 double,UCELLID7 double,= LONGITUDE7 double,LATITUDE7 double,UCELLID8 double,LONGITUDE8 double,LATITU= DE8 double,UCELLID9 double,LONGITUDE9 double,LATITUDE9 double,UCELLID10 dou= ble,LONGITUDE10 double,LATITUDE10 double,INTBUFFER_FULL_DELAY double,STALL_= DURATION double,STREAMING_DW_PACKETS double,STREAMING_DOWNLOAD_DELAY double= ,PLAY_DURATION double,STREAMING_QUALITY int,VIDEO_DATA_RATE double,AUDIO_DA= TA_RATE double,STREAMING_FILESIZE double,STREAMING_DURATIOIN double,TCP_SYN= _TIME double,TCP_RTT_STEP1 double,CHARGE_ID double,UL_REVERSE_TO_DL_DELAY d= ouble,DL_REVERSE_TO_UL_DELAY double,DATATRANS_DW_GOODPUT double,DATATRANS_D= W_TOTAL_DURATION double,SUM_FRAGMENT_INTERVAL double,TCP_FIN_TIMES double,T= CP_RESET_TIMES double,URL_CLASSIFICATION double,STREAMING_LQ_DURATIOIN doub= le,MAX_DNS_DELAY double,MAX_DNS2SYN double,MAX_LATANCY_OF_LINK_SETUP double= ,MAX_SYNACK2FIRSTACK double,MAX_SYNACK2LASTACK double,MAX_ACK2GET_DELAY dou= ble,MAX_FRAG_INTERVAL_PREDELAY double,SUM_FRAG_INTERVAL_PREDELAY double,SER= VICE_DELAY_MSEC double,HOMEPROVINCE double,HOMECITY double,SERVICE_ID doubl= e,CHARGING_CLASS double,DATATRANS_UL_DURATION double,ASSOCIATED_ID double,P= ACKET_LOSS_NUM double,JITTER double,MS_DNS_DELAY_MSEL double,GET_STREAMING_= DELAY double,TCP_UL_RETRANS_WITHOUTPL double,TCP_DW_RETRANS_WITHOUTPL doubl= e,GET_MAX_UL_SIZE double,GET_MIN_UL_SIZE double,GET_MAX_DL_SIZE double,GET_= MIN_DL_SIZE double,L4_UL_THROUGHPUT double,L4_DW_THROUGHPUT double,L4_UL_GO= ODPUT double,L4_DW_GOODPUT double,NETWORK_UL_TRAFFIC double,NETWORK_DL_TRAF= FIC double,L4_UL_PACKETS double,L4_DW_PACKETS double,TCP_RTT double,TCP_UL_= OUTOFSEQU double,TCP_DW_OUTOFSEQU double,TCP_UL_RETRANS double,TCP_DW_RETRA= NS double,TCP_UL_RETRANS_WITHPL double,TCP_DW_RETRANS_WITHPL double,TCP_UL_= PACKAGES_WITHPL double,TCP_DW_PACKAGES_WITHPL double,TCP_UL_PACKAGES_WITHOU= TPL double,TCP_DW_PACKAGES_WITHOUTPL double,UPPERLAYER_IP_UL_PACKETS double= ,UPPERLAYER_IP_DL_PACKETS double,DOWNLAYER_IP_UL_PACKETS double,DOWNLAYER_I= P_DL_PACKETS double,UPPERLAYER_IP_UL_FRAGMENTS double,UPPERLAYER_IP_DL_FRAG= MENTS double,DOWNLAYER_IP_UL_FRAGMENTS double,DOWNLAYER_IP_DL_FRAGMENTS dou= ble,VALID_TRANS_DURATION double,AIR_PORT_DURATION double,RADIO_CONN_TIMES d= ouble,RAN_NE_ID double,AVG_UL_RTT double,AVG_DW_RTT double,UL_RTT_LONG_NUM = int,DW_RTT_LONG_NUM int,UL_RTT_STAT_NUM int,DW_RTT_STAT_NUM int,USER_PROBE_= UL_LOST_PKT int,SERVER_PROBE_UL_LOST_PKT int,SERVER_PROBE_DW_LOST_PKT int,U= SER_PROBE_DW_LOST_PKT int,CHARGING_CHARACTERISTICS double,DL_SERIOUS_OUT_OF= _ORDER_NUM double,DL_SLIGHT_OUT_OF_ORDER_NUM double,DL_FLIGHT_TOTAL_SIZE do= uble,DL_FLIGHT_TOTAL_NUM double,DL_MAX_FLIGHT_SIZE double,UL_SERIOUS_OUT_OF= _ORDER_NUM double,UL_SLIGHT_OUT_OF_ORDER_NUM double,UL_FLIGHT_TOTAL_SIZE do= uble,UL_FLIGHT_TOTAL_NUM double,UL_MAX_FLIGHT_SIZE double,USER_DL_SLIGHT_OU= T_OF_ORDER_PACKETS double,SERVER_UL_SLIGHT_OUT_OF_ORDER_PACKETS double,DL_C= ONTINUOUS_RETRANSMISSION_DELAY double,USER_HUNGRY_DELAY double,SERVER_HUNGR= Y_DELAY double,AVG_DW_RTT_MICRO_SEC int,AVG_UL_RTT_MICRO_SEC int,FLOW_SAMPL= E_RATIO int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ( 'DICT= IONARY_EXCLUDE'=3D'MSISDN,IMSI,IMEI,MS_IP,SERVER_IP,HOST,SP,MS_INDICATOR,st= reaming_url','DICTIONARY_INCLUDE'=3D'SESSION_INDICATOR,SERVER_DECIMAL,TCP_S= TATES_BIGINTPOSITIVE') > Load Query: LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/SEQ500/seq_500Recor= ds.csv' into table smart_500_DE options('DELIMITER'=3D',', 'QUOTECHAR'=3D'"= ','BAD_RECORDS_ACTION'=3D'FORCE','FILEHEADER'=3D'SID,PROBEID,INTERFACEID,GR= OUPID,GGSN_ID,SGSN_ID,dummy,SESSION_INDICATOR,BEGIN_TIME,BEGIN_TIME_MSEL,EN= D_TIME,END_TIME_MSEL,PROT_CATEGORY,PROT_TYPE,L7_CARRIER_PROT,SUB_PROT_TYPE,= MSISDN,IMSI,IMEI,ENCRYPT_VERSION,ROAMING_TYPE,ROAM_DIRECTION,MS_IP,SERVER_I= P,MS_PORT,APN,SGSN_SIG_IP,GGSN_USER_IP,SGSN_USER_IP,MCC,MNC,RAT,LAC,RAC,SAC= ,CI,SERVER_DECIMAL,BROWSER_TIMESTAMP,TCP_CONN_STATES,GGSN_SIG_IP_BigInt_NEG= ATIVE,TCP_STATES_BIGINTPOSITIVE,dummy,TCP_WIN_SIZE,dummy,TCP_MSS,dummy,TCP_= CONN_TIMES,dummy,TCP_CONN_2_FAILED_TIMES,dummy,TCP_CONN_3_FAILED_TIMES,HOST= ,STREAMING_URL,dummy,GET_STREAMING_FAILED_CODE,dummy,GET_STREAMING_FLAG,dum= my,GET_NUM,dummy,GET_SUCCEED_NUM,dummy,GET_RETRANS_NUM,dummy,GET_TIMEOUT_NU= M,INTBUFFER_FST_FLAG,INTBUFFER_FULL_FLAG,STALL_NUM,dummy,VIDEO_FRAME_RATE,d= ummy,VIDEO_CODEC_ID,dummy,VIDEO_WIDTH,dummy,VIDEO_HEIGHT,dummy,AUDIO_CODEC_= ID,dummy,MEDIA_FILE_TYPE,dummy,PLAY_STATE,dummy,PLAY_STATE,dummy,STREAMING_= FLAG,dummy,TCP_STATUS_INDICATOR,dummy,DISCONNECTION_FLAG,dummy,FAILURE_CODE= ,FLAG,TAC,ECI,dummy,TCP_SYN_TIME_MSEL,dummy,TCP_FST_SYN_DIRECTION,RAN_NE_US= ER_IP,HOMEMCC,HOMEMNC,dummy,CHARGE_FLAG,dummy,PREPAID_FLAG,dummy,USER_AGENT= ,dummy,MS_WIN_STAT_TOTAL_NUM,dummy,MS_WIN_STAT_SMALL_NUM,dummy,MS_ACK_TO_1S= TGET_DELAY,dummy,SERVER_ACK_TO_1STDATA_DELAY,dummy,STREAMING_TYPE,dummy,SOU= RCE_VIDEO_QUALITY,TETHERING_FLAG,CARRIER_ID,LAYER1ID,LAYER2ID,dummy,LAYER3I= D,dummy,LAYER4ID,dummy,LAYER5ID,dummy,LAYER6ID,CHARGING_RULE_BASE_NAME,SP,d= ummy,EXTENDED_URL,SV,FIRST_SAI_CGI_ECGI,dummy,EXTENDED_URL_OTHER,SIGNALING_= USE_FLAG,dummy,DNS_RETRANS_NUM,dummy,DNS_FAIL_CODE,FIRST_RAT,FIRST_RAT,MS_I= NDICATOR,LAST_SAI_CGI_ECGI,LAST_RAT,dummy,FIRST_LONGITUDE,dummy,FIRST_LATIT= UDE,dummy,FIRST_ALTITUDE,dummy,FIRST_RASTERLONGITUDE,dummy,FIRST_RASTERLATI= TUDE,dummy,FIRST_RASTERALTITUDE,dummy,FIRST_FREQUENCYSPOT,dummy,FIRST_CLUTT= ER,dummy,FIRST_USERBEHAVIOR,dummy,FIRST_SPEED,dummy,FIRST_CREDIBILITY,dummy= ,LAST_LONGITUDE,dummy,LAST_LATITUDE,dummy,LAST_ALTITUDE,dummy,LAST_RASTERLO= NGITUDE,dummy,LAST_RASTERLATITUDE,dummy,LAST_RASTERALTITUDE,dummy,LAST_FREQ= UENCYSPOT,dummy,LAST_CLUTTER,dummy,LAST_USERBEHAVIOR,dummy,LAST_SPEED,dummy= ,LAST_CREDIBILITY,dummy,IMEI_CIPHERTEXT,APP_ID,dummy,DOMAIN_NAME,dummy,STRE= AMING_CACHE_IP,dummy,STOP_LONGER_THAN_MIN_THRESHOLD,dummy,STOP_LONGER_THAN_= MAX_THRESHOLD,dummy,PLAY_END_STAT,dummy,STOP_START_TIME1,dummy,STOP_END_TIM= E1,dummy,STOP_START_TIME2,dummy,STOP_END_TIME2,dummy,STOP_START_TIME3,dummy= ,STOP_END_TIME3,dummy,STOP_START_TIME4,dummy,STOP_END_TIME4,dummy,STOP_STAR= T_TIME5,dummy,STOP_END_TIME5,dummy,STOP_START_TIME6,dummy,STOP_END_TIME6,du= mmy,STOP_START_TIME7,dummy,STOP_END_TIME7,dummy,STOP_START_TIME8,dummy,STOP= _END_TIME8,dummy,STOP_START_TIME9,dummy,STOP_END_TIME9,dummy,STOP_START_TIM= E10,dummy,STOP_END_TIME10,dummy,FAIL_CLASS,RECORD_TYPE,dummy,NODATA_COUNT,d= ummy,VIDEO_NODATA_DURATION,dummy,VIDEO_SMOOTH_DURATION,dummy,VIDEO_SD_DURAT= ION,dummy,VIDEO_HD_DURATION,dummy,VIDEO_UHD_DURATION,dummy,VIDEO_FHD_DURATI= ON,dummy,FLUCTUATION,dummy,START_DOWNLOAD_THROUGHPUT,dummy,L7_UL_GOODPUT_FU= LL_MSS,dummy,SESSIONKEY,dummy,FIRST_UCELLID,dummy,LAST_UCELLID,dummy,UCELLI= D1,dummy,LONGITUDE1,dummy,LATITUDE1,dummy,UCELLID2,dummy,LONGITUDE2,dummy,L= ATITUDE2,dummy,UCELLID3,dummy,LONGITUDE3,dummy,LATITUDE3,dummy,UCELLID4,dum= my,LONGITUDE4,dummy,LATITUDE4,dummy,UCELLID5,dummy,LONGITUDE5,dummy,LATITUD= E5,dummy,UCELLID6,dummy,LONGITUDE6,dummy,LATITUDE6,dummy,UCELLID7,dummy,LON= GITUDE7,dummy,LATITUDE7,dummy,UCELLID8,dummy,LONGITUDE8,dummy,LATITUDE8,dum= my,UCELLID9,dummy,LONGITUDE9,dummy,LATITUDE9,dummy,UCELLID10,dummy,LONGITUD= E10,dummy,LATITUDE10,dummy,INTBUFFER_FULL_DELAY,dummy,STALL_DURATION,dummy,= STREAMING_DW_PACKETS,dummy,STREAMING_DOWNLOAD_DELAY,dummy,PLAY_DURATION,dum= my,STREAMING_QUALITY,dummy,VIDEO_DATA_RATE,dummy,AUDIO_DATA_RATE,dummy,STRE= AMING_FILESIZE,dummy,STREAMING_DURATIOIN,dummy,TCP_SYN_TIME,dummy,TCP_RTT_S= TEP1,CHARGE_ID,dummy,UL_REVERSE_TO_DL_DELAY,dummy,DL_REVERSE_TO_UL_DELAY,du= mmy,DATATRANS_DW_GOODPUT,dummy,DATATRANS_DW_TOTAL_DURATION,dummy,SUM_FRAGME= NT_INTERVAL,dummy,TCP_FIN_TIMES,dummy,TCP_RESET_TIMES,dummy,URL_CLASSIFICAT= ION,dummy,STREAMING_LQ_DURATIOIN,dummy,MAX_DNS_DELAY,dummy,MAX_DNS2SYN,dumm= y,MAX_LATANCY_OF_LINK_SETUP,dummy,MAX_SYNACK2FIRSTACK,dummy,MAX_SYNACK2LAST= ACK,dummy,MAX_ACK2GET_DELAY,dummy,MAX_FRAG_INTERVAL_PREDELAY,dummy,SUM_FRAG= _INTERVAL_PREDELAY,dummy,SERVICE_DELAY_MSEC,dummy,HOMEPROVINCE,dummy,HOMECI= TY,dummy,SERVICE_ID,dummy,CHARGING_CLASS,dummy,DATATRANS_UL_DURATION,dummy,= ASSOCIATED_ID,dummy,PACKET_LOSS_NUM,dummy,JITTER,dummy,MS_DNS_DELAY_MSEL,du= mmy,GET_STREAMING_DELAY,dummy,TCP_UL_RETRANS_WITHOUTPL,dummy,TCP_DW_RETRANS= _WITHOUTPL,dummy,GET_MAX_UL_SIZE,dummy,GET_MIN_UL_SIZE,dummy,GET_MAX_DL_SIZ= E,dummy,GET_MIN_DL_SIZE,dummy,FLOW_SAMPLE_RATIO,dummy,UL_RTT_LONG_NUM,dummy= ,DW_RTT_LONG_NUM,dummy,UL_RTT_STAT_NUM,dummy,DW_RTT_STAT_NUM,dummy,USER_PRO= BE_UL_LOST_PKT,dummy,SERVER_PROBE_UL_LOST_PKT,dummy,SERVER_PROBE_DW_LOST_PK= T,dummy,USER_PROBE_DW_LOST_PKT,dummy,AVG_DW_RTT_MICRO_SEC,dummy,AVG_UL_RTT_= MICRO_SEC,dummy,RAN_NE_ID,dummy,AVG_UL_RTT,dummy,AVG_DW_RTT,dummy,CHARGING_= CHARACTERISTICS,dummy,DL_SERIOUS_OUT_OF_ORDER_NUM,dummy,DL_SLIGHT_OUT_OF_OR= DER_NUM,dummy,DL_FLIGHT_TOTAL_SIZE,dummy,DL_FLIGHT_TOTAL_NUM,dummy,DL_MAX_F= LIGHT_SIZE,dummy,VALID_TRANS_DURATION,dummy,AIR_PORT_DURATION,dummy,RADIO_C= ONN_TIMES,dummy,UL_SERIOUS_OUT_OF_ORDER_NUM,dummy,UL_SLIGHT_OUT_OF_ORDER_NU= M,dummy,UL_FLIGHT_TOTAL_SIZE,dummy,UL_FLIGHT_TOTAL_NUM,dummy,UL_MAX_FLIGHT_= SIZE,dummy,USER_DL_SLIGHT_OUT_OF_ORDER_PACKETS,dummy,SERVER_UL_SLIGHT_OUT_O= F_ORDER_PACKETS,dummy,DL_CONTINUOUS_RETRANSMISSION_DELAY,dummy,USER_HUNGRY_= DELAY,dummy,SERVER_HUNGRY_DELAY,dummy,UPPERLAYER_IP_UL_FRAGMENTS,dummy,UPPE= RLAYER_IP_DL_FRAGMENTS,dummy,DOWNLAYER_IP_UL_FRAGMENTS,dummy,DOWNLAYER_IP_D= L_FRAGMENTS,dummy,UPPERLAYER_IP_UL_PACKETS,dummy,UPPERLAYER_IP_DL_PACKETS,d= ummy,DOWNLAYER_IP_UL_PACKETS,dummy,DOWNLAYER_IP_DL_PACKETS,dummy,TCP_UL_PAC= KAGES_WITHPL,dummy,TCP_DW_PACKAGES_WITHPL,dummy,TCP_UL_PACKAGES_WITHOUTPL,d= ummy,TCP_DW_PACKAGES_WITHOUTPL,dummy,TCP_UL_RETRANS_WITHPL,dummy,TCP_DW_RET= RANS_WITHPL,L4_UL_THROUGHPUT,L4_DW_THROUGHPUT,L4_UL_GOODPUT,L4_DW_GOODPUT,N= ETWORK_UL_TRAFFIC,NETWORK_DL_TRAFFIC,L4_UL_PACKETS,L4_DW_PACKETS,TCP_RTT,TC= P_UL_OUTOFSEQU,TCP_DW_OUTOFSEQU,TCP_UL_RETRANS,TCP_DW_RETRANS') > Stack Trace : > [exec] org.apache.spark.SparkException: Job aborted due to stage failure:= Task 0 in stage 2.0 failed 4 times, most recent failure: Lost task 0.3 in = stage 2.0 (TID 35, hadoop-master): org.apache.carbondata.processing.newflow= .exception.CarbonDataLoadingException: Data Loading failed for table smart_= 500_de > [exec] =09at org.apache.carbondata.processing.newflow.DataLoadExecut= or.execute(DataLoadExecutor.java:54) > [exec] =09at org.apache.carbondata.spark.rdd.NewCarbonDataLoadRDD$$a= non$1.(NewCarbonDataLoadRDD.scala:166) > [exec] =09at org.apache.carbondata.spark.rdd.NewCarbonDataLoadRDD.co= mpute(NewCarbonDataLoadRDD.scala:142) > [exec] =09at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.sc= ala:306) > [exec] =09at org.apache.spark.rdd.RDD.iterator(RDD.scala:270) > [exec] =09at org.apache.spark.scheduler.ResultTask.runTask(ResultTas= k.scala:66) > [exec] =09at org.apache.spark.scheduler.Task.run(Task.scala:89) > [exec] =09at org.apache.spark.executor.Executor$TaskRunner.run(Execu= tor.scala:227) > [exec] =09at java.util.concurrent.ThreadPoolExecutor.runWorker(Threa= dPoolExecutor.java:1142) > [exec] =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thre= adPoolExecutor.java:617) > [exec] =09at java.lang.Thread.run(Thread.java:745) > [exec] Caused by: java.lang.ArrayIndexOutOfBoundsException > [exec]=20 > [exec] Driver stacktrace: > [exec] =09at org.apache.spark.scheduler.DAGScheduler.org$apache$spar= k$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:14= 31) > [exec] =09at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortS= tage$1.apply(DAGScheduler.scala:1419) > [exec] =09at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortS= tage$1.apply(DAGScheduler.scala:1418) > [exec] =09at scala.collection.mutable.ResizableArray$class.foreach(R= esizableArray.scala:59) > [exec] =09at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffe= r.scala:47) > [exec] =09at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGS= cheduler.scala:1418) > [exec] =09at org.apache.spark.scheduler.DAGScheduler$$anonfun$handle= TaskSetFailed$1.apply(DAGScheduler.scala:799) > [exec] =09at org.apache.spark.scheduler.DAGScheduler$$anonfun$handle= TaskSetFailed$1.apply(DAGScheduler.scala:799) > [exec] =09at scala.Option.foreach(Option.scala:236) > [exec] =09at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFa= iled(DAGScheduler.scala:799) > [exec] =09at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop= .doOnReceive(DAGScheduler.scala:1640) > [exec] =09at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop= .onReceive(DAGScheduler.scala:1599) > used csv is attached below. -- This message was sent by Atlassian JIRA (v6.3.4#6332)