carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CARBONDATA-896) throws nullpointerException while insert data
Date Tue, 11 Apr 2017 10:20:42 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964137#comment-15964137
] 

Rahul Kumar edited comment on CARBONDATA-896 at 4/11/17 10:20 AM:
------------------------------------------------------------------

hi [~Sehriff] ,
i have tried following query with spark-1.6 :
    cc.sql("""
           CREATE TABLE IF NOT EXISTS t3
           (ID Int, date Date, country String,
           name String, phonetype String, serialname String, salary   
      Int,floatField float)
           STORED BY 'carbondata'
           """)
    cc.sql("""
           CREATE TABLE IF NOT EXISTS h3
           (ID Int, date Date, country String,
           name String, phonetype String, serialname String, salary Int,floatField float)row
format delimited fields terminated by ','""")

    cc.sql(s""" LOAD DATA LOCAL INPATH '$testData' into table h3""")
    cc.sql(""" SELECT * FROM h3""").show()
    cc.sql("insert into default.t3 select * from h3").show
    cc.sql("""SELECT * FROM h3""").show()
    cc.sql("""SELECT * FROM t3""").show()

and it is working fine for me .

Can you please add some more information( spark version, csv, executed steps)


was (Author: rahulknoldus):
hi [~Sehriff] ,
i have tried following query with spark-1.6 :
    cc.sql("""
           CREATE TABLE IF NOT EXISTS t3
           (ID Int, date Date, country String,
           name String, phonetype String, serialname String, salary   
      Int,floatField float)
           STORED BY 'carbondata'
           """)
    cc.sql("""
           CREATE TABLE IF NOT EXISTS h3
           (ID Int, date Date, country String,
           name String, phonetype String, serialname String, salary Int,floatField float)row
format delimited fields terminated by ','""")

    cc.sql(s""" LOAD DATA LOCAL INPATH '$testData' into table h3""")
    cc.sql(""" SELECT * FROM h3""").show()
    cc.sql("insert into default.t3 select * from h3").show
    cc.sql("""SELECT * FROM h3""").show()
    cc.sql("""SELECT * FROM t3""").show()

and its working fine for me .

Can you please add some more information( spark version, csv, executed steps)

> throws nullpointerException while insert data
> ---------------------------------------------
>
>                 Key: CARBONDATA-896
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-896
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 1.0.0-incubating
>            Reporter: sehriff
>
> insert data into carbon table from hive using sql like:
> cc.sql("insert into carbon.table_carbon select * from hivetable").show
> and got the following error:
> Job aborted due to stage failure: Task 0 in stage 26.3 failed 4 times, most recent failure:
Lost task 0.3 in stage 26.3 (TID 5628, HDD013): java.lang.NullPointerException
> 	at org.apache.carbondata.core.datastore.filesystem.AbstractDFSCarbonFile.getLastModifiedTime(AbstractDFSCarbonFile.java:135)
> 	at org.apache.carbondata.core.datastore.filesystem.AbstractDFSCarbonFile.isFileModified(AbstractDFSCarbonFile.java:210)
> 	at org.apache.carbondata.core.cache.dictionary.AbstractDictionaryCache.isDictionaryMetaFileModified(AbstractDictionaryCache.java:119)
> 	at org.apache.carbondata.core.cache.dictionary.AbstractDictionaryCache.checkAndLoadDictionaryData(AbstractDictionaryCache.java:158)
> 	at org.apache.carbondata.core.cache.dictionary.ReverseDictionaryCache.getDictionary(ReverseDictionaryCache.java:174)
> 	at org.apache.carbondata.core.cache.dictionary.ReverseDictionaryCache.get(ReverseDictionaryCache.java:67)
> 	at org.apache.carbondata.core.cache.dictionary.ReverseDictionaryCache.get(ReverseDictionaryCache.java:38)
> 	at org.apache.carbondata.spark.load.CarbonLoaderUtil.getDictionary(CarbonLoaderUtil.java:463)
> 	at org.apache.carbondata.spark.load.CarbonLoaderUtil.getDictionary(CarbonLoaderUtil.java:469)
> 	at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.<init>(CarbonGlobalDictionaryRDD.scala:413)
> 	at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:342)
> 	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> 	at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> 	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
> 	at org.apache.spark.scheduler.Task.run(Task.scala:89)
> 	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message