hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Feng Yuan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-11840) when multi insert the inputformat becomes OneNullRowInputFormat
Date Wed, 16 Sep 2015 10:14:46 GMT
Feng Yuan created HIVE-11840:
--------------------------------

             Summary: when multi insert the inputformat becomes OneNullRowInputFormat
                 Key: HIVE-11840
                 URL: https://issues.apache.org/jira/browse/HIVE-11840
             Project: Hive
          Issue Type: Bug
          Components: Hive
    Affects Versions: 0.14.0
            Reporter: Feng Yuan
            Priority: Critical
             Fix For: 0.14.1


example:
from portrait.rec_feature_feedback a 
insert overwrite table portrait.test1 select iid, feedback_15day, feedback_7day, feedback_5day,
feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('949722CF_12F7_523A_EE21_E3D591B7E755')

insert overwrite table portrait.test2 select iid, feedback_15day, feedback_7day, feedback_5day,
feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('test') 
insert overwrite table portrait.test3 select iid, feedback_15day, feedback_7day, feedback_5day,
feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('F7734668_CC49_8C4F_24C5_EA8B6728E394')

when single insert it works.but multi insert when i select * from test1:
NULL NULL NULL NULL NULL NULL.

i see "explain extended"
Path -> Alias:
        -mr-10006portrait.rec_feature_feedback{l_date=2015-09-09, cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394}
[a]
        -mr-10007portrait.rec_feature_feedback{l_date=2015-09-09, cid=Czgc_pc, bid=949722CF_12F7_523A_EE21_E3D591B7E755}
[a]
      Path -> Partition:
        -mr-10006portrait.rec_feature_feedback{l_date=2015-09-09, cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394}

          Partition
            base file name: bid=F7734668_CC49_8C4F_24C5_EA8B6728E394
            input format: org.apache.hadoop.hive.ql.io.OneNullRowInputFormat
            output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
            partition values:
              bid F7734668_CC49_8C4F_24C5_EA8B6728E394
              cid Cyiyaowang
              l_date 2015-09-09

but when single insert:
Path -> Alias:
        hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755
[a]
      Path -> Partition:
        hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755

          Partition
            base file name: bid=949722CF_12F7_523A_EE21_E3D591B7E755
            input format: org.apache.hadoop.mapred.TextInputFormat
            output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
            partition values:
              bid 949722CF_12F7_523A_EE21_E3D591B7E755
              cid Czgc_pc
              l_date 2015-09-09



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message