hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Feng Yuan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-11840) when multi insert the inputformat becomes OneNullRowInputFormat
Date Wed, 23 Sep 2015 02:13:04 GMT

     [ https://issues.apache.org/jira/browse/HIVE-11840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Feng Yuan updated HIVE-11840:
-----------------------------
    Priority: Blocker  (was: Critical)

> when multi insert the inputformat becomes OneNullRowInputFormat
> ---------------------------------------------------------------
>
>                 Key: HIVE-11840
>                 URL: https://issues.apache.org/jira/browse/HIVE-11840
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 0.14.0
>            Reporter: Feng Yuan
>            Priority: Blocker
>             Fix For: 0.14.1
>
>         Attachments: multi insert, single__insert
>
>
> example:
> from portrait.rec_feature_feedback a 
> insert overwrite table portrait.test1 select iid, feedback_15day, feedback_7day, feedback_5day,
feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('949722CF_12F7_523A_EE21_E3D591B7E755')

> insert overwrite table portrait.test2 select iid, feedback_15day, feedback_7day, feedback_5day,
feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('test') 
> insert overwrite table portrait.test3 select iid, feedback_15day, feedback_7day, feedback_5day,
feedback_3day, feedback_1day where l_date = '2015-09-09' and bid in ('F7734668_CC49_8C4F_24C5_EA8B6728E394')
> when single insert it works.but multi insert when i select * from test1:
> NULL NULL NULL NULL NULL NULL.
> i see "explain extended"
> Path -> Alias:
>         -mr-10006portrait.rec_feature_feedback{l_date=2015-09-09, cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394}
[a]
>         -mr-10007portrait.rec_feature_feedback{l_date=2015-09-09, cid=Czgc_pc, bid=949722CF_12F7_523A_EE21_E3D591B7E755}
[a]
>       Path -> Partition:
>         -mr-10006portrait.rec_feature_feedback{l_date=2015-09-09, cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394}

>           Partition
>             base file name: bid=F7734668_CC49_8C4F_24C5_EA8B6728E394
>             input format: org.apache.hadoop.hive.ql.io.OneNullRowInputFormat
>             output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
>             partition values:
>               bid F7734668_CC49_8C4F_24C5_EA8B6728E394
>               cid Cyiyaowang
>               l_date 2015-09-09
> but when single insert:
> Path -> Alias:
>         hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755
[a]
>       Path -> Partition:
>         hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755

>           Partition
>             base file name: bid=949722CF_12F7_523A_EE21_E3D591B7E755
>             input format: org.apache.hadoop.mapred.TextInputFormat
>             output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
>             partition values:
>               bid 949722CF_12F7_523A_EE21_E3D591B7E755
>               cid Czgc_pc
>               l_date 2015-09-09



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message