hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13947) HoS print wrong number for hash table size in map join scenario
Date Tue, 01 Nov 2016 14:47:58 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aihua Xu updated HIVE-13947:
----------------------------
    Status: Patch Available  (was: Open)

patch-1: simple fix to close the file stream before getting file status since otherwise, the
file length would be 0. Checked from the log that we are now getting the correct file size,
 but can't think of a test for that.



> HoS print wrong number for hash table size in map join scenario
> ---------------------------------------------------------------
>
>                 Key: HIVE-13947
>                 URL: https://issues.apache.org/jira/browse/HIVE-13947
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>    Affects Versions: 1.2.1
>            Reporter: wangwenli
>            Assignee: Aihua Xu
>            Priority: Minor
>         Attachments: HIVE-13947.1.patch
>
>
> In *sparkHashTableSinkOperator*, when *flushToFile*, before close output stream, it try
to get the file length, and will get 0 for it,  take *hashTableSinkOperator* for ref, it should
get length after output stream closed



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message