hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthew Liem (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-21705) Allow user to specify file prefix for hive output files
Date Thu, 09 May 2019 18:00:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthew Liem updated HIVE-21705:
--------------------------------
    Description: 
Allow users to specify prefix for hiveoutput files. e.g 

set hive.output.file.prefix=""

This would happen in the tmpPath -> finalPath rename. 

Mapreduce has a similar feature with "mapreduce.output.basename" and the proposed solution
is to have a similar hive conf setting "hive.output.file.prefix" that will append hive output
file names 

This would require we modify getFinalPath in the FileSinkOperator class and pass in a prefix
from a newly created HiveConf.ConfVars.OUTPUT_FILE_PREFIX

  was:
Allow users to specify prefix for hiveoutput files. e.g 

set hive.output.file.prefix=""

This would happen in the tmpPath -> finalPath rename. 


> Allow user to specify file prefix for hive output files 
> --------------------------------------------------------
>
>                 Key: HIVE-21705
>                 URL: https://issues.apache.org/jira/browse/HIVE-21705
>             Project: Hive
>          Issue Type: New Feature
>    Affects Versions: 2.3.4
>            Reporter: Matthew Liem
>            Priority: Minor
>
> Allow users to specify prefix for hiveoutput files. e.g 
> set hive.output.file.prefix=""
> This would happen in the tmpPath -> finalPath rename. 
> Mapreduce has a similar feature with "mapreduce.output.basename" and the proposed solution
is to have a similar hive conf setting "hive.output.file.prefix" that will append hive output
file names 
> This would require we modify getFinalPath in the FileSinkOperator class and pass in
a prefix from a newly created HiveConf.ConfVars.OUTPUT_FILE_PREFIX



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message