hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Esteban Gutierrez (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HBASE-9877) HFileOutputFormat creates partitions file with random name under /tmp
Date Wed, 16 Nov 2016 22:17:58 GMT

     [ https://issues.apache.org/jira/browse/HBASE-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Esteban Gutierrez resolved HBASE-9877.
--------------------------------------
    Resolution: Fixed

Original issue was addressed by HBASE-13010. HBASE-15129 exposes hbase.fs.tmp.dir and you
can specify a different location for the partition file.

> HFileOutputFormat creates partitions file with random name under /tmp
> ---------------------------------------------------------------------
>
>                 Key: HBASE-9877
>                 URL: https://issues.apache.org/jira/browse/HBASE-9877
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>    Affects Versions: 0.98.0, 0.94.12, 0.96.0
>            Reporter: Nick Dimiduk
>            Priority: Minor
>
> HFileOutputFormat creates a partitions file for managing reducer partition boundaries.
This file is created under /tmp and is just a UUID. As [pointed out|https://issues.apache.org/jira/browse/HBASE-4285?focusedCommentId=13620294&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13620294]
by [~lurbina], there's no guarantee this path exists or is user-writable. As [~yuzhihong@gmail.com]
[mentions|https://issues.apache.org/jira/browse/HBASE-4285?focusedCommentId=13602934&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13602934],
this file name is useless for users trying to debug a failing job. We should give it a meaningful
name, based on job name and/or timestamp.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message