hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3304) [HOD] logcondense fails if DFS has files that are not log files, but match a certain pattern
Date Mon, 28 Apr 2008 05:24:55 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hemanth Yamijala updated HADOOP-3304:
-------------------------------------

      Resolution: Fixed
    Release Note: Fixed the regular expression used by the logcondense utility to generate
the list of log files to purge from HDFS. Also, improved error handling, so a single invalid
log file does not fail the purge process.
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Devaraj committed this patch to both trunk and the Hadoop 0.17 branch.

> [HOD] logcondense fails if DFS has files that are not log files, but match a certain
pattern
> --------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3304
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3304
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hod
>    Affects Versions: 0.16.2
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>            Priority: Blocker
>             Fix For: 0.17.0
>
>         Attachments: 3304.1.patch, 3304.2.patch, 3304.patch
>
>
> logcondense works by listing files in dfs and match them against a certain pattern. This
pattern is incorrect in the sense that it can potentially match files that are not log files.
And this can cause it to fail and not delete files correctly as it should.
> It should use a correct regular expression that will only list log files. Also, possibly
it should log a stack trace if it happens, but continue to delete files and not stop.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message