hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roman Slysh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7927) Fluentd unable to write events to MaprFS using httpfs
Date Fri, 13 Mar 2015 10:39:38 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Roman Slysh updated HDFS-7927:
    Attachment: HDFS-7927.patch

Attaching the patch that resolves the issue with MaprFS communication.

> Fluentd unable to write events to MaprFS using httpfs
> -----------------------------------------------------
>                 Key: HDFS-7927
>                 URL: https://issues.apache.org/jira/browse/HDFS-7927
>             Project: Hadoop HDFS
>          Issue Type: Bug
>         Environment: mapr 4.0.1
>            Reporter: Roman Slysh
>         Attachments: HDFS-7927.patch
> The issue is on MaprFS file system. Probably, can be reproduced on HDFS, but not sure.

> We have observed in td-agent log whenever webhdfs plugin call to flush events its calling
append instead of create file on maprfs by communicating with webhdfs. We need to modify this
plugin to create file and then append data to the file as manually creating file is not a
solution as lot of log events write to Filesystem they need to rotate on timely basis.
> http://docs.fluentd.org/articles/http-to-hdfs

This message was sent by Atlassian JIRA

View raw message