avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1909) Make concat tool handle directories as input
Date Sat, 28 Jan 2017 08:24:25 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15843982#comment-15843982

ASF GitHub Bot commented on AVRO-1909:

Github user wallin closed the pull request at:


> Make concat tool handle directories as input
> --------------------------------------------
>                 Key: AVRO-1909
>                 URL: https://issues.apache.org/jira/browse/AVRO-1909
>             Project: Avro
>          Issue Type: Improvement
>          Components: java
>    Affects Versions: 1.8.1
>            Reporter: Sebastian Wallin
>            Priority: Minor
> I'm having a situation where I want to concatenate thousands of files in a directory.
Currently this generates `Argument list too long` when the shell tries to expand into a list
of files.
> It would be great for the `concat` tool to handle directories as input for use cases
like this, as well as being consistent with the `cat` tool
> There is a similar issue filed (AVRO-1787), which requests both directories and glob
patters to be handled. IMHO it would be enough to make the `concat` tool handle directories,
as a start. It would also require a lot less code to be changed.

This message was sent by Atlassian JIRA

View raw message