cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Philip Thompson (JIRA)" <>
Subject [jira] [Updated] (CASSANDRA-8934) COPY command has inherent 128KB field size limit
Date Mon, 16 Mar 2015 16:28:39 GMT


Philip Thompson updated CASSANDRA-8934:
    Attachment: 8934-2.1.txt

Attached is the 2.1 patch. Not sure if it's worth adding a new section to cqlshrc for this,
but it doesn't exactly fit in ui, auth, or ssl. Also not sure if that is the best place to
set the csv.field_size_limit, but it seems setting it anywhere is valid. Tested locally.

> COPY command has inherent 128KB field size limit
> ------------------------------------------------
>                 Key: CASSANDRA-8934
>                 URL:
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tools
>            Reporter:  Brian Hess
>            Assignee: Philip Thompson
>              Labels: cqlsh, docs-impacting
>             Fix For: 2.1.4, 2.0.14
>         Attachments: 8934-2.1.txt
> In using the COPY command as follows:
> {{cqlsh -e "COPY test.test1mb(pkey, ccol, data) FROM 'in/data1MB/data1MB_9.csv'"}}
> the following error is thrown:
> {{<stdin>:1:field larger than field limit (131072)}}
> The data file contains a field that is greater than 128KB (it's more like almost 1MB).
> A work-around (thanks to [~jjordan] and [~thobbs] is to modify the cqlsh script and add
the line
> {{csv.field_size_limit(1000000000)}}
> anywhere after the line
> {{import csv}}

This message was sent by Atlassian JIRA

View raw message