arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam M Krebs (Jira)" <>
Subject [jira] [Created] (ARROW-6574) [JS] TypeError with utf8 and JSONVectorLoader.readData
Date Mon, 16 Sep 2019 23:02:00 GMT
Adam M Krebs created ARROW-6574:

             Summary: [JS] TypeError with utf8 and JSONVectorLoader.readData
                 Key: ARROW-6574
             Project: Apache Arrow
          Issue Type: Bug
          Components: JavaScript
    Affects Versions: 0.14.1
         Environment: node v10.16.0, OSX 10.14.5
            Reporter: Adam M Krebs

Minimal repro:

const fields = [
    name: 'first_name',
    type: {name: 'utf8'},
    nullable: false,
    children: [],

  schema: {fields},
  batches: [{
    count: 1,
    columns: [{
      name: 'first_name',
      count: 1,
      VALIDITY: [],
      DATA: ['Fred']

    readData(type, { offset } = this.nextBufferRange()) {
                     ^TypeError: Cannot destructure property `offset` of 'undefined' or 'null'.
    at JSONVectorLoader.readData (/[snip]/node_modules/apache-arrow/visitor/vectorloader.js:92:38)
    at JSONVectorLoader.visitUtf8 (/[snip]/node_modules/apache-arrow/visitor/vectorloader.js:46:188)
    at JSONVectorLoader.visit (/[snip]/node_modules/apache-arrow/visitor.js:28:48)
    at JSONVectorLoader.visit (/[snip]/node_modules/apache-arrow/visitor/vectorloader.js:40:22)
    at (/[snip]/node_modules/apache-arrow/visitor.js:25:44)
    at (<anonymous>)
    at JSONVectorLoader.visitMany (/[snip]/node_modules/apache-arrow/visitor.js:25:22)
    at RecordBatchJSONReaderImpl._loadVectors (/[snip]/node_modules/apache-arrow/ipc/reader.js:523:107)
    at RecordBatchJSONReaderImpl._loadRecordBatch (/[snip]/node_modules/apache-arrow/ipc/reader.js:209:79)
    at (/[snip]/node_modules/apache-arrow/ipc/reader.js:280:42){code}


Looks like the `nextBufferRange` call is returning `undefined`, due to an out-of-bounds `buffersIndex`.


Happy to provide more info if needed. Seems to only affect utf8 types and nothing else.


This message was sent by Atlassian Jira

View raw message