orc-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harshad Patel <harshadkpa...@gmail.com>
Subject When writing a large text object a java.lang.NullPointerException is thrown in DynamicByteArray
Date Tue, 09 May 2017 07:12:31 GMT
Using the examples from the ORC site and from the repo I have created an
application which uses
ORC to persist many text docs as ORC

However on very large objects e.g. 1mb-5mb I always get a null pointer in
the add method of

DynamicByteArray.java

- System.arraycopy(value, valueOffset, data[i], j, size);

Has anyone got any workarounds for this?

Example code

BytesColumnVector text = (BytesColumnVector)batch.cols[colNum];
byte[] textBytes = text .toString.getBytes("UTF_8");
vector.setVal(row,textBytes)

Or any examples of how to use ensure the arraycopy doesnt die(e.g.
ensureSize and initBuffer ?)



Thanks

Mime
View raw message