asterixdb-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "abdullah alamoudi (Code Review)" <do-not-re...@asterixdb.incubator.apache.org>
Subject Change in asterixdb[master]: ASTERIXDB-1044 Allow Reading large records from HDFS
Date Mon, 04 Jan 2016 12:59:38 GMT
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

    https://asterix-gerrit.ics.uci.edu/529

to look at the new patch set (#3).

Change subject: ASTERIXDB-1044 Allow Reading large records from HDFS
......................................................................

ASTERIXDB-1044 Allow Reading large records from HDFS

This change enable reading of HDFS records larger than 8192.

Before this change, the stream will return 0 bytes if the record doesn't
fit in the reader buffer. The reader used by the delimited data parser
throws an exception if it gets back 0 bytes. With this change, a record
is streamed to the reader in multiple read calls. A test case was added
for this case.

Change-Id: I3cf52be4bc0fd8af2555062eeb421d7235088d98
---
A asterix-app/data/hdfs/large-record.txt
A asterix-app/src/test/resources/runtimets/queries/hdfs/large-record/large-record.1.ddl.aql
A asterix-app/src/test/resources/runtimets/queries/hdfs/large-record/large-record.2.update.aql
A asterix-app/src/test/resources/runtimets/queries/hdfs/large-record/large-record.3.query.aql
A asterix-app/src/test/resources/runtimets/results/hdfs/large-record/large-record.1.adm
M asterix-app/src/test/resources/runtimets/testsuite.xml
6 files changed, 123 insertions(+), 1 deletion(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/29/529/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/529
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I3cf52be4bc0fd8af2555062eeb421d7235088d98
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi <bamousaa@gmail.com>
Gerrit-Reviewer: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <jianfeng.jia@gmail.com>
Gerrit-Reviewer: Murtadha Hubail <hubailmor@gmail.com>
Gerrit-Reviewer: Till Westmann <tillw@apache.org>

Mime
View raw message