asterixdb-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "abdullah alamoudi (Code Review)" <do-not-re...@asterixdb.incubator.apache.org>
Subject Change in asterixdb[master]: Feed Fixes and Cleanup
Date Thu, 07 Jan 2016 17:04:45 GMT
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

    https://asterix-gerrit.ics.uci.edu/574

to look at the new patch set (#2).

Change subject: Feed Fixes and Cleanup
......................................................................

Feed Fixes and Cleanup

1. Introduce filesystem feed data source.
2. Fix the order of closing feed stages on disconnection.
3. Added Twitter feed to the compatibility utility to allow
   using it with its alias.
4. First part of the feed log space.
5. Fixed the handling of duplicate key exception but now we have
   a deadlock.

Change-Id: I4e8db26a810efd1fbaa52ceeb3efd0c8328ab070
---
M asterix-app/src/main/java/org/apache/asterix/aql/translator/QueryTranslator.java
M asterix-app/src/main/java/org/apache/asterix/feeds/FeedLoadManager.java
M asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/ExternalLibraryBootstrap.java
M asterix-app/src/test/resources/runtimets/results/feeds/feeds_01/feeds_01.1.adm
M asterix-app/src/test/resources/runtimets/testsuite.xml
M asterix-common/src/main/java/org/apache/asterix/common/dataflow/AsterixLSMInsertDeleteOperatorNodePushable.java
M asterix-common/src/main/java/org/apache/asterix/common/exceptions/FrameDataException.java
M asterix-common/src/main/java/org/apache/asterix/common/feeds/FeedExceptionHandler.java
M asterix-common/src/main/java/org/apache/asterix/common/feeds/FeedFrameUtil.java
M asterix-common/src/main/java/org/apache/asterix/common/feeds/FeedPolicyAccessor.java
M asterix-common/src/main/java/org/apache/asterix/common/feeds/FeedRuntimeInputHandler.java
M asterix-common/src/main/java/org/apache/asterix/common/feeds/MonitoredBuffer.java
M asterix-common/src/main/java/org/apache/asterix/common/feeds/api/IDataSourceAdapter.java
M asterix-common/src/main/java/org/apache/asterix/common/feeds/api/ITupleTrackingFeedAdapter.java
M asterix-common/src/main/java/org/apache/asterix/common/parse/ITupleForwarder.java
R asterix-external-data/src/main/java/org/apache/asterix/external/api/IAdapterRuntimeManager.java
M asterix-external-data/src/main/java/org/apache/asterix/external/api/IDataFlowController.java
A asterix-external-data/src/main/java/org/apache/asterix/external/api/IFeedAdapter.java
M asterix-external-data/src/main/java/org/apache/asterix/external/api/IStreamDataParser.java
A asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/AbstractFeedDataFlowController.java
A asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/FeedRecordDataFlowController.java
A asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/FeedStreamDataFlowController.java
A asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/FeedTupleForwarder.java
M asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/RecordDataFlowController.java
M asterix-external-data/src/main/java/org/apache/asterix/external/dataflow/StreamDataFlowController.java
M asterix-external-data/src/main/java/org/apache/asterix/external/dataset/adapter/GenericAdapter.java
A asterix-external-data/src/main/java/org/apache/asterix/external/feeds/FileSystemFeedProgressTracker.java
R asterix-external-data/src/main/java/org/apache/asterix/external/feeds/IngestionRuntime.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/AbstractStreamRecordReader.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/LineRecordReader.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/QuotedLineRecordReader.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/SemiStructuredRecordReader.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/TwitterPushRecordReader.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/factory/TwitterRecordReaderFactory.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AInputStreamReader.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/HDFSInputStreamProvider.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/LocalFSInputStreamProvider.java
A asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/LocalFileSystemInputStream.java
M asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/factory/LocalFSInputStreamProviderFactory.java
M asterix-external-data/src/main/java/org/apache/asterix/external/parser/ADMDataParser.java
M asterix-external-data/src/main/java/org/apache/asterix/external/parser/DelimitedDataParser.java
M asterix-external-data/src/main/java/org/apache/asterix/external/provider/AdapterFactoryProvider.java
M asterix-external-data/src/main/java/org/apache/asterix/external/provider/DataflowControllerProvider.java
M asterix-external-data/src/main/java/org/apache/asterix/external/provider/DatasourceFactoryProvider.java
M asterix-external-data/src/main/java/org/apache/asterix/external/runtime/GenericSocketFeedAdapter.java
M asterix-external-data/src/main/java/org/apache/asterix/external/runtime/SocketClientAdapter.java
M asterix-external-data/src/main/java/org/apache/asterix/external/util/DataflowUtils.java
M asterix-external-data/src/main/java/org/apache/asterix/external/util/Datatypes.java
M asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataCompatibilityUtils.java
M asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataConstants.java
M asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataExceptionUtils.java
M asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataUtils.java
A asterix-external-data/src/main/java/org/apache/asterix/external/util/FeedLogManager.java
C asterix-external-data/src/main/java/org/apache/asterix/external/util/FeedUtils.java
A asterix-external-data/src/main/java/org/apache/asterix/external/util/FileSystemWatcher.java
A asterix-external-data/src/main/java/org/apache/asterix/external/util/LocalFileSystemUtils.java
R asterix-external-data/src/main/java/org/apache/asterix/external/util/NodeResolverFactory.java
D asterix-external-data/src/main/java/org/apache/asterix/external/util/TweetProcessor.java
M asterix-external-data/src/test/java/org/apache/asterix/external/library/adapter/TestTypedAdapter.java
M asterix-lang-aql/src/main/java/org/apache/asterix/lang/aql/statement/SubscribeFeedStatement.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/bootstrap/MetadataBootstrap.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/declared/AqlMetadataProvider.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/entities/DatasourceAdapter.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/entitytupletranslators/DatasourceAdapterTupleTranslator.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/AdapterExecutor.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/AdapterRuntimeManager.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedCollectOperatorDescriptor.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedIntakeOperatorDescriptor.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedIntakeOperatorNodePushable.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedMessageOperatorNodePushable.java
M asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedMetaStoreNodePushable.java
R asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/MetadataUtil.java
72 files changed, 1,683 insertions(+), 397 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/74/574/2
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/574
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I4e8db26a810efd1fbaa52ceeb3efd0c8328ab070
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi <bamousaa@gmail.com>
Gerrit-Reviewer: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Mime
View raw message