nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bryan Bende (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-1784) Create a FetchHBase Processor
Date Wed, 01 Jun 2016 15:53:59 GMT

    [ https://issues.apache.org/jira/browse/NIFI-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310521#comment-15310521
] 

Bryan Bende commented on NIFI-1784:
-----------------------------------

Rather than calling this FetchHBase which implies fetching a specific cell (similar to how
other "fetch" processors work in NiFI) we should probably call this ScanHBase and support
any type of scan, and still allow incoming flow files for dynamic scans.

This would allow for several different uses cases, such as:

- Fetch a static cell by providing table, row id, col fam, col qual directly in the processor
- Fetch a dynamic cell by obtaining the table, row id, col fam, col qual from an incoming
FlowFile
- Fetch an entire table, or portion of a table, repeatedly on some interval by providing the
table name in the processor

GetHBase can still be used when people want incremental pulling based on new records.

> Create a FetchHBase Processor
> -----------------------------
>
>                 Key: NIFI-1784
>                 URL: https://issues.apache.org/jira/browse/NIFI-1784
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Bryan Bende
>            Priority: Minor
>
> We should provide a processor to fetch a row from HBase. The processor should support
receiving an incoming FlowFile and taking the row id to fetch from an attribute on the incoming,
and should also be able to fetch a static row id.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message