nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bryan Bende <bbe...@gmail.com>
Subject Re: [DISCUSS] First Release of NiFi Registry
Date Thu, 21 Dec 2017 17:50:16 GMT
Just wanted to give an update on this...

Great progress has been made in the last two weeks in terms of getting
ready for an RC. Still a few outstanding items, but I think we could
have those wrapped up soon and kick out an RC some time next week.
Depending when everything is ready we can adjust the voting period if
needed to account for holidays and make sure there is adequate time
for review.

In the mean time, I encourage anyone who is interested to give it a
try. Here is some info about how to get started...

1) Get the code for the registry

The Apache repo is here:

https://git-wip-us.apache.org/repos/asf/nifi-registry.git

The github repo is here if you prefer to fork that:

https://github.com/apache/nifi-registry

2) Build the registry code

cd nifi-registry
mvn clean install

3) Start the registry

cd nifi-registry-assembly/target/nifi-registry-0.0.1-SNAPSHOT-bin/nifi-registry-0.0.1-SNAPSHOT/
./bin/nifi-registry.sh start

4) Create a bucket in the registry

- Go to the registry UI at http://localhost:18080/nifi-registry
- Click the tool icon in the top right corner
- Click New Bucket from the bucket table
- Enter a name and click create

5) Get the NiFi PR which adds the support for integrating with the registry

https://github.com/apache/nifi/pull/2219

Build that PR like normal.

NOTE: That you must have already built nifi-registry with "mvn clean
install" in order to build this PR because it depends on snapshot JARs
being in your local Maven repo.

6) Tell NiFi about your local registry instance

- Go the controller settings for NiFi from the top-right menu
- Select the Registry Clients tab
- Add a new Registry Client giving it a name and the url of
http://localhost:18080

7) Create a process group and place it under version control

- Right click on the PG and select the Version menu
- Select Start Version Control
- Choose the registry instance and bucket you want to use
- Enter a name, description, and comment

8) Go back to the registry and refresh the main page and you should
see the versioned flow you just saved

9) Import a new PG from a versioned flow

- Drag on a new PG like normal
- Instead of entering a name, click the Import link
- Now choose the flow you saved before

You should have a second identical PG now.

>From there you can try making changes to one of them, view local
changes, revert changes, save a version 2, upgrade the other one to
version 2, etc.

Hope that helps.

-Bryan

On Fri, Dec 8, 2017 at 9:19 AM, Bryan Bende <bbende@gmail.com> wrote:
> Mike,
>
> You brought up a good point... documentation is one of the things that
> still needs to be done.
>
> There is some information that might be helpful though...
>
> I would suggest reading this Wiki page for the feature proposal of
> "Configuration Management of Flows" [1].
>
> There is also a JIRA from a few months ago with initial mock ups for
> the registry UI [2].
>
> As part of the RC I can provide some instructions on how it can be
> tested with NiFi using PR 2219.
>
> Thanks,
>
> Bryan
>
> [1] https://cwiki.apache.org/confluence/display/NIFI/Configuration+Management+of+Flows
> [2] https://issues.apache.org/jira/browse/NIFIREG-3
>
>
> On Thu, Dec 7, 2017 at 8:21 PM, Mike Thomsen <mikerthomsen@gmail.com> wrote:
>> Is there a good description/detail page somewhere going over the registry?
>>
>> On Thu, Dec 7, 2017 at 2:06 PM, Pierre Villard <pierre.villard.fr@gmail.com>
>> wrote:
>>
>>> Strong +1!!
>>>
>>> Really impressed by all the work you guys did on the registry stuff. Very
>>> impatient to use it in official releases!
>>>
>>> Le 7 déc. 2017 18:52, "Jeff" <jtswork@gmail.com> a écrit :
>>>
>>> Bryan,
>>>
>>> +1 to getting an initial release of NiFi Registry out to the community.
>>> Definitely a huge step in the evolution of NiFi!
>>>
>>> On Thu, Dec 7, 2017 at 11:29 AM Russell Bateman <russ@windofkeltia.com>
>>> wrote:
>>>
>>> > Our down-stream users are excited at the prospect of using this registry
>>> > capability for their flows. So, we're eager to see it integrated into
>>> > the earliest NiFi version you can choose (1.5.0?).
>>> >
>>> > Russ
>>> >
>>> > On 12/07/2017 08:49 AM, Kevin Doran wrote:
>>> > > Thanks for kicking off this discussion thread, Bryan.
>>> > >
>>> > > I support prepping a release of NiFi Registry and making it version
>>> > 0.1.0 as you propose.
>>> > >
>>> > > Thanks!
>>> > > Kevin
>>> > >
>>> > > On 12/7/17, 10:45, "Joe Witt" <joe.witt@gmail.com> wrote:
>>> > >
>>> > >      Bryan - very exciting and awesome.  Having experimented with the
>>> > >      registry on the JIRAs/PRs you mention I must say this is going
to
>>> > be a
>>> > >      huge step forward for NiFi!
>>> > >
>>> > >      Since we'll also be doing a NiFi release soon (1.5.0?) I am happy
>>> to
>>> > >      volunteer to RM that as well if needed.
>>> > >
>>> > >      Thanks
>>> > >
>>> > >      On Thu, Dec 7, 2017 at 10:39 AM, Bryan Bende <bbende@gmail.com>
>>> > wrote:
>>> > >      > Hey folks,
>>> > >      >
>>> > >      > There has been a lot of great work done on the NiFi Registry
[1]
>>> > and I
>>> > >      > think we are probably very close to an initial release focused
>>> on
>>> > >      > storing "versioned flows".
>>> > >      >
>>> > >      > Since NiFi will have a dependency on client code provided
by the
>>> > >      > registry, the first release of the registry would need to
occur
>>> > before
>>> > >      > the first release of NiFi that integrates with it. The work
on
>>> the
>>> > >      > NiFi side is being done as part of NIFI-4436, which can be
>>> > followed
>>> > >      > along on PR 2219 [2].
>>> > >      >
>>> > >      > Currently nifi-registry master is set to 0.0.1-SNAPSHOT,
but I
>>> > would
>>> > >      > propose the first release should be 0.1.0.
>>> > >      >
>>> > >      > Let me know if anyone has any thoughts or comments.  I'm
happy
>>> to
>>> > act
>>> > >      > as RM if no one else is interested in doing so, and we can
start
>>> > the
>>> > >      > process of going through JIRA to see what is left.
>>> > >      >
>>> > >      > Thanks,
>>> > >      >
>>> > >      > Bryan
>>> > >      >
>>> > >      > [1] https://nifi.apache.org/registry.html
>>> > >      > [2] https://github.com/apache/nifi/pull/2219
>>> > >
>>> > >
>>> > >
>>> >
>>> >
>>>

Mime
View raw message