nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MINIFI-107) Support for Process Groups
Date Fri, 04 Nov 2016 21:14:58 GMT

    [ https://issues.apache.org/jira/browse/MINIFI-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637707#comment-15637707
] 

ASF GitHub Bot commented on MINIFI-107:
---------------------------------------

Github user JPercivall commented on a diff in the pull request:

    https://github.com/apache/nifi-minifi/pull/50#discussion_r86612327
  
    --- Diff: minifi-toolkit/minifi-toolkit-configuration/src/test/resources/ProcessGroupsAndRemoteProcessGroups.yml
---
    @@ -0,0 +1,276 @@
    +# Licensed to the Apache Software Foundation (ASF) under one or more
    +# contributor license agreements.  See the NOTICE file distributed with
    +# this work for additional information regarding copyright ownership.
    +# The ASF licenses this file to You under the Apache License, Version 2.0
    +# (the \"License\"); you may not use this file except in compliance with
    +# the License.  You may obtain a copy of the License at
    +#
    +#     http://www.apache.org/licenses/LICENSE-2.0
    +#
    +# Unless required by applicable law or agreed to in writing, software
    +# distributed under the License is distributed on an \"AS IS\" BASIS,
    +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    +# See the License for the specific language governing permissions and
    +# limitations under the License.
    +
    +MiNiFi Config Version: 2
    +Flow Controller:
    +  name: ProcessGroupsAndRemoteProcessGroups
    +  comment: ''
    +Core Properties:
    +  flow controller graceful shutdown period: 10 sec
    +  flow service write delay interval: 500 ms
    +  administrative yield duration: 30 sec
    +  bored yield duration: 10 millis
    +  max concurrent threads: 1
    +FlowFile Repository:
    +  partitions: 256
    +  checkpoint interval: 2 mins
    +  always sync: false
    +  Swap:
    +    threshold: 20000
    +    in period: 5 sec
    +    in threads: 1
    +    out period: 5 sec
    +    out threads: 4
    +Content Repository:
    +  content claim max appendable size: 10 MB
    +  content claim max flow files: 100
    +  always sync: false
    +Provenance Repository:
    +  provenance rollover time: 1 min
    +Component Status Repository:
    +  buffer size: 1440
    +  snapshot frequency: 1 min
    +Security Properties:
    +  keystore: ''
    +  keystore type: ''
    +  keystore password: ''
    +  key password: ''
    +  truststore: ''
    +  truststore type: ''
    +  truststore password: ''
    +  ssl protocol: ''
    +  Sensitive Props:
    +    key:
    +    algorithm: PBEWITHMD5AND256BITAES-CBC-OPENSSL
    +    provider: BC
    +Processors:
    +- id: 207748d1-0158-1000-0000-000000000000
    +  name: GenerateFlowFile
    +  class: org.apache.nifi.processors.standard.GenerateFlowFile
    +  max concurrent tasks: 1
    +  scheduling strategy: TIMER_DRIVEN
    +  scheduling period: 0 sec
    +  penalization period: 30 sec
    +  yield period: 1 sec
    +  run duration nanos: 0
    +  auto-terminated relationships list: []
    +  Properties:
    +    Batch Size: '1'
    +    Data Format: Binary
    +    File Size: 1 b
    +    Unique FlowFiles: 'false'
    +- id: 2079e8bd-0158-1000-0000-000000000000
    +  name: LogAttribute
    +  class: org.apache.nifi.processors.standard.LogAttribute
    +  max concurrent tasks: 1
    +  scheduling strategy: TIMER_DRIVEN
    +  scheduling period: 0 sec
    +  penalization period: 30 sec
    +  yield period: 1 sec
    +  run duration nanos: 0
    +  auto-terminated relationships list:
    +  - success
    +  Properties:
    +    Attributes to Ignore:
    +    Attributes to Log:
    +    Log Level: info
    +    Log Payload: 'false'
    +    Log prefix:
    +- id: 2077ab1e-0158-1000-0000-000000000000
    +  name: UpdateAttribute
    +  class: org.apache.nifi.processors.attributes.UpdateAttribute
    +  max concurrent tasks: 1
    +  scheduling strategy: TIMER_DRIVEN
    +  scheduling period: 0 sec
    +  penalization period: 30 sec
    +  yield period: 1 sec
    +  run duration nanos: 0
    +  auto-terminated relationships list: []
    +  Properties:
    +    Delete Attributes Expression:
    +    top: top
    +Process Groups:
    +- id: 207888b1-0158-1000-0000-000000000000
    +  name: middle
    +  Processors:
    +  - id: 2078f34e-0158-1000-0000-000000000000
    +    name: UpdateAttribute
    +    class: org.apache.nifi.processors.attributes.UpdateAttribute
    +    max concurrent tasks: 1
    +    scheduling strategy: TIMER_DRIVEN
    +    scheduling period: 0 sec
    +    penalization period: 30 sec
    +    yield period: 1 sec
    +    run duration nanos: 0
    +    auto-terminated relationships list: []
    +    Properties:
    +      Delete Attributes Expression:
    +      middle: middle
    +  Process Groups:
    +  - id: 20794cd4-0158-1000-0000-000000000000
    +    name: bottom
    +    Processors:
    +    - id: 207a89ba-0158-1000-0000-000000000000
    +      name: UpdateAttribute
    +      class: org.apache.nifi.processors.attributes.UpdateAttribute
    +      max concurrent tasks: 1
    +      scheduling strategy: TIMER_DRIVEN
    +      scheduling period: 0 sec
    +      penalization period: 30 sec
    +      yield period: 1 sec
    +      run duration nanos: 0
    +      auto-terminated relationships list: []
    +      Properties:
    +        Delete Attributes Expression:
    +        bottom: bottom
    +    Process Groups: []
    +    Input Ports:
    +    - id: 207a5f50-0158-1000-0000-000000000000
    +      name: input
    +    Output Ports:
    +    - id: 207a6d92-0158-1000-0000-000000000000
    +      name: output
    +    Connections:
    +    - id: 21a6abb9-0158-1000-0000-000000000000
    +      name: UpdateAttribute/success/21a39aba-0158-1000-a1a0-1b55bcddcd72
    +      source id: 207a89ba-0158-1000-0000-000000000000
    +      source relationship names:
    +      - success
    +      destination id: 21a39aba-0158-1000-a1a0-1b55bcddcd72
    +      max work queue size: 10000
    +      max work queue data size: 1 GB
    +      flowfile expiration: 0 sec
    +      queue prioritizer class: ''
    +    - id: 207ad5e9-0158-1000-0000-000000000000
    +      name: UpdateAttribute/success/null
    +      source id: 207a89ba-0158-1000-0000-000000000000
    +      source relationship names:
    +      - success
    +      destination id: 207a6d92-0158-1000-0000-000000000000
    +      max work queue size: 10000
    +      max work queue data size: 1 GB
    +      flowfile expiration: 0 sec
    +      queue prioritizer class: ''
    +    - id: 207aca0d-0158-1000-0000-000000000000
    +      name: null//UpdateAttribute
    +      source id: 207a5f50-0158-1000-0000-000000000000
    +      source relationship names: []
    +      destination id: 207a89ba-0158-1000-0000-000000000000
    +      max work queue size: 10000
    +      max work queue data size: 1 GB
    +      flowfile expiration: 0 sec
    +      queue prioritizer class: ''
    +    Remote Processing Groups:
    +    - name: http://localhost:9091/nifi
    +      url: http://localhost:9091/nifi
    +      comment: ''
    +      timeout: 30 sec
    +      yield period: 10 sec
    +      Input Ports:
    +      - id: 21a39aba-0158-1000-a1a0-1b55bcddcd72
    +        name: input2
    +        comment: ''
    +        max concurrent tasks: 1
    +        use compression: false
    +  Input Ports:
    +  - id: 2078c936-0158-1000-0000-000000000000
    +    name: input
    +  Output Ports:
    +  - id: 2079b327-0158-1000-0000-000000000000
    +    name: output
    +  Connections:
    +  - id: 21a5b1f1-0158-1000-0000-000000000000
    +    name: UpdateAttribute/success/21a2fb5e-0158-1000-3b5e-5a7d3aaee01b
    +    source id: 2078f34e-0158-1000-0000-000000000000
    +    source relationship names:
    +    - success
    +    destination id: 21a2fb5e-0158-1000-3b5e-5a7d3aaee01b
    +    max work queue size: 10000
    +    max work queue data size: 1 GB
    +    flowfile expiration: 0 sec
    +    queue prioritizer class: ''
    +  - id: 207b0eb1-0158-1000-0000-000000000000
    +    name: UpdateAttribute/success/null
    +    source id: 2078f34e-0158-1000-0000-000000000000
    +    source relationship names:
    +    - success
    +    destination id: 207a5f50-0158-1000-0000-000000000000
    +    max work queue size: 10000
    +    max work queue data size: 1 GB
    +    flowfile expiration: 0 sec
    +    queue prioritizer class: ''
    +  - id: 20792ec2-0158-1000-0000-000000000000
    +    name: null//UpdateAttribute
    +    source id: 2078c936-0158-1000-0000-000000000000
    +    source relationship names: []
    +    destination id: 2078f34e-0158-1000-0000-000000000000
    +    max work queue size: 10000
    +    max work queue data size: 1 GB
    +    flowfile expiration: 0 sec
    +    queue prioritizer class: ''
    +  - id: 207b1880-0158-1000-0000-000000000000
    +    name: null//null
    --- End diff --
    
    May be indicative of something wrong in the way this config was built, why are there a
bunch of "null" values in the names?


> Support for Process Groups
> --------------------------
>
>                 Key: MINIFI-107
>                 URL: https://issues.apache.org/jira/browse/MINIFI-107
>             Project: Apache NiFi MiNiFi
>          Issue Type: Improvement
>            Reporter: Bryan Rosander
>            Assignee: Bryan Rosander
>
> Process groups are a good way to simplify the design part of development in NiFi.  MiNiFi
Java currently doesn't support them but should in order to make designing templates compatible
with MiNiFi a better experience.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message