nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aldrin Piri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MINIFI-425) MiNiFi contents_repository config problem
Date Wed, 17 Jan 2018 16:09:05 GMT

    [ https://issues.apache.org/jira/browse/MINIFI-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328923#comment-16328923
] 

Aldrin Piri commented on MINIFI-425:
------------------------------------

[~saulo] The minif-app.log looks a little light.  Also, were you performing all those restarts
exhibited in the minifi-bootstrap.log?

If not, my suspicion is that you were encountering a heap issue from the SplitText.  Typically
this is aided by tiering SplitText processors (split a very large file into 1k chunks and
then do individual splits).

> MiNiFi contents_repository config problem
> -----------------------------------------
>
>                 Key: MINIFI-425
>                 URL: https://issues.apache.org/jira/browse/MINIFI-425
>             Project: Apache NiFi MiNiFi
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>            Reporter: Saulo Sobreiro
>            Priority: Major
>         Attachments: config.yml, minifi-app.log, minifi-bootstrap.log
>
>
> *Problem:*
> I found 2 problems in this my MiNiFi-NiFi setup:
> - The first is related to my MiNiFi ./content_repository. This path is using 
> around 120GB of disk space, which is far more than I can afford for this 
> application; 
> - The second is related to the solution I tried to the previous problem. I 
> tried to configure the MiNiFi nifi.properties with the following values: 
> ´´´ 
> nifi.content.repository.archive.max.retention.period=6 hours 
> nifi.content.repository.archive.max.usage.percentage=5% 
> ´´´ 
> However, when I restart MiNiFi this instance for it to use the new 
> properties, I noticed that it overwrites my nifi.properties file with some 
> default values erasing the new values. 
>  
> *Versions in use:*
> NiFi - version 1.2.0 installed with HDF (3.0.2.0-76) 
> MiNiFi - version 0.3.0 (transfered from 
> [http://mirrors.up.pt/pub/apache/nifi/minifi/0.3.0/minifi-0.3.0-bin.tar.gz]) 
> NiFi OS - RHEL 7.4
> MiNiFi OS - RHEL 7.2 
>  
> *config.yml*
> The config.yml file can be found attached. It is the version used in production after
replacing some information like URLs. 
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message