hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joep Rottinghuis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting
Date Wed, 28 Sep 2016 19:20:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530597#comment-15530597
] 

Joep Rottinghuis commented on YARN-4561:
----------------------------------------

All data that comes in late would be marked as suspicious. Only if accompanied with non-suspicious
data will we keep this. If there is no other normal of final-value record we can discard this
suspicious data.

> Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting
> -----------------------------------------------------------------------
>
>                 Key: YARN-4561
>                 URL: https://issues.apache.org/jira/browse/YARN-4561
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Vrushali C
>            Assignee: Vrushali C
>              Labels: YARN-5355
>
> YARN-4062 deals with the flush and compaction related coprocessor basic functionality.
We also need to ensure we can turn compaction on/off as a whole (in case of dealing with production
issues) as well as provide a way to allow for blacklisting and whitelisting of processing
compaction for certain records.
> For instance, we may want to compact only those records which belong to applications
in that datacenter. This way we donot interfere with hbase replication causing coprocessors
to process the same record in more than one dc at the same time.
> Also, we might want to not compact/process certain records, perhaps whose rowkey matches
a certain criteria.
> Filing jira to track these enhancements



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message