phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From twdsilva <...@git.apache.org>
Subject [GitHub] phoenix pull request #303: PHOENIX-3534 Support multi region SYSTEM.CATALOG ...
Date Mon, 25 Jun 2018 15:00:23 GMT
Github user twdsilva commented on a diff in the pull request:

    https://github.com/apache/phoenix/pull/303#discussion_r197829637
  
    --- Diff: phoenix-core/src/main/java/org/apache/phoenix/replication/SystemCatalogWALEntryFilter.java
---
    @@ -35,20 +35,18 @@
      * during cluster upgrades. However, tenant-owned data such as tenant-owned views need
to
      * be copied. This WALEntryFilter will only allow tenant-owned rows in SYSTEM.CATALOG
to
      * be replicated. Data from all other tables is automatically passed. It will also copy
    - * child links in SYSTEM.CATALOG that are globally-owned but point to tenant-owned views.
    + * child links in SYSTEM.CHILD_LINK that are globally-owned but point to tenant-owned
views.
      *
      */
     public class SystemCatalogWALEntryFilter implements WALEntryFilter {
     
    -  private static byte[] CHILD_TABLE_BYTES =
    -      new byte[]{PTable.LinkType.CHILD_TABLE.getSerializedValue()};
    -
       @Override
       public WAL.Entry filter(WAL.Entry entry) {
     
    -    //if the WAL.Entry's table isn't System.Catalog, it auto-passes this filter
    +    //if the WAL.Entry's table isn't System.Catalog or System.Child_Link, it auto-passes
this filter
         //TODO: when Phoenix drops support for pre-1.3 versions of HBase, redo as a WALCellFilter
    -    if (!SchemaUtil.isMetaTable(entry.getKey().getTablename().getName())){
    +    byte[] tableName = entry.getKey().getTablename().getName();
    +	if (!SchemaUtil.isMetaTable(tableName) && !SchemaUtil.isChildLinkTable(tableName)){
    --- End diff --
    
    SYSTEM.CHILD_LINK contains the parent->child linking rows and cells we use to detect
race conditions (eg a column of conflicting type being added at the same time to a parent
and child). 
    The latter cells are written with a short TTL. 
    I think we can use HBase replication for SYSTEM.CHILD_LINK. All the tenant specific view
metadata rows in SYSTEM.CATALOG start with tenant id. 
    I will modify this filter to how it was before PHOENIX-4229. 
    @gjacoby126  Thanks for the suggestion.


---

Mime
View raw message