ranger-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pradeep Agrawal <pradeepagrawal8...@gmail.com>
Subject Re: Review Request 69187: RANGER-2268: Optimize policy and tags migration to new schema
Date Fri, 26 Oct 2018 05:05:08 GMT


> On Oct. 26, 2018, 5:03 a.m., Pradeep Agrawal wrote:
> > Ship It!

Tested patch with 5000 policies and it took 14 minutes only while earlier it was taking several
hours.


- Pradeep


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69187/#review210078
-----------------------------------------------------------


On Oct. 26, 2018, 1:42 a.m., Abhay Kulkarni wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69187/
> -----------------------------------------------------------
> 
> (Updated Oct. 26, 2018, 1:42 a.m.)
> 
> 
> Review request for ranger, Madhan Neethiraj, Pradeep Agrawal, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-2268
>     https://issues.apache.org/jira/browse/RANGER-2268
> 
> 
> Repository: ranger
> 
> 
> Description
> -------
> 
> Policies and tags are migrated to new schema introduced in RANGER-2203 using java patches.
The time for migration can increase very rapidly as number of migrated policies/tags increase,
and may take hours for a few thousand large policies containing many users and groups.
> 
> The fix involves updating every policy in a new transaction to ensure that JPA cache
is kept to a minimum size.
> 
> 
> Diffs
> -----
> 
>   security-admin/src/main/java/org/apache/ranger/patch/PatchForUpdatingPolicyJson_J10019.java
6a21effe4 
>   security-admin/src/main/java/org/apache/ranger/patch/PatchForUpdatingTagsJson_J10020.java
035e0239a 
> 
> 
> Diff: https://reviews.apache.org/r/69187/diff/1/
> 
> 
> Testing
> -------
> 
> Tested migration with a few thousand policies. Ensured that the migration time is reduced
considerably.
> 
> 
> Thanks,
> 
> Abhay Kulkarni
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message