I have build a rule automation code which automates rule creation and dataset creation in collibra data quality.
I used pentaho as a tool and applied manual development process into collibra data quality swagger api. Input for manual development comes from collibra data glossary in the form of ads ,
By using ADS ( consist of table name column name , db name , connection name , rule name , application name )
I manipulate these information and using cdq swagger api , I create dataset and rules.
1st phase of work is creating template kind of rules which got complete and moved to production
2nd phase of is creating medium complex rules where we have analysed the rules in ADS and listed 9 rules as a medium complex
Datasteward enters the SQL logic of each rule in that particular rule pseudocode
So we use that information and creation rule query of custom medium complex rules
This phase 2 is been moved to production
After the phase 2 migrated to production during July end
In the August Month , ASD team utilitized Rule automation to create 716 Rules out of 844 By following the prerequisites. (Consist of Generic Rules , Custom Medium Complex Rules)
I need a ppt of two slides displaying the Rule Automation Medium Complex achivement
, Stats of ASD utilitizing Rule Automation after phase 2 productionization,
Different types medium complex custom rules are current code confirmity , country code conformity , condition completeness, ect of 9 rules
Short Description of Rule Automation, metrics and it stats,
Previously how it was happenin
g and now it is working