Skip to content

Mage AI - DB pipelines Integration with QualityEvaluator

Goals:

  • Define sampling strategy for DB queries (SQL & NoSQL)
  • Implement a solution for sample data based on the above strategy.
  • Pass the extracted data to the Quality Evaluator service and store all the information through Governance API.

In this scenario, a strategy should be defined in order to manage large volumes of data. The default approach will be sampling.

/cc @jpla

Edited by Javier Belenguer Faguás