added UDRG library to the spark job build (!12) · Merge requests · Eclipse Research Labs / DATAMITE project / data-support-tools / Data_Ingestion_and_Storage / Infrastructure

In order to the Spark Jobs use the UDRG service as a library, it must be included in the Spark Job Dockerfile.

Steps:

Add to the build script the curl command to download the UDRG library from Gitlab. The URL is: https://gitlab.eclipse.org/eclipse-research-labs/datamite-project/data-quality/user-defined-rules-generator/-/blob/main/ruleinterpreter-0.1-py2.py3-none-any.whl
Add to the pip install command in the Dockerfile the UDRG library.

added UDRG library to the spark job build