Bug: PDLC-CA input CSV file is not being generated
The following are steps done to diagnose errors with PDLC, in the latest CODECO integration code (cloned on 05.11.2024, at 9:30 am CET)
Logs of PDLC-CA, indicate that it's still waiting for the data.csv file to be generated by PDLC-DP at the shared volume in the path: /data/CA/data.csv:
Created CSV file: /data/RL/metrics.csv
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Waiting for the directory and input CSV file to exist...
Hence, the next step is to check the output of PDLC-DP, which indicates a bug caused by ACM:
Directory '/data/RL/' created successfully.
Directory '/data/CA/' created successfully.
Directory '/data/GNN/' created successfully.
Directory '/data/min_max/' created successfully.
Directory '/data/CA/' already exists.
[INFO] - here an empty list occurs
Directory '/data/RL/' already exists.
[RLs INFO]- here an empty list occurs
Directory '/data/GNN/' already exists.
Directory '/data/min_max/' already exists.
[GNNs INFO]- here an empty list occurs
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5026'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5028'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5033'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5034'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5037'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5038'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5042'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5043'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5047'}}
BUG ON ACM: {'apiVersion': 'codeco.he-codeco.eu/v1alpha1', 'items': [], 'kind': 'CodecoAppList', 'metadata': {'continue': '', 'resourceVersion': '5049'}}
Another step of verification, is to check the volume from within the PDLC-DP pod, to see if PDLC-DP is generating /data/CA/data.csv, using the following cmd kubectl exec -it pdlc-dp-f899dc9cf-hm22l -n he-codeco-pdlc -- /bin/sh
# cd /data
# ls
CA GNN RL min_max
# cd CA
# ls --->(returns nothing in the dir /data/CA)
# cd ..
# ls
CA GNN RL min_max
# cd RL
# ls
CRDs metrics.csv trained_models ---> (we cant see test_nodes.csv, which is expected to be generated by PDLC-DP)