Temporary files
As the data are imported into the Data Product Composition Tool, and the user processes the data, a new temporary file is generated for each action until the user decides which file(s) will be saved as a data product.
For example:
- If the user aggregates dataset1 and dataset2 by rows, a new temporary file named dataset1_dataset2_agg_rows is generated.
- If the user deletes a column from dataset2, a new file named dataset2_del_col_1 is created.
- If the user deletes another column, the system generates dataset2_del_col_2, and so on.
As a result, each user action produces a new temporary file named according to a pattern that includes the dataset name(s), the action performed, and a version identifier when needed.