Skip to content

Bulk data upload error

Dear Developers, I deployed the dev-branch of this repository on our VM. The service deployment (with docker swarm following the README) went well. However, when I try to upload the dataset, I received an error as attached in the

To understand the origin, we tried to trace the logs of the service containers and noticed the following errors in Spark and Kpi-library containers that relates to the pip installation of "kpi_library-0.0.2-py3-none-any.whl"

Spark container error

Processing /tmp/kpi_library-0.0.1-py3-none-any.whl ERROR: Could not install packages due to an OSError: [Errno 2] No such file or directory: '/tmp/kpi_library-0.0.1-py3-none-any.whl'

Kpi-library container error

WARNING: Requirement '/tmp/kpi_library-0.0.2-py3-none-any.whl' looks like a filename, but the file does not exist Processing /tmp/kpi_library-0.0.2-py3-none-any.whl ERROR: Could not install packages due to an OSError: [Errno 2] No such file or directory: '/tmp/kpi_library-0.0.2-py3-none-any.whl'

  1. The path /tmp is defined inside the infrastructure/charts/datamite/conf/kpilibrary-db-init/prepare_python.sh
  2. The url of the pip wheel is working though.

I would appreciate any suggestion to resolve this issue.