Import error

changed the description

It looks like you have two versions of Aidge, one with python 3.8 and 3.10.

I think you should try to remove the file /mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu/aidge_backend_cpu.cpython-310-x86_64-linux-gnu.so which I suspect generate the error.

Cheers,

Cyril

Thank you @cmoineau but it doesn't solve:

farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu$ ls
__init__.py  _version.py                                        aidge_backend_cpu.cpython-38-x86_64-linux-gnu.so
__pycache__  aidge_backend_cpu.cpython-310-x86_64-linux-gnu.so  version.txt
farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu$ rm aidge_backend_cpu.cpython-310-x86_64-linux-gnu.so
farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu$ cd ../../..
farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib$ cd ../..
farges@WDTIS181H:/mnt/d/farges/Documents/aidge$ source env_aidge/bin/activate
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge$ python3
Python 3.8.16 (default, Oct 29 2024, 09:03:22)
[GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import aidge_core
>>> import aidge_backend_cpu
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu/__init__.py", line 2, in <module>
    from aidge_backend_cpu.aidge_backend_cpu import * # import so generated by PyBind
ImportError: libpython3.8.so.1.0: cannot open shared object file: No such file or directory
>>>

I will try to reinstall aidge_backend_cpu .

The strange thing is that installing again generate again the 310 lib :

(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ pip install .
Processing /mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: numpy in /mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages (from aidge_backend_cpu==0.3.2.dev17+g2a745b7) (1.24.4)
Building wheels for collected packages: aidge_backend_cpu
  Building wheel for aidge_backend_cpu (pyproject.toml) ... done
  Created wheel for aidge_backend_cpu: filename=aidge_backend_cpu-0.3.2.dev17+g2a745b7-cp38-cp38-linux_x86_64.whl size=31014530 sha256=b3d206170ea7c3a3715882cb5dcbf0f19729c5b88c7dfb80f3c8101d44fa8df7
  Stored in directory: /tmp/pip-ephem-wheel-cache-0bpe0b51/wheels/d5/58/41/89f16c76dcff9f3a1265d47c0893dab4e4e75a170cda5cefb0
Successfully built aidge_backend_cpu
Installing collected packages: aidge_backend_cpu
  Attempting uninstall: aidge_backend_cpu
    Found existing installation: aidge_backend_cpu 0.3.2.dev17+g2a745b7
    Uninstalling aidge_backend_cpu-0.3.2.dev17+g2a745b7:
      Successfully uninstalled aidge_backend_cpu-0.3.2.dev17+g2a745b7
Successfully installed aidge_backend_cpu-0.3.2.dev17+g2a745b7
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ cd ../../../env_aidge/lib/python3.8/site-packages/aidge_backend_cpu
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu$ ls -l
total 86724
-rwxrwxrwx 1 farges farges      124 Oct 29 16:08 __init__.py
drwxrwxrwx 1 farges farges     4096 Oct 29 16:08 __pycache__
-rwxrwxrwx 1 farges farges      196 Oct 29 16:08 _version.py
-rwxrwxrwx 1 farges farges  4974920 Oct 29 16:08 aidge_backend_cpu.cpython-310-x86_64-linux-gnu.so
-rwxrwxrwx 1 farges farges 83826864 Oct 29 16:08 aidge_backend_cpu.cpython-38-x86_64-linux-gnu.so
-rwxrwxrwx 1 farges farges        6 Oct 29 16:08 version.txt
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu$

I think you should try to remove egg and build files before reinstalling as they may cache some informations.

And the RECORD of the dist-info indicates this file:

(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info$ more RECORD
aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info/INSTALLER,sha256=zuuue4knoyJ-UwPPXg8fezS7VCrXJQrAP7zeNuwvFQg,4
aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info/LICENSE,sha256=C-zxZWe-t3-iUrdmRjHdF3yPmhiJ5ImVtFN5xxMOUwM,14198
aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info/METADATA,sha256=H0hxA2gY7z3osZ1D6Fa0xwTbijGW4QmlQTDltINt1xY,19392
aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info/RECORD,,
aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info/REQUESTED,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info/WHEEL,sha256=QjksN8yqvEZiPRpkysvFl_zIoTPrHYtCPi208j7yd3I,102
aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info/direct_url.json,sha256=tBESLrF8Li2VT7skYfaSeNlpDn4JfYx0T_udm2RZ6Xw,93
aidge_backend_cpu-0.3.2.dev17+g2a745b7.dist-info/top_level.txt,sha256=o6c5mPJ_13HQADHgebfqo8J99lMxpyhlmO5A91B9Lxo,18
aidge_backend_cpu/__init__.py,sha256=qz9W5q4jScnRNIeazIhtk_5o3WcCTA50riKX5pJcmXU,124
aidge_backend_cpu/__pycache__/__init__.cpython-38.pyc,,
aidge_backend_cpu/__pycache__/_version.cpython-38.pyc,,
aidge_backend_cpu/_version.py,sha256=iHeP0RBW-cpONsdL0gNdLOIrzv--yVKnlTFXlYH5Lx4,196
aidge_backend_cpu/aidge_backend_cpu.cpython-310-x86_64-linux-gnu.so,sha256=WEh3W9isioJA9vYsA8csVntlAKp95-dojHV2F1bCdk4,4
974920
aidge_backend_cpu/aidge_backend_cpu.cpython-38-x86_64-linux-gnu.so,sha256=SxNaHVLYGZI58u9YutA_XLQufq2Zg9y99ESJoLxgB28,83
826864
aidge_backend_cpu/version.txt,sha256=OrlMBNJJhvOvKIuhzaLAu928Wonf8JcYKAX1RXjh6nU,6

Removing build and egg, generates only one lib but doesn't remove the error:

(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ rm -r build
rm: remove write-protected regular file 'build/_deps/pybind11-src/.git/objects/pack/pack-98b3965051cb8135e13e85b45ab360cd9bbd7a18.idx'? y
rm: remove write-protected regular file 'build/_deps/pybind11-src/.git/objects/pack/pack-98b3965051cb8135e13e85b45ab360cd9bbd7a18.pack'? y
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ rm -r aidge_backend_cpu.egg-info/
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ ls
CHANGELOG       MANIFEST.in       aidge_backend_cpu                  include         setup.ps1  unit_tests
CMakeLists.txt  README.md         aidge_backend_cpu-config.cmake.in  pyproject.toml  setup.py   version.txt
LICENSE         UNKNOWN.egg-info  cmake                              python_binding  src
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ pip install .
Processing /mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: numpy in /mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages (from aidge_backend_cpu==0.3.2.dev17+g2a745b7) (1.24.4)
Building wheels for collected packages: aidge_backend_cpu
  Building wheel for aidge_backend_cpu (pyproject.toml) ... done
  Created wheel for aidge_backend_cpu: filename=aidge_backend_cpu-0.3.2.dev17+g2a745b7-cp38-cp38-linux_x86_64.whl size=1359773 sha256=26df85e97681141017fa52b3d5b06d77fc249d7d7f8a6e68bfede8a91350eace
  Stored in directory: /tmp/pip-ephem-wheel-cache-8tdr6_yy/wheels/d5/58/41/89f16c76dcff9f3a1265d47c0893dab4e4e75a170cda5cefb0
Successfully built aidge_backend_cpu
Installing collected packages: aidge_backend_cpu
  Attempting uninstall: aidge_backend_cpu
    Found existing installation: aidge_backend_cpu 0.3.2.dev17+g2a745b7
    Uninstalling aidge_backend_cpu-0.3.2.dev17+g2a745b7:
      Successfully uninstalled aidge_backend_cpu-0.3.2.dev17+g2a745b7
Successfully installed aidge_backend_cpu-0.3.2.dev17+g2a745b7
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ python3
Python 3.8.16 (default, Oct 29 2024, 09:03:22)
[GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import aidge_core
>>> import aidge_backend_cpu
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu/aidge_backend_cpu/__init__.py", line 2, in <module>
    from aidge_backend_cpu.aidge_backend_cpu import * # import so generated by PyBind
ModuleNotFoundError: No module named 'aidge_backend_cpu.aidge_backend_cpu'
>>> quit()
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ cd ../../../env_aidge/lib/python3.8/site-packages/aidge_backend_cpu
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu$ ls
__init__.py  __pycache__  _version.py  aidge_backend_cpu.cpython-38-x86_64-linux-gnu.so
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/env_aidge/lib/python3.8/site-packages/aidge_backend_cpu$

I found one way to bypass the problem: I added a line "from aidge_backend_cpu import *" before "import aidge_backend_cpu". If this is the new way to import the module, the issue can be closed. Otherwise I guess that adding this line in the init().py may solve the issue.

(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_core/aidge_core$ python3
Python 3.8.16 (default, Oct 29 2024, 09:03:22)
[GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import aidge_core
>>> from aidge_backend_cpu import *
>>> import aidge_backend_cpu
>>> ab = aidge_core.Tensor.get_available_backends()
>>> print(ab)
{'cpu', 'export_serialize'}

No, this is not the new way to import backends, I am confused about this behavior.

Especially since I cannot reproduce it...

I understood the problem. The mistake is mine: import should not be done from inside the package folder. See:

(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ Python3
Python 3.8.16 (default, Oct 29 2024, 09:03:22)
[GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import aidge_core
>>> import aidge_backend_cpu
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu/aidge_backend_cpu/__init__.py", line 2, in <module>
    from aidge_backend_cpu.aidge_backend_cpu import * # import so generated by PyBind
ModuleNotFoundError: No module named 'aidge_backend_cpu.aidge_backend_cpu'
>>> quit()
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge/aidge_backend_cpu$ cd ..
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge$ Python3
Python 3.8.16 (default, Oct 29 2024, 09:03:22)
[GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import aidge_core
>>> import aidge_backend_cpu
>>> quit()
(env_aidge) farges@WDTIS181H:/mnt/d/farges/Documents/aidge/aidge/aidge$

I close the issue.

closed

mentioned in issue maab05/aidge#1 (closed)

Import error

What commit version of aidge do you use

Problem description

Reproducible example code and log

Context

Linked to old closed issue

Designs

Child items ...

Activity