fossology-python timeout when uploading some components
It happens with python3-cryptography
22-09-14 06:11:04 INFO aliens4friends.commands.upload | [python3-cryptography-36.0.2-r0] expanding alien package, it may require a lot of time
22-09-14 06:11:04 DEBUG aliens4friends.commons.package | [python3-cryptography-36.0.2-r0] adding internal archive cryptography-36.0.2.tar.gz
22-09-14 06:11:04 INFO aliens4friends.commons.fossywrapper | [python3-cryptography@36.0.2-r0-4758177b] Checking if it has already been uploaded
22-09-14 06:11:07 INFO fossology.uploads | Retrieved all 18 of uploads
22-09-14 06:11:07 INFO aliens4friends.commons.fossywrapper | get or create folder "Goofy"
22-09-14 06:11:07 INFO fossology.folders | Folder 'Goofy' already exists under the folder Software Repository (1)
22-09-14 06:11:07 INFO aliens4friends.commons.fossywrapper | Checking if another upload with name starting with python3-cryptography@ has already been uploaded in folder Goofy
22-09-14 06:11:09 INFO fossology.uploads | Retrieved all 18 of uploads
22-09-14 06:11:09 INFO aliens4friends.commons.fossyupload | [python3-cryptography@36.0.2-r0-4758177b] Preparing package for upload
22-09-14 06:11:13 INFO aliens4friends.commons.fossyupload | [python3-cryptography@36.0.2-r0-4758177b] Uploading package
22-09-14 06:11:13 INFO aliens4friends.commons.fossywrapper | [/build/tmp/tmpxedsoyej/python3-cryptography@36.0.2-r0-4758177b.tar.xz] Uploading the file to Fossology
22-09-14 06:11:13 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:13:13 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:15:14 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:17:14 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:19:14 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:21:14 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:23:14 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:25:14 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:27:14 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:29:14 DEBUG fossology.uploads | Retry GET upload 1917 after 120 seconds: Ununpack job not started. Please check job status at /api/v1/jobs?upload=1917
22-09-14 06:31:14 ERROR aliens4friends.commands.command | FossyWrapperException: Can't upload package to fossology. Is fossology scheduler running?
22-09-14 06:31:14 DEBUG aliens4friends.commands.command | Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/tenacity/__init__.py", line 407, in __call__
result = fn(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/fossology/uploads.py", line 120, in detail_upload
raise TryAgain
tenacity.TryAgain
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/aliens4friends/commons/fossywrapper.py", line 151, in upload
upload = self.fossology.upload_file(
File "/usr/local/lib/python3.8/site-packages/fossology/uploads.py", line 278, in upload_file
upload = self.detail_upload(
File "/usr/local/lib/python3.8/site-packages/tenacity/__init__.py", line 324, in wrapped_f
return self(f, *args, **kw)
File "/usr/local/lib/python3.8/site-packages/tenacity/__init__.py", line 404, in __call__
do = self.iter(retry_state=retry_state)
File "/usr/local/lib/python3.8/site-packages/tenacity/__init__.py", line 361, in iter
raise retry_exc from fut.exception()
tenacity.RetryError: RetryError[<Future at 0x7fa95045a190 state=finished raised TryAgain>]
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/aliens4friends/commands/command.py", line 103, in _run
return self.run(*args) if args else self.run([])
File "/usr/local/lib/python3.8/site-packages/aliens4friends/commands/upload.py", line 116, in run
upload_id = a2f.get_or_do_upload() # if exists, a2f.uploaded is False
File "/usr/local/lib/python3.8/site-packages/aliens4friends/commons/fossyupload.py", line 125, in get_or_do_upload
self.upload = self.fossy.upload(
File "/usr/local/lib/python3.8/site-packages/aliens4friends/commons/fossywrapper.py", line 159, in upload
raise FossyWrapperException(
aliens4friends.commons.fossywrapper.FossyWrapperException: Can't upload package to fossology. Is fossology scheduler running?
Actually, the component is uploaded (but it is not renamed and keeps the .tar.xz
suffix), it's the python wrapper that returns a timeout