Unable to load celery application

[arun-gupta]

Trying to find a workaround for the failure mentioned in #20, and run make all-services command in the terminal. Now, getting a different error:

ubuntu@ip-172-31-40-162:~/pdf-to-podcast$ make all-services
\033[0;32m✓ ELEVENLABS_API_KEY is set\033[0m  
\033[0;32m✓ NVIDIA_API_KEY is set\033[0m  
\033[0;32m✓ MAX_CONCURRENT_REQUESTS is set\033[0m  
\033[0;32mCreating data/minio directory...\033[0m  
docker compose down
\033[0;32mStarting development environment all-services...\033[0m  
[+] Running 24/24

. . .

jaeger-1         | {"level":"info","ts":1757555426.5781221,"caller":"grpc@v1.75.0/clientconn.go:1226","msg":"[core] [Channel #1 SubChannel #8]Subchannel Connectivity change to READY"}
jaeger-1         | {"level":"info","ts":1757555426.578187,"caller":"pickfirstleaf/pickfirstleaf.go:176","msg":"[pick-first-leaf-lb] [pick-first-leaf-lb 0xc0000baa20] SubConn 0xc0006253b0 reported connectivity state READY and the health listener is disabled. Transitioning SubConn to READY."}
jaeger-1         | {"level":"info","ts":1757555426.5782096,"caller":"grpc@v1.75.0/clientconn.go:563","msg":"[core] [Channel #1]Channel Connectivity change to READY"}
celery-worker-1  | 
celery-worker-1  | A module that was compiled using NumPy 1.x cannot be run in
celery-worker-1  | NumPy 2.2.6 as it may crash. To support both 1.x and 2.x
celery-worker-1  | versions of NumPy, modules must be compiled with NumPy 2.0.
celery-worker-1  | Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.
celery-worker-1  | 
celery-worker-1  | If you are a user of the module, the easiest solution will be to
celery-worker-1  | downgrade to 'numpy<2' or try to upgrade the affected module.
celery-worker-1  | We expect that some modules will need time to support NumPy 2.
celery-worker-1  | 
celery-worker-1  | Traceback (most recent call last):  File "/opt/conda/bin/celery", line 8, in <module>
celery-worker-1  |     sys.exit(main())
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/celery/__main__.py", line 15, in main
celery-worker-1  |     sys.exit(_main())
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/celery/bin/celery.py", line 231, in main
celery-worker-1  |     return celery(auto_envvar_prefix="CELERY")
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
celery-worker-1  |     return self.main(*args, **kwargs)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 1078, in main
celery-worker-1  |     rv = self.invoke(ctx)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 1685, in invoke
celery-worker-1  |     super().invoke(ctx)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
celery-worker-1  |     return ctx.invoke(self.callback, **ctx.params)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 783, in invoke
celery-worker-1  |     return __callback(*args, **kwargs)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/click/decorators.py", line 33, in new_func
celery-worker-1  |     return f(get_current_context(), *args, **kwargs)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/celery/bin/celery.py", line 141, in celery
celery-worker-1  |     app = find_app(app)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/celery/app/utils.py", line 383, in find_app
celery-worker-1  |     sym = symbol_by_name(app, imp=imp)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/kombu/utils/imports.py", line 59, in symbol_by_name
celery-worker-1  |     module = imp(module_name, package=package, **kwargs)
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/celery/utils/imports.py", line 109, in import_from_cwd
celery-worker-1  |     return imp(module, package=package)
celery-worker-1  |   File "/opt/conda/lib/python3.11/importlib/__init__.py", line 126, in import_module
celery-worker-1  |     return _bootstrap._gcd_import(name[level:], package, level)
celery-worker-1  |   File "/app/tasks.py", line 3, in <module>
celery-worker-1  |     from docling.document_converter import DocumentConverter
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/docling/document_converter.py", line 27, in <module>
celery-worker-1  |     from docling.pipeline.standard_pdf_pipeline import StandardPdfPipeline
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/docling/pipeline/standard_pdf_pipeline.py", line 26, in <module>
celery-worker-1  |     from docling.models.table_structure_model import TableStructureModel
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/docling/models/table_structure_model.py", line 7, in <module>
celery-worker-1  |     from docling_ibm_models.tableformer.data_management.tf_predictor import TFPredictor
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/docling_ibm_models/tableformer/data_management/tf_predictor.py", line 10, in <module>
celery-worker-1  |     import cv2
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/cv2/__init__.py", line 181, in <module>
celery-worker-1  |     bootstrap()
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/cv2/__init__.py", line 153, in bootstrap
celery-worker-1  |     native_module = importlib.import_module("cv2")
celery-worker-1  |   File "/opt/conda/lib/python3.11/importlib/__init__.py", line 126, in import_module
celery-worker-1  |     return _bootstrap._gcd_import(name[level:], package, level)
celery-worker-1  | AttributeError: _ARRAY_API not found
celery-worker-1  | Usage: celery [OPTIONS] COMMAND [ARGS]...
celery-worker-1  | Try 'celery --help' for help.
celery-worker-1  | 
celery-worker-1  | Error: 
celery-worker-1  | Unable to load celery application.
celery-worker-1  | While trying to load the module tasks the following error occurred:
celery-worker-1  | Traceback (most recent call last):
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/celery/bin/celery.py", line 141, in celery
celery-worker-1  |     app = find_app(app)
celery-worker-1  |           ^^^^^^^^^^^^^
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/celery/app/utils.py", line 383, in find_app
celery-worker-1  |     sym = symbol_by_name(app, imp=imp)
celery-worker-1  |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/kombu/utils/imports.py", line 59, in symbol_by_name
celery-worker-1  |     module = imp(module_name, package=package, **kwargs)
celery-worker-1  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/celery/utils/imports.py", line 109, in import_from_cwd
celery-worker-1  |     return imp(module, package=package)
celery-worker-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
celery-worker-1  |   File "/opt/conda/lib/python3.11/importlib/__init__.py", line 126, in import_module
celery-worker-1  |     return _bootstrap._gcd_import(name[level:], package, level)
celery-worker-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
celery-worker-1  |   File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
celery-worker-1  |   File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
celery-worker-1  |   File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
celery-worker-1  |   File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
celery-worker-1  |   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
celery-worker-1  |   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
celery-worker-1  |   File "/app/tasks.py", line 3, in <module>
celery-worker-1  |     from docling.document_converter import DocumentConverter
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/docling/document_converter.py", line 27, in <module>
celery-worker-1  |     from docling.pipeline.standard_pdf_pipeline import StandardPdfPipeline
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/docling/pipeline/standard_pdf_pipeline.py", line 26, in <module>
celery-worker-1  |     from docling.models.table_structure_model import TableStructureModel
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/docling/models/table_structure_model.py", line 7, in <module>
celery-worker-1  |     from docling_ibm_models.tableformer.data_management.tf_predictor import TFPredictor
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/docling_ibm_models/tableformer/data_management/tf_predictor.py", line 10, in <module>
celery-worker-1  |     import cv2
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/cv2/__init__.py", line 181, in <module>
celery-worker-1  |     bootstrap()
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/cv2/__init__.py", line 153, in bootstrap
celery-worker-1  |     native_module = importlib.import_module("cv2")
celery-worker-1  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
celery-worker-1  |   File "/opt/conda/lib/python3.11/importlib/__init__.py", line 126, in import_module
celery-worker-1  |     return _bootstrap._gcd_import(name[level:], package, level)
celery-worker-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
celery-worker-1  | ImportError: numpy.core.multiarray failed to import
celery-worker-1  | 
celery-worker-1 exited with code 2
api-service-1    | INFO:     172.18.0.1:39108 - "GET / HTTP/1.1" 404 Not Found
api-service-1    | INFO:     172.18.0.1:39116 - "GET / HTTP/1.1" 404 Not Found
celery-worker-1 exited with code 2
celery-worker-1 exited with code 2
api-service-1    | INFO:     172.18.0.1:35536 - "GET / HTTP/1.1" 404 Not Found
celery-worker-1 exited with code 2
celery-worker-1 exited with code 2
api-service-1    | INFO:     172.18.0.1:45734 - "GET / HTTP/1.1" 404 Not Found
celery-worker-1 exited with code 2
api-service-1    | INFO:     172.18.0.1:58658 - "GET / HTTP/1.1" 404 Not Found
celery-worker-1 exited with code 2
api-service-1    | INFO:     172.18.0.1:41784 - "GET / HTTP/1.1" 404 Not Found
celery-worker-1 exited with code 2
api-service-1    | INFO:     172.18.0.1:35336 - "GET / HTTP/1.1" 404 Not Found
celery-worker-1 exited with code 2
api-service-1    | INFO:     172.18.0.1:40116 - "GET / HTTP/1.1" 404 Not Found
api-service-1    | INFO:     172.18.0.1:58164 - "GET / HTTP/1.1" 404 Not Found
api-service-1    | INFO:     172.18.0.1:42174 - "GET / HTTP/1.1" 404 Not Found
celery-worker-1 exited with code 2
api-service-1    | INFO:     172.18.0.1:46536 - "GET / HTTP/1.1" 404 Not Found

[eletonia]

I'm seeing the same error with make all-services:

celery-worker-1  |     import cv2                                                                                                             
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/cv2/__init__.py", line 181, in <module>                                    
celery-worker-1  |     bootstrap()                                                                                                            
celery-worker-1  |   File "/opt/conda/lib/python3.11/site-packages/cv2/__init__.py", line 153, in bootstrap                                   
celery-worker-1  |     native_module = importlib.import_module("cv2")                                                                         
celery-worker-1  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^                                                                         
celery-worker-1  |   File "/opt/conda/lib/python3.11/importlib/__init__.py", line 126, in import_module                                       
celery-worker-1  |     return _bootstrap._gcd_import(name[level:], package, level)                                                            celery-worker-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
celery-worker-1  | ImportError: numpy.core.multiarray failed to import
celery-worker-1  | 
celery-worker-1 exited with code 2

[shahin-salehi]

I had the same issue, navigate to services -> PDFService -> PDFModelService and in requirements.api (not sure it's needed in this one) and requirements.worker add a line and write numpy<2

If you've already built everything remove the pdf-to-podcast-celery-worker image (check with docker images) so that when you run make all-services it gets rebuilt with the new requirements

I also had to delete the container holding on to the old image

After that it started working for me cant speak on outcome though since I ran out of free credits mid run 😁