After installing docline using pip while trying the sample code- its giving torch transformer compatibility issue

[PanchamiPrasannakumar]

Bug

ng_rt_detr.py", line 1597, in wrapper
if not torch.compiler.is_compiling():
^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'torch.compiler' has no attribute 'is_compiling'

[trinanjan12]

@PanchamiPrasannakumar have you tried this? 672

[PanchamiPrasannakumar]

getting numpy issue while trying that solution. I have used $ python3.12 -m venv venv $ source ./venv/bin/activate $ pip install --no-cache docling

$ docling --version
Docling version: 2.14.0

[trinanjan12]

Not sure @PanchamiPrasannakumar . I was doing something like this #653 (comment)

[dolfim-ibm]

You could check pip show torch to verify which version was installed.

[PanchamiPrasannakumar]

Name: torch
Version: 2.2.2

[dolfim-ibm]

I think your architecture is no longer supported by the recent torch releases (we are now at 2.5.2).

You could try installing numpy 1.x explicitly.

pip install "numpy<2.0.0"

[gmeghnag]

I have the same issue here:

# python3 --version
Python 3.11.8

# python3 -m pip freeze | egrep -i "docling|numpy|torch"
docling==2.15.0
docling-core==2.13.1
docling-ibm-models==3.1.0
docling-parse==3.0.0
numpy==1.26.4
torch==2.2.2
torchvision==0.17.2

# cat ex.py 
from docling.document_converter import DocumentConverter
source = "https://arxiv.org/pdf/2408.09869"  # document per local path or URL
converter = DocumentConverter()
result = converter.convert(source)
print(result.document.export_to_markdown())

# python3 ex.py 
Encountered an error during conversion of document 82dd470712ce8389f19f20eb9330475e2166a281f8c7990a9f1d0763d73b4d22:
Traceback (most recent call last):

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/pipeline/base_pipeline.py", line 150, in _build_document
    for p in pipeline_pages:  # Must exhaust!

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/pipeline/base_pipeline.py", line 116, in _apply_on_pages
    yield from page_batch

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/models/page_assemble_model.py", line 60, in __call__
    for page in page_batch:

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/models/table_structure_model.py", line 136, in __call__
    for page in page_batch:

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/models/layout_model.py", line 187, in __call__
    for ix, pred_item in enumerate(

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 35, in generator_context
    response = gen.send(None)
               ^^^^^^^^^^^^^^

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling_ibm_models/layoutmodel/layout_predictor.py", line 143, in predict
    outputs = self._model(**inputs)
              ^^^^^^^^^^^^^^^^^^^^^

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/rt_detr/modeling_rt_detr.py", line 2094, in forward
    outputs = self.model(
              ^^^^^^^^^^^

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/rt_detr/modeling_rt_detr.py", line 1886, in forward
    anchors, valid_mask = self.generate_anchors(spatial_shapes_tuple, device=device, dtype=dtype)
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/rt_detr/modeling_rt_detr.py", line 1597, in wrapper
    if not torch.compiler.is_compiling():
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^

AttributeError: module 'torch.compiler' has no attribute 'is_compiling'

Traceback (most recent call last):
  File "/Users/gmeghnag/ex.py", line 4, in <module>
    result = converter.convert(source)
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/pydantic/_internal/_validate_call.py", line 38, in wrapper_function
    return wrapper(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/pydantic/_internal/_validate_call.py", line 111, in __call__
    res = self.__pydantic_validator__.validate_python(pydantic_core.ArgsKwargs(args, kwargs))
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/document_converter.py", line 191, in convert
    return next(all_res)
           ^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/document_converter.py", line 212, in convert_all
    for conv_res in conv_res_iter:
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/document_converter.py", line 247, in _convert
    for item in map(
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/document_converter.py", line 288, in _process_document
    conv_res = self._execute_pipeline(in_doc, raises_on_error=raises_on_error)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/document_converter.py", line 311, in _execute_pipeline
    conv_res = pipeline.execute(in_doc, raises_on_error=raises_on_error)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/pipeline/base_pipeline.py", line 52, in execute
    raise e
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/pipeline/base_pipeline.py", line 44, in execute
    conv_res = self._build_document(conv_res)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/pipeline/base_pipeline.py", line 178, in _build_document
    raise e
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/pipeline/base_pipeline.py", line 150, in _build_document
    for p in pipeline_pages:  # Must exhaust!
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/pipeline/base_pipeline.py", line 116, in _apply_on_pages
    yield from page_batch
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/models/page_assemble_model.py", line 60, in __call__
    for page in page_batch:
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/models/table_structure_model.py", line 136, in __call__
    for page in page_batch:
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling/models/layout_model.py", line 187, in __call__
    for ix, pred_item in enumerate(
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 35, in generator_context
    response = gen.send(None)
               ^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/docling_ibm_models/layoutmodel/layout_predictor.py", line 143, in predict
    outputs = self._model(**inputs)
              ^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/rt_detr/modeling_rt_detr.py", line 2094, in forward
    outputs = self.model(
              ^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1511, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1520, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/rt_detr/modeling_rt_detr.py", line 1886, in forward
    anchors, valid_mask = self.generate_anchors(spatial_shapes_tuple, device=device, dtype=dtype)
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/transformers/models/rt_detr/modeling_rt_detr.py", line 1597, in wrapper
    if not torch.compiler.is_compiling():
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'torch.compiler' has no attribute 'is_compiling'

The O.S. is macOS Sequoia 15.1.1 Chip Apple M1 Pro and the Terminal is "open with Rosetta" [1].

[1] https://support.apple.com/en-in/102527