cannot import name 'ModelMetaclass' from 'pydantic.main'

[maspotts]

Since I upgraded pydantic to the latest release I'm unable to import spacy (also the latest release) because I get this exception:

>>> import spacy
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/spacy/__init__.py", line 6, in <module>
    from .errors import setup_default_warnings
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/spacy/errors.py", line 3, in <module>
    from .compat import Literal
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/spacy/compat.py", line 4, in <module>
    from thinc.util import copy_array
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/thinc/__init__.py", line 5, in <module>
    from .config import registry
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/thinc/config.py", line 2, in <module>
    import confection
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/confection/__init__.py", line 11, in <module>
    from pydantic.main import ModelMetaclass
ImportError: cannot import name 'ModelMetaclass' from 'pydantic.main' (/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pydantic/main.py)

I see that pydantic has moved ModelMetaclass (and claims it's private and should not be used) but evidently spacy is using it (in its original location). Is there a recommended workaround? I can't downgrade pydantic because another module has a dependency on the 2.0 releases.

[maspotts]

I was able to hack a copy of ModelMetaclass like this:

from pydantic._internal._model_construction import ModelMetaclass

if 'pydantic.main' not in sys.modules:
    import pydantic.main

sys.modules['pydantic.main'].ModelMetaclass = ModelMetaclass

but then I ran into a missing ModelField class, so I guess patching is a non-starter!

[maspotts]

As it stands, unless I'm missing something, I think I'm unable to use spaCy in this project (due to my existing dependency on pydantic V2), but that seems a bit mad, so hopefully there's a workaround!

[svlandeg]

Hi @maspotts, thanks for the report! Which exact versions of spaCy and Pydantic are you using?

We'll look into this.

[svlandeg]

I can't reproduce this - with the latest versions of spacy and confection I upgraded Pydantic to its latest 2.6.1 and things are still working on my end. Could you try a clean install maybe?

[maspotts]

That's awesome news: thanks! Here's what I get:

orac logs [0] pip3 show spacy
Name: spacy
Version: 4.0.0.dev2
Summary: Industrial-strength Natural Language Processing (NLP) in Python
Home-page: https://spacy.io
Author: Explosion
Author-email: contact@explosion.ai
License: MIT
Location: /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages
Requires: catalogue, cymem, jinja2, langcodes, murmurhash, numpy, packaging, preshed, pydantic, requests, setuptools, smart-open, spacy-legacy, spacy-loggers, srsly, thinc, tqdm, typer, wasabi, weasel
Required-by: en-core-web-sm
orac logs [0] pip3 show pydantic
Name: pydantic
Version: 2.6.1
Summary: Data validation using Python type hints
Home-page:
Author:
Author-email: Samuel Colvin <s@muelcolvin.com>, Eric Jolibois <em.jolibois@gmail.com>, Hasan Ramezani <hasan.r67@gmail.com>, Adrian Garcia Badaracco <1755071+adriangb@users.noreply.github.com>, Terrence Dorsey <terry@pydantic.dev>, David Montague <david@pydantic.dev>, Serge Matveenko <lig@countzero.co>, Marcelo Trylesinski <marcelotryle@gmail.com>, Sydney Runkle <sydneymarierunkle@gmail.com>, David Hewitt <mail@davidhewitt.io>
License:
Location: /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages
Requires: annotated-types, pydantic-core, typing-extensions
Required-by: argilla, chromadb, confection, fastapi, gradio, langchain, langchain-core, langchainplus-sdk, langsmith, llamaindex-py-client, openai, openapi-schema-pydantic, paper-qa, replicate, spacy, thinc, weasel
orac logs [0] python
Python 3.10.7 (main, Nov 20 2022, 07:54:00) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import spacy
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/spacy/__init__.py", line 11, in <module>
    from thinc.api import Config, prefer_gpu, require_cpu, require_gpu  # noqa: F401
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/thinc/__init__.py", line 5, in <module>
    from .config import registry
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/thinc/config.py", line 2, in <module>
    import confection
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/confection/__init__.py", line 11, in <module>
    from pydantic.main import ModelMetaclass
ImportError: cannot import name 'ModelMetaclass' from 'pydantic.main' (/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pydantic/main.py)
>>>
orac logs [0] pip3 install --upgrade pydantic==1.10.14
Collecting pydantic==1.10.14
  Using cached pydantic-1.10.14-cp310-cp310-macosx_11_0_arm64.whl.metadata (150 kB)
Requirement already satisfied: typing-extensions>=4.2.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic==1.10.14) (4.9.0)
Using cached pydantic-1.10.14-cp310-cp310-macosx_11_0_arm64.whl (2.6 MB)
Installing collected packages: pydantic
  Attempting uninstall: pydantic
    Found existing installation: pydantic 2.6.1
    Uninstalling pydantic-2.6.1:
      Successfully uninstalled pydantic-2.6.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
argilla 1.6.0 requires httpx<0.24,>=0.15, but you have httpx 0.27.0 which is incompatible.
argilla 1.6.0 requires numpy<1.24.0, but you have numpy 1.24.3 which is incompatible.
gradio 4.19.1 requires pydantic>=2.0, but you have pydantic 1.10.14 which is incompatible.
llama-index-vector-stores-chroma 0.1.3 requires onnxruntime<2.0.0,>=1.17.0, but you have onnxruntime 1.15.1 which is incompatible.
paper-qa 4.0.0rc8 requires pydantic>=2, but you have pydantic 1.10.14 which is incompatible.
Successfully installed pydantic-1.10.14
orac logs [0] pip3 show pydantic
Name: pydantic
Version: 1.10.14
Summary: Data validation and settings management using python type hints
Home-page: https://github.com/pydantic/pydantic
Author: Samuel Colvin
Author-email: s@muelcolvin.com
License: MIT
Location: /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages
Requires: typing-extensions
Required-by: argilla, chromadb, confection, fastapi, gradio, langchain, langchain-core, langchainplus-sdk, langsmith, llamaindex-py-client, openai, openapi-schema-pydantic, paper-qa, replicate, spacy, thinc, weasel
orac logs [0] python
Python 3.10.7 (main, Nov 20 2022, 07:54:00) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import spacy
>>>
orac logs [0] pip3 install --upgrade pydantic==2.6.1
Collecting pydantic==2.6.1
  Using cached pydantic-2.6.1-py3-none-any.whl.metadata (83 kB)
Requirement already satisfied: annotated-types>=0.4.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic==2.6.1) (0.6.0)
Requirement already satisfied: pydantic-core==2.16.2 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic==2.6.1) (2.16.2)
Requirement already satisfied: typing-extensions>=4.6.1 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic==2.6.1) (4.9.0)
Using cached pydantic-2.6.1-py3-none-any.whl (394 kB)
Installing collected packages: pydantic
  Attempting uninstall: pydantic
    Found existing installation: pydantic 1.10.14
    Uninstalling pydantic-1.10.14:
      Successfully uninstalled pydantic-1.10.14
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
argilla 1.6.0 requires httpx<0.24,>=0.15, but you have httpx 0.27.0 which is incompatible.
argilla 1.6.0 requires numpy<1.24.0, but you have numpy 1.24.3 which is incompatible.
confection 0.0.4 requires pydantic!=1.8,!=1.8.1,<1.11.0,>=1.7.4, but you have pydantic 2.6.1 which is incompatible.
langchainplus-sdk 0.0.20 requires pydantic<2,>=1, but you have pydantic 2.6.1 which is incompatible.
llama-index-vector-stores-chroma 0.1.3 requires onnxruntime<2.0.0,>=1.17.0, but you have onnxruntime 1.15.1 which is incompatible.
replicate 0.8.4 requires pydantic<2,>1, but you have pydantic 2.6.1 which is incompatible.
Successfully installed pydantic-2.6.1
orac logs [0] pip3 show pydantic
Name: pydantic
Version: 2.6.1
Summary: Data validation using Python type hints
Home-page:
Author:
Author-email: Samuel Colvin <s@muelcolvin.com>, Eric Jolibois <em.jolibois@gmail.com>, Hasan Ramezani <hasan.r67@gmail.com>, Adrian Garcia Badaracco <1755071+adriangb@users.noreply.github.com>, Terrence Dorsey <terry@pydantic.dev>, David Montague <david@pydantic.dev>, Serge Matveenko <lig@countzero.co>, Marcelo Trylesinski <marcelotryle@gmail.com>, Sydney Runkle <sydneymarierunkle@gmail.com>, David Hewitt <mail@davidhewitt.io>
License:
Location: /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages
Requires: annotated-types, pydantic-core, typing-extensions
Required-by: argilla, chromadb, confection, fastapi, gradio, langchain, langchain-core, langchainplus-sdk, langsmith, llamaindex-py-client, openai, openapi-schema-pydantic, paper-qa, replicate, spacy, thinc, weasel
orac logs [0] python
Python 3.10.7 (main, Nov 20 2022, 07:54:00) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import spacy
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/spacy/__init__.py", line 11, in <module>
    from thinc.api import Config, prefer_gpu, require_cpu, require_gpu  # noqa: F401
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/thinc/__init__.py", line 5, in <module>
    from .config import registry
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/thinc/config.py", line 2, in <module>
    import confection
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/confection/__init__.py", line 11, in <module>
    from pydantic.main import ModelMetaclass
ImportError: cannot import name 'ModelMetaclass' from 'pydantic.main' (/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pydantic/main.py)

[maspotts]

Here's the same with spacy 3.7.4:

orac logs [0] pip3 install spacy==3.7.4
Collecting spacy==3.7.4
  Using cached spacy-3.7.4-cp310-cp310-macosx_11_0_arm64.whl.metadata (27 kB)
Collecting spacy-legacy<3.1.0,>=3.0.11 (from spacy==3.7.4)
  Using cached spacy_legacy-3.0.12-py2.py3-none-any.whl.metadata (2.8 kB)
Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (1.0.4)
Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (1.0.9)
Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (2.0.7)
Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (3.0.8)
Collecting thinc<8.3.0,>=8.2.2 (from spacy==3.7.4)
  Using cached thinc-8.2.3-cp310-cp310-macosx_11_0_arm64.whl.metadata (15 kB)
Requirement already satisfied: wasabi<1.2.0,>=0.9.1 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (1.1.1)
Requirement already satisfied: srsly<3.0.0,>=2.4.3 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (2.4.6)
Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (2.0.8)
Requirement already satisfied: weasel<0.4.0,>=0.1.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (0.3.3)
Requirement already satisfied: typer<0.10.0,>=0.3.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (0.9.0)
Requirement already satisfied: smart-open<7.0.0,>=5.2.1 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (6.3.0)
Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (4.66.2)
Requirement already satisfied: requests<3.0.0,>=2.13.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (2.31.0)
Requirement already satisfied: pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (2.6.1)
Requirement already satisfied: jinja2 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (3.1.2)
Requirement already satisfied: setuptools in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (67.8.0)
Requirement already satisfied: packaging>=20.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (23.2)
Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (3.3.0)
Requirement already satisfied: numpy>=1.19.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from spacy==3.7.4) (1.24.3)
Requirement already satisfied: annotated-types>=0.4.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy==3.7.4) (0.6.0)
Requirement already satisfied: pydantic-core==2.16.2 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy==3.7.4) (2.16.2)
Requirement already satisfied: typing-extensions>=4.6.1 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy==3.7.4) (4.9.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from requests<3.0.0,>=2.13.0->spacy==3.7.4) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from requests<3.0.0,>=2.13.0->spacy==3.7.4) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from requests<3.0.0,>=2.13.0->spacy==3.7.4) (1.26.18)
Requirement already satisfied: certifi>=2017.4.17 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from requests<3.0.0,>=2.13.0->spacy==3.7.4) (2024.2.2)
Requirement already satisfied: blis<0.8.0,>=0.7.8 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from thinc<8.3.0,>=8.2.2->spacy==3.7.4) (0.7.9)
Requirement already satisfied: confection<1.0.0,>=0.0.1 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from thinc<8.3.0,>=8.2.2->spacy==3.7.4) (0.0.4)
Requirement already satisfied: click<9.0.0,>=7.1.1 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from typer<0.10.0,>=0.3.0->spacy==3.7.4) (8.1.3)
Requirement already satisfied: cloudpathlib<0.17.0,>=0.7.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from weasel<0.4.0,>=0.1.0->spacy==3.7.4) (0.16.0)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from jinja2->spacy==3.7.4) (2.1.2)
Collecting pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4 (from spacy==3.7.4)
  Using cached pydantic-1.10.14-cp310-cp310-macosx_11_0_arm64.whl.metadata (150 kB)
Using cached spacy-3.7.4-cp310-cp310-macosx_11_0_arm64.whl (6.6 MB)
Using cached spacy_legacy-3.0.12-py2.py3-none-any.whl (29 kB)
Using cached thinc-8.2.3-cp310-cp310-macosx_11_0_arm64.whl (789 kB)
Using cached pydantic-1.10.14-cp310-cp310-macosx_11_0_arm64.whl (2.6 MB)
Installing collected packages: spacy-legacy, pydantic, thinc, spacy
  Attempting uninstall: spacy-legacy
    Found existing installation: spacy-legacy 4.0.0.dev1
    Uninstalling spacy-legacy-4.0.0.dev1:
      Successfully uninstalled spacy-legacy-4.0.0.dev1
  Attempting uninstall: pydantic
    Found existing installation: pydantic 2.6.1
    Uninstalling pydantic-2.6.1:
      Successfully uninstalled pydantic-2.6.1
  Attempting uninstall: thinc
    Found existing installation: thinc 9.0.0.dev4
    Uninstalling thinc-9.0.0.dev4:
      Successfully uninstalled thinc-9.0.0.dev4
  Attempting uninstall: spacy
    Found existing installation: spacy 4.0.0.dev2
    Uninstalling spacy-4.0.0.dev2:
      Successfully uninstalled spacy-4.0.0.dev2
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
argilla 1.6.0 requires httpx<0.24,>=0.15, but you have httpx 0.27.0 which is incompatible.
argilla 1.6.0 requires numpy<1.24.0, but you have numpy 1.24.3 which is incompatible.
gradio 4.19.1 requires pydantic>=2.0, but you have pydantic 1.10.14 which is incompatible.
llama-index-vector-stores-chroma 0.1.3 requires onnxruntime<2.0.0,>=1.17.0, but you have onnxruntime 1.15.1 which is incompatible.
paper-qa 4.0.0rc8 requires pydantic>=2, but you have pydantic 1.10.14 which is incompatible.
Successfully installed pydantic-1.10.14 spacy-3.7.4 spacy-legacy-3.0.12 thinc-8.2.3
orac logs [0] pip show spacy
Name: spacy
Version: 3.7.4
Summary: Industrial-strength Natural Language Processing (NLP) in Python
Home-page: https://spacy.io
Author: Explosion
Author-email: contact@explosion.ai
License: MIT
Location: /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages
Requires: catalogue, cymem, jinja2, langcodes, murmurhash, numpy, packaging, preshed, pydantic, requests, setuptools, smart-open, spacy-legacy, spacy-loggers, srsly, thinc, tqdm, typer, wasabi, weasel
Required-by: en-core-web-sm
orac logs [0] pip show pydantic
Name: pydantic
Version: 1.10.14
Summary: Data validation and settings management using python type hints
Home-page: https://github.com/pydantic/pydantic
Author: Samuel Colvin
Author-email: s@muelcolvin.com
License: MIT
Location: /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages
Requires: typing-extensions
Required-by: argilla, chromadb, confection, fastapi, gradio, langchain, langchain-core, langchainplus-sdk, langsmith, llamaindex-py-client, openai, openapi-schema-pydantic, paper-qa, replicate, spacy, thinc, weasel
orac logs [0] python
Python 3.10.7 (main, Nov 20 2022, 07:54:00) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import spacy
>>>
orac logs [0] pip3 install --upgrade pydantic==2.6.1
Collecting pydantic==2.6.1
  Using cached pydantic-2.6.1-py3-none-any.whl.metadata (83 kB)
Requirement already satisfied: annotated-types>=0.4.0 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic==2.6.1) (0.6.0)
Requirement already satisfied: pydantic-core==2.16.2 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic==2.6.1) (2.16.2)
Requirement already satisfied: typing-extensions>=4.6.1 in /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic==2.6.1) (4.9.0)
Using cached pydantic-2.6.1-py3-none-any.whl (394 kB)
Installing collected packages: pydantic
  Attempting uninstall: pydantic
    Found existing installation: pydantic 1.10.14
    Uninstalling pydantic-1.10.14:
      Successfully uninstalled pydantic-1.10.14
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
argilla 1.6.0 requires httpx<0.24,>=0.15, but you have httpx 0.27.0 which is incompatible.
argilla 1.6.0 requires numpy<1.24.0, but you have numpy 1.24.3 which is incompatible.
confection 0.0.4 requires pydantic!=1.8,!=1.8.1,<1.11.0,>=1.7.4, but you have pydantic 2.6.1 which is incompatible.
langchainplus-sdk 0.0.20 requires pydantic<2,>=1, but you have pydantic 2.6.1 which is incompatible.
llama-index-vector-stores-chroma 0.1.3 requires onnxruntime<2.0.0,>=1.17.0, but you have onnxruntime 1.15.1 which is incompatible.
replicate 0.8.4 requires pydantic<2,>1, but you have pydantic 2.6.1 which is incompatible.
Successfully installed pydantic-2.6.1
orac logs [0] pip show pydantic
Name: pydantic
Version: 2.6.1
Summary: Data validation using Python type hints
Home-page:
Author:
Author-email: Samuel Colvin <s@muelcolvin.com>, Eric Jolibois <em.jolibois@gmail.com>, Hasan Ramezani <hasan.r67@gmail.com>, Adrian Garcia Badaracco <1755071+adriangb@users.noreply.github.com>, Terrence Dorsey <terry@pydantic.dev>, David Montague <david@pydantic.dev>, Serge Matveenko <lig@countzero.co>, Marcelo Trylesinski <marcelotryle@gmail.com>, Sydney Runkle <sydneymarierunkle@gmail.com>, David Hewitt <mail@davidhewitt.io>
License:
Location: /Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages
Requires: annotated-types, pydantic-core, typing-extensions
Required-by: argilla, chromadb, confection, fastapi, gradio, langchain, langchain-core, langchainplus-sdk, langsmith, llamaindex-py-client, openai, openapi-schema-pydantic, paper-qa, replicate, spacy, thinc, weasel
orac logs [0] python
Python 3.10.7 (main, Nov 20 2022, 07:54:00) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import spacy
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/spacy/__init__.py", line 6, in <module>
    from .errors import setup_default_warnings
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/spacy/errors.py", line 3, in <module>
    from .compat import Literal
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/spacy/compat.py", line 4, in <module>
    from thinc.util import copy_array
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/thinc/__init__.py", line 5, in <module>
    from .config import registry
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/thinc/config.py", line 2, in <module>
    import confection
  File "/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/confection/__init__.py", line 11, in <module>
    from pydantic.main import ModelMetaclass
ImportError: cannot import name 'ModelMetaclass' from 'pydantic.main' (/Users/mike/.pyenv/versions/3.10.7/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pydantic/main.py)

[maspotts]

I'm on a Mac Studio (M1 Max) running Sonoma 14.2.1.

[svlandeg]

Thanks for those detailed logs! That's helpful.

First - definitely don't install spacy 4.0.0.devX yet - it's not ready ;-)

When you install spaCy 3.7.4, somehow your environment is not installing the latest confection:

confection 0.0.4 requires pydantic!=1.8,!=1.8.1,<1.11.0,>=1.7.4, but you have pydantic 2.6.1 which is incompatible.

The latest is 0.1.4 and has compatibility for Pydantic v2 (since 0.1.1). Try upgrading that (and probably also Thinc)?

[maspotts]

Ah! That did it! Upgraded confection==0.1.4 and I can import spacy 3.7.4 with pydantic 2.6.1!! Thanks so much!!! I wonder why confection was being left at 0.0.4. I sometimes feel like pip just crosses its fingers and gives up when it tries to resolve dependencies!

[svlandeg]

Great, happy to hear it works now!

[maspotts]

Thanks for taking a look and figuring it out so quickly :)