[E090] Extension 'languages' already exists on Doc. To overwrite the existing extension, set force=True on Doc.set_extension.

[WalczRobert]

I am new to SpaCy and working on a project. The goal is to create a new column with the detected languages. I can do this but must take unconventional steps that would not work in production. The error is:

[E090] Extension 'languages' already exists on Doc. To overwrite the existing extension, set force=True on Doc.set_extension.

However as you will see in my code I do set force=True and I still get this error. For my use case I need to use Spacy_CLD since my text is in mixed languages per record. meaning it may have Spanish and English in one record. and I need the out put to say 'es', 'en' right now it says 'xx'.

Here is the code that gets the error:

# Create spacy-CLD pipeline
LanguageDetector = nlp.add_pipe(LanguageDetector(), name="LanguageDetector", first=True)
nlp.add_pipe('LanguageDetector', before='ner')

# Define the getter function
def get_languages(doc):
      return set([token._.language for token in doc if token.is_alpha])

# Add the custom extension
Doc.set_extension('languages', getter=get_languages, force=True)

nlp = spacy.load('xx_ent_wiki_sm')

doc = nlp('Data science is an interdisciplinary field that utilizes scientific methods, processes, algorithms, and systems to extract insights and knowledge from structured and unstructured data. La ciencia de datos es un campo interdisciplinario que utiliza métodos científicos, procesos, algoritmos y sistemas para extraer ideas y conocimiento de datos estructurados y no estructurados.')

detected_languages = list(doc._.languages)

Now the unconventinal fix is if I add this line of code I will get a different error, then after i delete this line of code everything works fine. This is not acceptable for production though.
Language = LanguageDetector()

Now the real data will come from a dataframe and I will look at one column to detect languages and output the detected languages to a new column. I have that part working fine. Its the language detect I am having an issue with.

Any suggestion from some experienced SpaCy coders?

[WalczRobert]

My work around for now is this bit of code. I don't understand why it works, but it does.

try: 
    language_detector
except:
    language_detector = LanguageDetector()