Exception: Unsupported provider - aleph_alpha in Proxy mode

[vitalii-lobanov]

Attempting to operate Litellm in proxy mode while utilizing Aleph Alpha as the model provider results in the following error:

raise Exception(f"Unsupported provider - {custom_llm_provider}")
Exception: Unsupported provider - aleph_alpha

I use the following command to run litellm:

ALEPHALPHA_API_KEY='eyJ0e****************' litellm --config /workspaceautogen/litellm_aleph_alpha.yaml  --detailed_debug

The configuration file contents are detailed below:

model_list:
  - model_name: aleph_alpha/luminous-supreme-control
    litellm_params:
      model: luminous-supreme-control

litellm_settings: # module level litellm settings
  drop_params: True
  set_verbose: True

Litellm version is:

litellm --version
LiteLLM: Current Version = 1.27.1

Full litellm log (litellm even doesn't start with this config:

LiteLLM: Proxy initialized with Config, Set models:
    aleph_alpha/luminous-supreme-control
Traceback (most recent call last):
  File "/workspacelitellm/litellm-venv/bin/litellm", line 8, in <module>
    sys.exit(run_server())
             ^^^^^^^^^^^^
  File "/workspacelitellm/litellm-venv/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspacelitellm/litellm-venv/lib/python3.11/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/workspacelitellm/litellm-venv/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspacelitellm/litellm-venv/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspacelitellm/litellm-venv/lib/python3.11/site-packages/litellm/proxy/proxy_cli.py", line 428, in run_server
    _, _, general_settings = asyncio.run(
                             ^^^^^^^^^^^^
  File "/workspace/envs/lorkraft-TG1/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/workspace/envs/lorkraft-TG1/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/envs/lorkraft-TG1/lib/python3.11/asyncio/base_events.py", line 653, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/workspacelitellm/litellm-venv/lib/python3.11/site-packages/litellm/proxy/proxy_server.py", line 1711, in load_config
    router = litellm.Router(**router_params)  # type:ignore
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspacelitellm/litellm-venv/lib/python3.11/site-packages/litellm/router.py", line 195, in __init__
    self.set_model_list(model_list)
  File "/workspacelitellm/litellm-venv/lib/python3.11/site-packages/litellm/router.py", line 1920, in set_model_list
    raise Exception(f"Unsupported provider - {custom_llm_provider}")
Exception: Unsupported provider - aleph_alpha