MemGPT endpoints / inference.memgpt.ai: Bad output: Broken json -- bad formed responses

[quantumalchemy]

Describe the bug
» Use the free MemGPT endpoints
inference.memgpt.ai
getting broken json -- bad formed responses:
in CLI / and api
model = memgpt-openai
model_endpoint = https://inference.memgpt.ai
model_endpoint_type = openai
context_window = 16384

OUTPUT:

Creating new agent...
Couldn't find human {human} in database, please run memgpt add human
Couldn't find persona {persona} in database, please run memgpt add persona
-> 🤖 Using persona profile: 'sam_pov'
-> 🧑 Using human profile: 'basic'
🎉 Created new agent 'CheerfulWombat' (id=3ff423f2-7556-487c-95e0-357cddec62e0)

Hit enter to begin (will request first MemGPT message)
response = <Response [200]>, response.text =
{"id":"chatcmpl-9KsAUJwZJzXRFyx2Rt9PmzjedYQxy","choices":[{"finish_reason":"tool_calls","index":0,"message":{"content":null,"tool_calls":[{"id":"call_zOQk8RFziX5v
u96A3kAmdIYc","type":"function","function":{"arguments":"{"message":"Hello, Chad! Welcome. I'm Sam. It's great to meet you. What brings you here
today?"}","name":"send_message"}}],"role":"assistant","function_call":null},"logprobs":null}],"created":"2024-05-03T18:43:30Z","model":"gpt-4-turbo-2024-04-09","
system_fingerprint":"fp_ea6eb70039","object":"chat.completion","usage":{"completion_tokens":36,"prompt_tokens":2302,"total_tokens":2338}}
💭 None
🤖 Hello, Chad! Welcome. I'm Sam. It's great to meet you. What brings you here today?

Enter your message: hello

response = <Response [200]>, response.text =
{"id":"chatcmpl-9KsAfLhomNaEugXEJPP5yTYURHpFX","choices":[{"finish_reason":"tool_calls","index":0,"message":{"content":null,"tool_calls":[{"id":"call_OXtdy7amyo0F
0wxzYN02kiCK","type":"function","function":{"arguments":"{"message":"Hi! How's your day
going?"}","name":"send_message"}}],"role":"assistant","function_call":null},"logprobs":null}],"created":"2024-05-03T18:43:41Z","model":"gpt-4-turbo-2024-04-09","
system_fingerprint":"fp_ea6eb70039","object":"chat.completion","usage":{"completion_tokens":21,"prompt_tokens":2419,"total_tokens":2440}}
💭 None

Please describe your setup

• How did you install memgpt?
  • pip install pymemgpt? pip install pymemgpt-nightly? git clone?
• Describe your setup
  • What's your OS (Windows/MacOS/Linux)?
  • How are you running memgpt? (cmd.exe/Powershell/Anaconda Shell/Terminal)

MemGPT Config
[defaults]
preset = memgpt_chat
persona = sam_pov
human = basic

[model]
model = memgpt-openai
model_endpoint = https://inference.memgpt.ai
model_endpoint_type = openai
context_window = 16384

[embedding]
embedding_endpoint_type = hugging-face
embedding_endpoint = https://embeddings.memgpt.ai
embedding_model = BAAI/bge-large-en-v1.5
embedding_dim = 1024
embedding_chunk_size = 300

[archival_storage]
type = chroma
path = /root/.memgpt/chroma

[recall_storage]
type = sqlite
path = /root/.memgpt

[metadata_storage]
type = sqlite
path = /root/.memgpt

[version]
memgpt_version = 0.3.13

[client]
anon_clientid = 00000000000000000000867a4627fd44

---

https://inference.memgpt.ai