Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

02_qa_generation fails with exception #485

Open
seekerofsai opened this issue Apr 16, 2024 · 1 comment
Open

02_qa_generation fails with exception #485

seekerofsai opened this issue Apr 16, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@seekerofsai
Copy link

Running 02_qa_generation step fails with exception:

2024-04-15 20:42:21,690 - ERROR - rag_experiment_accelerator.ingest_data.acs_ingest - could not generate a valid json so moving over to next question! Error message: Expecting value: line 1 column 1 (char 0)
2024-04-15 20:42:21,720 - ERROR - rag_experiment_accelerator.ingest_data.acs_ingest - Traceback (most recent call last):
File "/Users/<>/repos/rag-experiment-accelerator/rag_experiment_accelerator/ingest_data/acs_ingest.py", line 128, in generate_qna
response_dict = json.loads(
^^^^^^^^^^^
File "/Users/<>/anaconda3/envs/rag-experiment/lib/python3.11/json/init.py", line 346, in loads
return _default_decoder.decode(s)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/<>/anaconda3/envs/rag-experiment/lib/python3.11/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/<>/anaconda3/envs/rag-experiment/lib/python3.11/json/decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

the generated response fails to load as json in generate_qna

'json[ { "question": "What are the top features and benefits of Surface Pro 8?", "answer": "Surface Pro 8s top features and benefits include being the most powerful pro ever, extending the ultimate desktop experience with Thunderbolt™ 4 ports, and having the most advanced display in a pro with improved video call capabilities." }, { "question": "How does Surface Pro 8s display enhance the user experience?", "answer": "Surface Pro 8s display is 11% larger, 10.8% higher resolution, 12.5% brighter, individually calibrated, virtually edge-to-edge, and now with up to 120Hz refresh rate for an even smoother pen experience and more responsive touch." }]'

@julia-meshcheryakova julia-meshcheryakova added the bug Something isn't working label Apr 17, 2024
@denaha
Copy link

denaha commented Apr 18, 2024

It fails for me, with another error. The resources are configured properly, not sure which URL is called for "Completions", as the step is when it's calling the Completions URL. Any hints?

 Error message: RetryError[<Future at 0x37d707f50 state=finished raised NotFoundError>]
2024-04-18 06:11:05,680 - ERROR - rag_experiment_accelerator.ingest_data.acs_ingest - Traceback (most recent call last):
  File "/Users/deneha/Documents/github/azure/rag-experiment-accelerator/.venv/lib/python3.12/site-packages/tenacity/__init__.py", line 382, in __call__
    result = fn(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^
  File "/Users/deneha/Documents/github/azure/rag-experiment-accelerator/rag_experiment_accelerator/llm/response_generator.py", line 71, in _create_chat_completion_with_retry
    return self.client.chat.completions.create(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/deneha/Documents/github/azure/rag-experiment-accelerator/.venv/lib/python3.12/site-packages/openai/_utils/_utils.py", line 275, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/deneha/Documents/github/azure/rag-experiment-accelerator/.venv/lib/python3.12/site-packages/openai/resources/chat/completions.py", line 667, in create
    return self._post(
           ^^^^^^^^^^^
  File "/Users/deneha/Documents/github/azure/rag-experiment-accelerator/.venv/lib/python3.12/site-packages/openai/_base_client.py", line 1208, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/deneha/Documents/github/azure/rag-experiment-accelerator/.venv/lib/python3.12/site-packages/openai/_base_client.py", line 897, in request
    return self._request(
           ^^^^^^^^^^^^^^
  File "/Users/deneha/Documents/github/azure/rag-experiment-accelerator/.venv/lib/python3.12/site-packages/openai/_base_client.py", line 988, in _request
    raise self._make_status_error_from_response(err.response) from None
openai.NotFoundError: Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants