{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":696392815,"defaultBranch":"development","name":"rag-experiment-accelerator","ownerLogin":"microsoft","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-09-25T16:47:36.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/6154722?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1716905212.0","currentOid":""},"activityList":{"items":[{"before":"e32e10b7fcd74e1e494f1da9d0f14a1f3a91cf14","after":null,"ref":"refs/heads/dependabot/pip/langchain-community-0.2.1","pushedAt":"2024-05-28T14:06:52.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"99319e74375951ce86211c43be469021fd693fd6","after":null,"ref":"refs/heads/dependabot/pip/openai-1.30.3","pushedAt":"2024-05-28T14:06:26.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"53be52ce0bcd9129c5c45ded2751b21ac65f9056","after":null,"ref":"refs/heads/dependabot/pip/scikit-learn-1.5.0","pushedAt":"2024-05-28T14:06:24.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"4b275dea3ad85ec4857b6e29f2d854cc4ef448e9","after":null,"ref":"refs/heads/dependabot/pip/unstructured-0.14.2","pushedAt":"2024-05-28T14:06:23.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"7b4f6a3eb9fa295b1463a1ef8e81524dcf0a9e2e","after":null,"ref":"refs/heads/dependabot/pip/langchain-0.2.1","pushedAt":"2024-05-28T14:06:23.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"4a49884d678f118b46269833e2f899284516c7de","after":null,"ref":"refs/heads/dependabot/pip/pymupdf-1.24.4","pushedAt":"2024-05-28T14:05:43.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"7a195b27123c8b53ddd2f72bcf4bdb487a676cb0","after":null,"ref":"refs/heads/gh-readonly-queue/development/pr-560-da97685851230081f201b9b35fcdbc23c9bd3ad8","pushedAt":"2024-05-28T14:05:36.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"}},{"before":"da97685851230081f201b9b35fcdbc23c9bd3ad8","after":"7a195b27123c8b53ddd2f72bcf4bdb487a676cb0","ref":"refs/heads/development","pushedAt":"2024-05-28T14:05:35.000Z","pushType":"merge_queue_merge","commitsCount":1,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Bump pymupdf from 1.24.3 to 1.24.4 (#560)\n\nBumps [pymupdf](https://github.com/pymupdf/pymupdf) from 1.24.3 to\n1.24.4.\n
\nRelease notes\n

Sourced from pymupdf's\nreleases.

\n
\n

PyMuPDF-1.24.4 released

\n

PyMuPDF-1.24.4 has been released.

\n

Wheels for Windows, Linux and MacOS, and the sdist, are available on\npypi.org and can be installed in the usual way, for example:

\n
python -m pip install --upgrade pymupdf\n
\n

[Linux-aarch64 wheels will be built and uploaded later.]

\n

Changes in version 1.24.4 (2024-05-16)

\n\n
\n
\n
\nChangelog\n

Sourced from pymupdf's\nchangelog.

\n
\n

Change Log

\n

Changes in version 1.24.4 (2024-05-16)

\n\n

Changes in version 1.24.3 (2024-05-09)

\n\n

Changes in version 1.24.2 (2024-04-17)

\n\n
\n

... (truncated)

\n
\n
\nCommits\n\n
\n
\n\n\n[![Dependabot compatibility\nscore](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=pymupdf&package-manager=pip&previous-version=1.24.3&new-version=1.24.4)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)\n\nDependabot will resolve any conflicts with this PR as long as you don't\nalter it yourself. You can also trigger a rebase manually by commenting\n`@dependabot rebase`.\n\n[//]: # (dependabot-automerge-start)\n[//]: # (dependabot-automerge-end)\n\n---\n\n
\nDependabot commands and options\n
\n\nYou can trigger Dependabot actions by commenting on this PR:\n- `@dependabot rebase` will rebase this PR\n- `@dependabot recreate` will recreate this PR, overwriting any edits\nthat have been made to it\n- `@dependabot merge` will merge this PR after your CI passes on it\n- `@dependabot squash and merge` will squash and merge this PR after\nyour CI passes on it\n- `@dependabot cancel merge` will cancel a previously requested merge\nand block automerging\n- `@dependabot reopen` will reopen this PR if it is closed\n- `@dependabot close` will close this PR and stop Dependabot recreating\nit. You can achieve the same result by closing it manually\n- `@dependabot show ignore conditions` will show all\nof the ignore conditions of the specified dependency\n- `@dependabot ignore this major version` will close this PR and stop\nDependabot creating any more for this major version (unless you reopen\nthe PR or upgrade to it yourself)\n- `@dependabot ignore this minor version` will close this PR and stop\nDependabot creating any more for this minor version (unless you reopen\nthe PR or upgrade to it yourself)\n- `@dependabot ignore this dependency` will close this PR and stop\nDependabot creating any more for this dependency (unless you reopen the\nPR or upgrade to it yourself)\n\n\n
\n\n---------\n\nSigned-off-by: dependabot[bot] \nCo-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>\nCo-authored-by: Julia Meshcheryakova ","shortMessageHtmlLink":"Bump pymupdf from 1.24.3 to 1.24.4 (#560)"}},{"before":null,"after":"7a195b27123c8b53ddd2f72bcf4bdb487a676cb0","ref":"refs/heads/gh-readonly-queue/development/pr-560-da97685851230081f201b9b35fcdbc23c9bd3ad8","pushedAt":"2024-05-28T13:55:29.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Bump pymupdf from 1.24.3 to 1.24.4 (#560)\n\nBumps [pymupdf](https://github.com/pymupdf/pymupdf) from 1.24.3 to\n1.24.4.\n
\nRelease notes\n

Sourced from pymupdf's\nreleases.

\n
\n

PyMuPDF-1.24.4 released

\n

PyMuPDF-1.24.4 has been released.

\n

Wheels for Windows, Linux and MacOS, and the sdist, are available on\npypi.org and can be installed in the usual way, for example:

\n
python -m pip install --upgrade pymupdf\n
\n

[Linux-aarch64 wheels will be built and uploaded later.]

\n

Changes in version 1.24.4 (2024-05-16)

\n
    \n
  • \n

    Fixed #3418

    \n
    • \n
  • \n

    Other:

    \n
      \n
    • Fixed sysinstall test failing to remove all of prior installation\nbefore\nnew install.
      • \n
    • Fixed utils.do_links() crash.
      • \n
    • Correct TextPage creation Code.
      • \n
    • Unified various diagnostics.
      • \n
    • Fix bug in page_merge().
      • \n
    \n
    • \n
\n
\n
\n
\nChangelog\n

Sourced from pymupdf's\nchangelog.

\n
\n

Change Log

\n

Changes in version 1.24.4 (2024-05-16)

\n
    \n
  • \n

    Fixed 3418\n<https://github.com/pymupdf/PyMuPDF/issues/3418>_:\nRe-introduced bug, text align add_redact_annot

    \n
    • \n
  • \n

    Other:

    \n
      \n
    • Fixed sysinstall test failing to remove all of prior installation\nbefore\nnew install.
      • \n
    • Fixed utils.do_links() crash.
      • \n
    • Correct TextPage creation Code.
      • \n
    • Unified various diagnostics.
      • \n
    • Fix bug in page_merge().
      • \n
    \n
    • \n
\n

Changes in version 1.24.3 (2024-05-09)

\n
    \n
  • \n

    The Python module is now called pymupdf.\nfitz is still supported for\nbackwards compatibility.

    \n
    • \n
  • \n

    Use MuPDF-1.24.2.

    \n
    • \n
  • \n

    Fixed issues:

    \n
      \n
    • Fixed 3357\n<https://github.com/pymupdf/PyMuPDF/issues/3357>_:\nPyMuPDF==1.24.0 will hanging when using\npage.get_text("text")
      • \n
    • Fixed 3376\n<https://github.com/pymupdf/PyMuPDF/issues/3376>_:\nRedacting results are not as expected in 1.24.x.
      • \n
    • Fixed 3379\n<https://github.com/pymupdf/PyMuPDF/issues/3379>_:\nDocumentation mismatch for get_text_blocks return value order.
      • \n
    • Fixed 3381\n<https://github.com/pymupdf/PyMuPDF/issues/3381>_: Contents\nstream contains floats in scientific notation
      • \n
    • Fixed 3402\n<https://github.com/pymupdf/PyMuPDF/issues/3402>_: Cannot\nadd Widgets containing inter-field-calculation JavaScript
      • \n
    • Fixed 3414\n<https://github.com/pymupdf/PyMuPDF/issues/3414>_: missing\nattribute set_dpi()
      • \n
    • Fixed 3430\n<https://github.com/pymupdf/PyMuPDF/issues/3430>_:\npage.get_text() cause process freeze with certain pdf on v1.24.2
      • \n
    \n
    • \n
  • \n

    Other:

    \n
      \n
    • \n

      New/modified methods:

      \n
        \n
      • Page.remove_rotation(): new, set page rotation to zero\nwhile keeping appearance.
        • \n
      \n
      • \n
    • \n

      Fixed some problems when checking for PDF properties.

      \n
      • \n
    • \n

      Fixed pip builds from sdist\n(see discussion 3360\n<https://github.com/pymupdf/PyMuPDF/discussions/3360>_:\nAlpine linux docker build failing "No matching distribution found\nfor pymupdfb==1.24.1").

      \n
      • \n
    \n
    • \n
\n

Changes in version 1.24.2 (2024-04-17)

\n\n
\n

... (truncated)

\n
\n
\nCommits\n
    \n
  • 74a368b\nUpdate changelog, version numbers and release dates for release\n1.24.4.
    • \n
  • 73bdc3b\nsrc/init.py:page_merge(): fixed bug.
    • \n
  • 2f48b97\nsrc/: use message() for all diagnostics.
    • \n
  • fecacd3\nsome code cleaning
    • \n
  • 7d8d41c\nCorrect TextPage creation Code
    • \n
  • 2067826\nFixed utils.do_links() crash.
    • \n
  • d464133\nDocumentation: Fixes up more Japanese translation, edit to rag.rst.
    • \n
  • e6e1daa\nscripts/sysinstall.py: fix test failure after recent rename\nfitz->pymupdf.
    • \n
  • 290649c\ntests/test_balance_count.py: update expectations with mupdf 1.24.0 and\n1.24.1.
    • \n
  • 1097080\ntests/: updated expectations to match latest MuPDF master.
    • \n
  • Additional commits viewable in compare\nview
    • \n
\n
\n
\n\n\n[![Dependabot compatibility\nscore](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=pymupdf&package-manager=pip&previous-version=1.24.3&new-version=1.24.4)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)\n\nDependabot will resolve any conflicts with this PR as long as you don't\nalter it yourself. You can also trigger a rebase manually by commenting\n`@dependabot rebase`.\n\n[//]: # (dependabot-automerge-start)\n[//]: # (dependabot-automerge-end)\n\n---\n\n
\nDependabot commands and options\n
\n\nYou can trigger Dependabot actions by commenting on this PR:\n- `@dependabot rebase` will rebase this PR\n- `@dependabot recreate` will recreate this PR, overwriting any edits\nthat have been made to it\n- `@dependabot merge` will merge this PR after your CI passes on it\n- `@dependabot squash and merge` will squash and merge this PR after\nyour CI passes on it\n- `@dependabot cancel merge` will cancel a previously requested merge\nand block automerging\n- `@dependabot reopen` will reopen this PR if it is closed\n- `@dependabot close` will close this PR and stop Dependabot recreating\nit. You can achieve the same result by closing it manually\n- `@dependabot show ignore conditions` will show all\nof the ignore conditions of the specified dependency\n- `@dependabot ignore this major version` will close this PR and stop\nDependabot creating any more for this major version (unless you reopen\nthe PR or upgrade to it yourself)\n- `@dependabot ignore this minor version` will close this PR and stop\nDependabot creating any more for this minor version (unless you reopen\nthe PR or upgrade to it yourself)\n- `@dependabot ignore this dependency` will close this PR and stop\nDependabot creating any more for this dependency (unless you reopen the\nPR or upgrade to it yourself)\n\n\n
\n\n---------\n\nSigned-off-by: dependabot[bot] \nCo-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>\nCo-authored-by: Julia Meshcheryakova ","shortMessageHtmlLink":"Bump pymupdf from 1.24.3 to 1.24.4 (#560)"}},{"before":"5a24fa36ea686fd10c2f1b4ae3c012b0ad0f0cc5","after":"4a49884d678f118b46269833e2f899284516c7de","ref":"refs/heads/dependabot/pip/pymupdf-1.24.4","pushedAt":"2024-05-28T13:44:54.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"julia-meshcheryakova","name":"Julia Meshcheryakova","path":"/julia-meshcheryakova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1250479?s=80&v=4"},"commit":{"message":"Merge branch 'development' into dependabot/pip/pymupdf-1.24.4","shortMessageHtmlLink":"Merge branch 'development' into dependabot/pip/pymupdf-1.24.4"}},{"before":null,"after":"99319e74375951ce86211c43be469021fd693fd6","ref":"refs/heads/dependabot/pip/openai-1.30.3","pushedAt":"2024-05-27T00:27:12.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump openai from 1.30.1 to 1.30.3\n\nBumps [openai](https://github.com/openai/openai-python) from 1.30.1 to 1.30.3.\n- [Release notes](https://github.com/openai/openai-python/releases)\n- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md)\n- [Commits](https://github.com/openai/openai-python/compare/v1.30.1...v1.30.3)\n\n---\nupdated-dependencies:\n- dependency-name: openai\n dependency-type: direct:production\n update-type: version-update:semver-patch\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump openai from 1.30.1 to 1.30.3"}},{"before":null,"after":"e32e10b7fcd74e1e494f1da9d0f14a1f3a91cf14","ref":"refs/heads/dependabot/pip/langchain-community-0.2.1","pushedAt":"2024-05-27T00:27:02.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump langchain-community from 0.2.0 to 0.2.1\n\nBumps [langchain-community](https://github.com/langchain-ai/langchain) from 0.2.0 to 0.2.1.\n- [Release notes](https://github.com/langchain-ai/langchain/releases)\n- [Commits](https://github.com/langchain-ai/langchain/compare/langchain-community==0.2.0...langchain-community==0.2.1)\n\n---\nupdated-dependencies:\n- dependency-name: langchain-community\n dependency-type: direct:production\n update-type: version-update:semver-patch\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump langchain-community from 0.2.0 to 0.2.1"}},{"before":null,"after":"4b275dea3ad85ec4857b6e29f2d854cc4ef448e9","ref":"refs/heads/dependabot/pip/unstructured-0.14.2","pushedAt":"2024-05-27T00:26:52.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump unstructured from 0.11.8 to 0.14.2\n\nBumps [unstructured](https://github.com/Unstructured-IO/unstructured) from 0.11.8 to 0.14.2.\n- [Release notes](https://github.com/Unstructured-IO/unstructured/releases)\n- [Changelog](https://github.com/Unstructured-IO/unstructured/blob/main/CHANGELOG.md)\n- [Commits](https://github.com/Unstructured-IO/unstructured/compare/0.11.8...0.14.2)\n\n---\nupdated-dependencies:\n- dependency-name: unstructured\n dependency-type: direct:production\n update-type: version-update:semver-minor\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump unstructured from 0.11.8 to 0.14.2"}},{"before":null,"after":"7b4f6a3eb9fa295b1463a1ef8e81524dcf0a9e2e","ref":"refs/heads/dependabot/pip/langchain-0.2.1","pushedAt":"2024-05-27T00:26:44.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump langchain from 0.2.0 to 0.2.1\n\nBumps [langchain](https://github.com/langchain-ai/langchain) from 0.2.0 to 0.2.1.\n- [Release notes](https://github.com/langchain-ai/langchain/releases)\n- [Commits](https://github.com/langchain-ai/langchain/compare/langchain==0.2.0...langchain==0.2.1)\n\n---\nupdated-dependencies:\n- dependency-name: langchain\n dependency-type: direct:production\n update-type: version-update:semver-patch\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump langchain from 0.2.0 to 0.2.1"}},{"before":null,"after":"53be52ce0bcd9129c5c45ded2751b21ac65f9056","ref":"refs/heads/dependabot/pip/scikit-learn-1.5.0","pushedAt":"2024-05-27T00:26:28.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump scikit-learn from 1.4.2 to 1.5.0\n\nBumps [scikit-learn](https://github.com/scikit-learn/scikit-learn) from 1.4.2 to 1.5.0.\n- [Release notes](https://github.com/scikit-learn/scikit-learn/releases)\n- [Commits](https://github.com/scikit-learn/scikit-learn/compare/1.4.2...1.5.0)\n\n---\nupdated-dependencies:\n- dependency-name: scikit-learn\n dependency-type: direct:production\n update-type: version-update:semver-minor\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump scikit-learn from 1.4.2 to 1.5.0"}},{"before":"dd3a933b8335d1941b5db358ec010ce360beb124","after":"057dd54f845823ac2d206121b5963748799fa04e","ref":"refs/heads/prerelease","pushedAt":"2024-05-25T21:04:50.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"guybartal","name":"Guy Bertental","path":"/guybartal","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3179107?s=80&v=4"},"commit":{"message":"Remove separation of checkpoints (#570)\n\nRemoved the separation of checkpoints to folders by their index_name and\r\nstep.\r\nNow all checkpoint data is stored together","shortMessageHtmlLink":"Remove separation of checkpoints (#570)"}},{"before":"124bab5a4170d40a5f18ab863fc2d2059cf1e994","after":"1220e43372e5eb275654686e13f081dd04e9cda3","ref":"refs/heads/yuval/remove-checkpoint-init","pushedAt":"2024-05-25T21:03:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"guybartal","name":"Guy Bertental","path":"/guybartal","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3179107?s=80&v=4"},"commit":{"message":"fix tests","shortMessageHtmlLink":"fix tests"}},{"before":"ec6e2f0e3b397b1527bd92899b3872b4818309ac","after":null,"ref":"refs/heads/karina/update-eval-metrics","pushedAt":"2024-05-24T11:13:25.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"kcortinas","name":"Karina Cortiñas","path":"/kcortinas","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/79872984?s=80&v=4"}},{"before":"0341e881ad4364b1ee98dea44674d1ad585daf5f","after":"dd3a933b8335d1941b5db358ec010ce360beb124","ref":"refs/heads/prerelease","pushedAt":"2024-05-24T11:13:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"kcortinas","name":"Karina Cortiñas","path":"/kcortinas","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/79872984?s=80&v=4"},"commit":{"message":"Fix llm-based evaluation metrics (#572)\n\nThis PR fixes:\r\n\r\n- **llm_context_precision**: the metric considers the context used to\r\ngenerate the question-answer pair in step 2 (`02_qa_generation.py`),\r\ninstead of the retrieved contexts. To assess the ability of the system\r\nto retrieve relevant chunks/contexts, we need to consider the relevancy\r\nof the retrieved contexts against the question. The computation of the\r\nmetric is also using as input the generated answer (`actual`) instead of\r\nthe question. The updated metric computes a simple average precision\r\n(proportion of relevant chunks without consideration of the ranking\r\norder).\r\n- **llm_context_recall**: this metric is also using the qna context\r\ninstead of the retrieved contexts. To assess the ability of the system\r\nin retrieving contexts that are aligned with the ground truth answer we\r\nneed to consider the retrieved contexts. The temperature parameter is\r\nremoved as it's already part of the initialisation of\r\n`ResponseGenerator`.\r\n- **llm_answer_relevance**: the metric currently inputs the generated\r\nanswer and the ground truth answer instead of the question and the\r\ngenerated answer.","shortMessageHtmlLink":"Fix llm-based evaluation metrics (#572)"}},{"before":"12a813bd5d80f0e86dc4f36138de80e5af54e77f","after":"ec6e2f0e3b397b1527bd92899b3872b4818309ac","ref":"refs/heads/karina/update-eval-metrics","pushedAt":"2024-05-24T10:32:53.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"kcortinas","name":"Karina Cortiñas","path":"/kcortinas","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/79872984?s=80&v=4"},"commit":{"message":"Fix context precision conflicts with prerelease","shortMessageHtmlLink":"Fix context precision conflicts with prerelease"}},{"before":"ca562a156a8d9d340bf881e471450bfdf004a7ce","after":"12a813bd5d80f0e86dc4f36138de80e5af54e77f","ref":"refs/heads/karina/update-eval-metrics","pushedAt":"2024-05-24T09:52:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"kcortinas","name":"Karina Cortiñas","path":"/kcortinas","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/79872984?s=80&v=4"},"commit":{"message":"fix context precision conflicts with prerelease","shortMessageHtmlLink":"fix context precision conflicts with prerelease"}},{"before":"99c73c838f67fed6080f6433b579f04b00b4162b","after":"ca562a156a8d9d340bf881e471450bfdf004a7ce","ref":"refs/heads/karina/update-eval-metrics","pushedAt":"2024-05-24T08:59:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"kcortinas","name":"Karina Cortiñas","path":"/kcortinas","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/79872984?s=80&v=4"},"commit":{"message":"fix context precision conflicts with prerelease","shortMessageHtmlLink":"fix context precision conflicts with prerelease"}},{"before":"93f7dbe538373d53dc4cbeb8cddc03d16fe22382","after":"99c73c838f67fed6080f6433b579f04b00b4162b","ref":"refs/heads/karina/update-eval-metrics","pushedAt":"2024-05-24T08:33:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"kcortinas","name":"Karina Cortiñas","path":"/kcortinas","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/79872984?s=80&v=4"},"commit":{"message":"fix conflicts with prerelease","shortMessageHtmlLink":"fix conflicts with prerelease"}},{"before":"fda5e9dffb3c3b51693f6d1afc274863bf111190","after":"93f7dbe538373d53dc4cbeb8cddc03d16fe22382","ref":"refs/heads/karina/update-eval-metrics","pushedAt":"2024-05-24T08:23:52.000Z","pushType":"push","commitsCount":7,"pusher":{"login":"kcortinas","name":"Karina Cortiñas","path":"/kcortinas","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/79872984?s=80&v=4"},"commit":{"message":"Merge branch 'prerelease' into karina/update-eval-metrics","shortMessageHtmlLink":"Merge branch 'prerelease' into karina/update-eval-metrics"}},{"before":"c77d22d1e030d707a3d7c025a3334a48608c69d0","after":null,"ref":"refs/heads/dependabot/pip/mlflow-2.13.0","pushedAt":"2024-05-23T20:07:36.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"a236505b422dafe053406fb8a1b974caa9f51239","after":null,"ref":"refs/heads/dependabot/pip/openai-1.30.1","pushedAt":"2024-05-23T20:06:47.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"da97685851230081f201b9b35fcdbc23c9bd3ad8","after":null,"ref":"refs/heads/gh-readonly-queue/development/pr-563-ec87f2b90ec3788c9f287b8b491f2f46e7a8f991","pushedAt":"2024-05-23T20:06:41.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"}},{"before":"ec87f2b90ec3788c9f287b8b491f2f46e7a8f991","after":"da97685851230081f201b9b35fcdbc23c9bd3ad8","ref":"refs/heads/development","pushedAt":"2024-05-23T20:06:40.000Z","pushType":"merge_queue_merge","commitsCount":1,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Bump openai from 1.25.2 to 1.30.1 (#563)\n\nBumps [openai](https://github.com/openai/openai-python) from 1.25.2 to\n1.30.1.\n
\nRelease notes\n

Sourced from openai's\nreleases.

\n
\n

v1.30.1

\n

1.30.1 (2024-05-14)

\n

Full Changelog: v1.30.0...v1.30.1

\n

Chores

\n
    \n
  • internal: add slightly better logging to scripts\n(#1422)\n(43dffab)
    • \n
\n

v1.30.0

\n

1.30.0 (2024-05-14)

\n

Full Changelog: v1.29.0...v1.30.0

\n

Features

\n
    \n
  • api: add incomplete state (#1420)\n(6484984)
    • \n
\n

v1.29.0

\n

1.29.0 (2024-05-13)

\n

Full Changelog: v1.28.2...v1.29.0

\n

Features

\n
    \n
  • api: add gpt-4o model (#1417)\n(4f09f8c)
    • \n
\n

v1.28.2

\n

1.28.2 (2024-05-13)

\n

Full Changelog: v1.28.1...v1.28.2

\n

Bug Fixes

\n
    \n
  • client: accidental blocking sleep in async code (#1415)\n(0ac6ecb)
    • \n
\n

Chores

\n
    \n
  • internal: bump pydantic dependency (#1413)\n(ed73d1d)
    • \n
\n

v1.28.1

\n

1.28.1 (2024-05-11)

\n

Full Changelog: v1.28.0...v1.28.1

\n

Chores

\n
    \n
  • docs: add SECURITY.md (#1408)\n(119970a)
    • \n
\n\n
\n

... (truncated)

\n
\n
\nChangelog\n

Sourced from openai's\nchangelog.

\n
\n

1.30.1 (2024-05-14)

\n

Full Changelog: v1.30.0...v1.30.1

\n

Chores

\n
    \n
  • internal: add slightly better logging to scripts\n(#1422)\n(43dffab)
    • \n
\n

1.30.0 (2024-05-14)

\n

Full Changelog: v1.29.0...v1.30.0

\n

Features

\n
    \n
  • api: add incomplete state (#1420)\n(6484984)
    • \n
\n

1.29.0 (2024-05-13)

\n

Full Changelog: v1.28.2...v1.29.0

\n

Features

\n
    \n
  • api: add gpt-4o model (#1417)\n(4f09f8c)
    • \n
\n

1.28.2 (2024-05-13)

\n

Full Changelog: v1.28.1...v1.28.2

\n

Bug Fixes

\n
    \n
  • client: accidental blocking sleep in async code (#1415)\n(0ac6ecb)
    • \n
\n

Chores

\n
    \n
  • internal: bump pydantic dependency (#1413)\n(ed73d1d)
    • \n
\n

1.28.1 (2024-05-11)

\n

Full Changelog: v1.28.0...v1.28.1

\n

Chores

\n
    \n
  • docs: add SECURITY.md (#1408)\n(119970a)
    • \n
\n

1.28.0 (2024-05-09)

\n

Full Changelog: v1.27.0...v1.28.0

\n

Features

\n\n
\n

... (truncated)

\n
\n
\nCommits\n
    \n
  • 5a89126\nrelease: 1.30.1
    • \n
  • 526a05e\nchore(internal): add slightly better logging to scripts (#1422)
    • \n
  • e2214ce\nrelease: 1.30.0
    • \n
  • d4c2c7a\nfeat(api): add incomplete state (#1420)
    • \n
  • 0b4a180\nrelease: 1.29.0
    • \n
  • ac6c900\nfeat(api): add gpt-4o model (#1417)
    • \n
  • c0afbc7\nrelease: 1.28.2
    • \n
  • 2dc6d42\nfix(client): accidental blocking sleep in async code (#1415)
    • \n
  • 3480e50\nchore(internal): bump pydantic dependency (#1413)
    • \n
  • 906ece0\nrelease: 1.28.1
    • \n
  • Additional commits viewable in compare\nview
    • \n
\n
\n
\n\n\n[![Dependabot compatibility\nscore](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=openai&package-manager=pip&previous-version=1.25.2&new-version=1.30.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)\n\nDependabot will resolve any conflicts with this PR as long as you don't\nalter it yourself. You can also trigger a rebase manually by commenting\n`@dependabot rebase`.\n\n[//]: # (dependabot-automerge-start)\n[//]: # (dependabot-automerge-end)\n\n---\n\n
\nDependabot commands and options\n
\n\nYou can trigger Dependabot actions by commenting on this PR:\n- `@dependabot rebase` will rebase this PR\n- `@dependabot recreate` will recreate this PR, overwriting any edits\nthat have been made to it\n- `@dependabot merge` will merge this PR after your CI passes on it\n- `@dependabot squash and merge` will squash and merge this PR after\nyour CI passes on it\n- `@dependabot cancel merge` will cancel a previously requested merge\nand block automerging\n- `@dependabot reopen` will reopen this PR if it is closed\n- `@dependabot close` will close this PR and stop Dependabot recreating\nit. You can achieve the same result by closing it manually\n- `@dependabot show ignore conditions` will show all\nof the ignore conditions of the specified dependency\n- `@dependabot ignore this major version` will close this PR and stop\nDependabot creating any more for this major version (unless you reopen\nthe PR or upgrade to it yourself)\n- `@dependabot ignore this minor version` will close this PR and stop\nDependabot creating any more for this minor version (unless you reopen\nthe PR or upgrade to it yourself)\n- `@dependabot ignore this dependency` will close this PR and stop\nDependabot creating any more for this dependency (unless you reopen the\nPR or upgrade to it yourself)\n\n\n
\n\n---------\n\nSigned-off-by: dependabot[bot] \nCo-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>\nCo-authored-by: Julia Meshcheryakova ","shortMessageHtmlLink":"Bump openai from 1.25.2 to 1.30.1 (#563)"}},{"before":null,"after":"da97685851230081f201b9b35fcdbc23c9bd3ad8","ref":"refs/heads/gh-readonly-queue/development/pr-563-ec87f2b90ec3788c9f287b8b491f2f46e7a8f991","pushedAt":"2024-05-23T19:58:13.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Bump openai from 1.25.2 to 1.30.1 (#563)\n\nBumps [openai](https://github.com/openai/openai-python) from 1.25.2 to\n1.30.1.\n
\nRelease notes\n

Sourced from openai's\nreleases.

\n
\n

v1.30.1

\n

1.30.1 (2024-05-14)

\n

Full Changelog: v1.30.0...v1.30.1

\n

Chores

\n
    \n
  • internal: add slightly better logging to scripts\n(#1422)\n(43dffab)
    • \n
\n

v1.30.0

\n

1.30.0 (2024-05-14)

\n

Full Changelog: v1.29.0...v1.30.0

\n

Features

\n
    \n
  • api: add incomplete state (#1420)\n(6484984)
    • \n
\n

v1.29.0

\n

1.29.0 (2024-05-13)

\n

Full Changelog: v1.28.2...v1.29.0

\n

Features

\n
    \n
  • api: add gpt-4o model (#1417)\n(4f09f8c)
    • \n
\n

v1.28.2

\n

1.28.2 (2024-05-13)

\n

Full Changelog: v1.28.1...v1.28.2

\n

Bug Fixes

\n
    \n
  • client: accidental blocking sleep in async code (#1415)\n(0ac6ecb)
    • \n
\n

Chores

\n
    \n
  • internal: bump pydantic dependency (#1413)\n(ed73d1d)
    • \n
\n

v1.28.1

\n

1.28.1 (2024-05-11)

\n

Full Changelog: v1.28.0...v1.28.1

\n

Chores

\n
    \n
  • docs: add SECURITY.md (#1408)\n(119970a)
    • \n
\n\n
\n

... (truncated)

\n
\n
\nChangelog\n

Sourced from openai's\nchangelog.

\n
\n

1.30.1 (2024-05-14)

\n

Full Changelog: v1.30.0...v1.30.1

\n

Chores

\n
    \n
  • internal: add slightly better logging to scripts\n(#1422)\n(43dffab)
    • \n
\n

1.30.0 (2024-05-14)

\n

Full Changelog: v1.29.0...v1.30.0

\n

Features

\n
    \n
  • api: add incomplete state (#1420)\n(6484984)
    • \n
\n

1.29.0 (2024-05-13)

\n

Full Changelog: v1.28.2...v1.29.0

\n

Features

\n
    \n
  • api: add gpt-4o model (#1417)\n(4f09f8c)
    • \n
\n

1.28.2 (2024-05-13)

\n

Full Changelog: v1.28.1...v1.28.2

\n

Bug Fixes

\n
    \n
  • client: accidental blocking sleep in async code (#1415)\n(0ac6ecb)
    • \n
\n

Chores

\n
    \n
  • internal: bump pydantic dependency (#1413)\n(ed73d1d)
    • \n
\n

1.28.1 (2024-05-11)

\n

Full Changelog: v1.28.0...v1.28.1

\n

Chores

\n
    \n
  • docs: add SECURITY.md (#1408)\n(119970a)
    • \n
\n

1.28.0 (2024-05-09)

\n

Full Changelog: v1.27.0...v1.28.0

\n

Features

\n\n
\n

... (truncated)

\n
\n
\nCommits\n
    \n
  • 5a89126\nrelease: 1.30.1
    • \n
  • 526a05e\nchore(internal): add slightly better logging to scripts (#1422)
    • \n
  • e2214ce\nrelease: 1.30.0
    • \n
  • d4c2c7a\nfeat(api): add incomplete state (#1420)
    • \n
  • 0b4a180\nrelease: 1.29.0
    • \n
  • ac6c900\nfeat(api): add gpt-4o model (#1417)
    • \n
  • c0afbc7\nrelease: 1.28.2
    • \n
  • 2dc6d42\nfix(client): accidental blocking sleep in async code (#1415)
    • \n
  • 3480e50\nchore(internal): bump pydantic dependency (#1413)
    • \n
  • 906ece0\nrelease: 1.28.1
    • \n
  • Additional commits viewable in compare\nview
    • \n
\n
\n
\n\n\n[![Dependabot compatibility\nscore](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=openai&package-manager=pip&previous-version=1.25.2&new-version=1.30.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)\n\nDependabot will resolve any conflicts with this PR as long as you don't\nalter it yourself. You can also trigger a rebase manually by commenting\n`@dependabot rebase`.\n\n[//]: # (dependabot-automerge-start)\n[//]: # (dependabot-automerge-end)\n\n---\n\n
\nDependabot commands and options\n
\n\nYou can trigger Dependabot actions by commenting on this PR:\n- `@dependabot rebase` will rebase this PR\n- `@dependabot recreate` will recreate this PR, overwriting any edits\nthat have been made to it\n- `@dependabot merge` will merge this PR after your CI passes on it\n- `@dependabot squash and merge` will squash and merge this PR after\nyour CI passes on it\n- `@dependabot cancel merge` will cancel a previously requested merge\nand block automerging\n- `@dependabot reopen` will reopen this PR if it is closed\n- `@dependabot close` will close this PR and stop Dependabot recreating\nit. You can achieve the same result by closing it manually\n- `@dependabot show ignore conditions` will show all\nof the ignore conditions of the specified dependency\n- `@dependabot ignore this major version` will close this PR and stop\nDependabot creating any more for this major version (unless you reopen\nthe PR or upgrade to it yourself)\n- `@dependabot ignore this minor version` will close this PR and stop\nDependabot creating any more for this minor version (unless you reopen\nthe PR or upgrade to it yourself)\n- `@dependabot ignore this dependency` will close this PR and stop\nDependabot creating any more for this dependency (unless you reopen the\nPR or upgrade to it yourself)\n\n\n
\n\n---------\n\nSigned-off-by: dependabot[bot] \nCo-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>\nCo-authored-by: Julia Meshcheryakova ","shortMessageHtmlLink":"Bump openai from 1.25.2 to 1.30.1 (#563)"}},{"before":"a831cfb94f9ba57c0d59eb402ddcbe2f595f7917","after":"a236505b422dafe053406fb8a1b974caa9f51239","ref":"refs/heads/dependabot/pip/openai-1.30.1","pushedAt":"2024-05-23T19:51:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"julia-meshcheryakova","name":"Julia Meshcheryakova","path":"/julia-meshcheryakova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1250479?s=80&v=4"},"commit":{"message":"Update requirements.txt","shortMessageHtmlLink":"Update requirements.txt"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEVe6TKAA","startCursor":null,"endCursor":null}},"title":"Activity · microsoft/rag-experiment-accelerator"}