{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":346639494,"defaultBranch":"latest","name":"openvino_notebooks","ownerLogin":"openvinotoolkit","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2021-03-11T09:01:13.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/55443902?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1717736417.0","currentOid":""},"activityList":{"items":[{"before":"0238a6e235c4c33264a6b9fa9189161f2b807174","after":"a22c21d1507f7cb52b684464a45e5fb9725dc2d9","ref":"refs/heads/latest","pushedAt":"2024-06-11T13:00:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"Fix monkey patching (#2101)\n\nCVS-143743","shortMessageHtmlLink":"Fix monkey patching (#2101)"}},{"before":"5c03914342d624250b6b96b03e00dd08e9221086","after":"0238a6e235c4c33264a6b9fa9189161f2b807174","ref":"refs/heads/latest","pushedAt":"2024-06-11T04:08:36.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"Added AWQ option to llm-chatbot notebook (#2043)\n\nAdd an option to run AWQ algorithm during INT4 model compression in\r\n`llm-chatbot` and `llm-rag-langchain` notebooks. Applying AWQ slightly\r\nimproves model generation quality, but requires significant amount of\r\nadditional memory and time so it is disabled by default.\r\n\r\nSome evaluation results are below. The wikitext task is considered as a\r\nmore accurate one. If not stated explicitly, AWQ was calibrated on\r\nwikitext2 dataset.\r\n\r\n\r\n\r\n
\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\nModel | Compression | PPL on lambada-openai | PPL on wikitext |\r\nCompression Time\r\n-- | -- | -- | -- | --\r\ngemma-2b-it | FP16 | 8.23 | | \r\ngemma-2b-it | INT8_asym | 8.36 | | \r\ngemma-2b-it | INT4_sym group size 64 ratio 60% | 8.9 | | 59 sec.\r\ngemma-2b-it | INT4_sym group size 64 ratio 60% + AWQ | 8.62 | | 202\r\nsec.\r\n | | | | \r\nllama-2-chat-7b | FP16 | 3.26 | 11.6 | \r\nllama-2-chat-7b | INT8_asym | 3.27 | 11.6 | \r\nllama-2-chat-7b | INT4_sym group size 128 ratio 80% | 3.38 | 11.95 | 215\r\nsec.\r\nllama-2-chat-7b | INT4_sym group size 128 ratio 80% + AWQ (wikitext2) |\r\n3.44 | 11.88 | 768 sec.\r\nllama-2-chat-7b | INT4_sym group size 128 ratio 80% + AWQ (ptb) | 3.42 |\r\n11.87 | \r\n | | | | \r\nllama-3-8b-instruct | FP16 | 3.1 | | \r\nllama-3-8b-instruct | INT8_asym | 3.08 | | \r\nllama-3-8b-instruct | INT4_sym group size 128 ratio 80% | 3.38 | | 242\r\nsec.\r\nllama-3-8b-instruct | INT4_sym group size 128 ratio 80% + AWQ | 3.26 | \r\n| 956 sec.\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n**Ticket**\r\n141233","shortMessageHtmlLink":"Added AWQ option to llm-chatbot notebook (#2043)"}},{"before":"68b0ada3cf69362748642d1da02c6e7960c46124","after":"5c03914342d624250b6b96b03e00dd08e9221086","ref":"refs/heads/latest","pushedAt":"2024-06-11T04:04:41.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"[llm-agent]Replace the LLM with Mistrial for better accuracy on GPU (#2094)","shortMessageHtmlLink":"[llm-agent]Replace the LLM with Mistrial for better accuracy on GPU (#…"}},{"before":"3de1edee7c612938a1516c3fa6c68e0c8ece7d1a","after":"68b0ada3cf69362748642d1da02c6e7960c46124","ref":"refs/heads/latest","pushedAt":"2024-06-11T02:32:26.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"andrei-kochin","name":"Andrei Kochin","path":"/andrei-kochin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/72827868?s=80&v=4"},"commit":{"message":"fix copy-paste issue in rag (#2098)\n\nfixing typo introduced in #2097","shortMessageHtmlLink":"fix copy-paste issue in rag (#2098)"}},{"before":"f80e692da3f8f25538ffb8fd7eefe28bd22f9d06","after":"3de1edee7c612938a1516c3fa6c68e0c8ece7d1a","ref":"refs/heads/latest","pushedAt":"2024-06-10T11:19:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"use lightweight model in llm chatbot by default (#2097)","shortMessageHtmlLink":"use lightweight model in llm chatbot by default (#2097)"}},{"before":"392b53737b83f66dd903e5e9706b2912acb26498","after":"f80e692da3f8f25538ffb8fd7eefe28bd22f9d06","ref":"refs/heads/latest","pushedAt":"2024-06-10T08:59:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"andrei-kochin","name":"Andrei Kochin","path":"/andrei-kochin","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/72827868?s=80&v=4"},"commit":{"message":"Update notebooks index readme file [skip ci]","shortMessageHtmlLink":"Update notebooks index readme file [skip ci]"}},{"before":"7a5b26eee1e7e224c4ee7908348d3e9f8cc00ec2","after":"392b53737b83f66dd903e5e9706b2912acb26498","ref":"refs/heads/latest","pushedAt":"2024-06-10T08:52:05.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"update whisper notebook (#2095)","shortMessageHtmlLink":"update whisper notebook (#2095)"}},{"before":"3b27f2ee94ae63b426b779138c70f0d62dbb614c","after":"7a5b26eee1e7e224c4ee7908348d3e9f8cc00ec2","ref":"refs/heads/latest","pushedAt":"2024-06-10T08:18:34.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"[GH Pages] Fix python 3.11 GPU status (#2096)","shortMessageHtmlLink":"[GH Pages] Fix python 3.11 GPU status (#2096)"}},{"before":"72d7bc715f948b7b514e5feb4026ab0b24b1b368","after":"3b27f2ee94ae63b426b779138c70f0d62dbb614c","ref":"refs/heads/latest","pushedAt":"2024-06-07T10:19:50.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"Add support for python3.11 launcher in Notebooks selector (#2069)\n\nTicket: CVS-142915","shortMessageHtmlLink":"Add support for python3.11 launcher in Notebooks selector (#2069)"}},{"before":"b28fb7dbf1d234385ac468f32105f804681c8dbb","after":"72d7bc715f948b7b514e5feb4026ab0b24b1b368","ref":"refs/heads/latest","pushedAt":"2024-06-07T09:10:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"Change tools input name to avoid misunderstanding by agent (#2092)","shortMessageHtmlLink":"Change tools input name to avoid misunderstanding by agent (#2092)"}},{"before":"3945a3908003e09e852caa73140ccbde466cdfdb","after":"b28fb7dbf1d234385ac468f32105f804681c8dbb","ref":"refs/heads/latest","pushedAt":"2024-06-07T09:10:09.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"reinstall opencv in person counting (#2091)","shortMessageHtmlLink":"reinstall opencv in person counting (#2091)"}},{"before":"6a7f5f42220881d5e14cd9903fad6b322a2c9730","after":"3945a3908003e09e852caa73140ccbde466cdfdb","ref":"refs/heads/latest","pushedAt":"2024-06-07T07:20:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"Fix Agent's hallucination issue (#2083)\n\n1. Fix the mistake on Agent's hallucination\r\n2. Update LLM with Phi-3 Mini\r\n3. Add new tools for weather query and image generation","shortMessageHtmlLink":"Fix Agent's hallucination issue (#2083)"}},{"before":"1a5937f02873d86b0a594234a871b210bd0ce065","after":"6a7f5f42220881d5e14cd9903fad6b322a2c9730","ref":"refs/heads/latest","pushedAt":"2024-06-07T06:28:28.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"fix spellcheck detected issue (#2090)","shortMessageHtmlLink":"fix spellcheck detected issue (#2090)"}},{"before":"c0e2d66fd3d78124bdeaef71331ee11c7aabfd03","after":"1a5937f02873d86b0a594234a871b210bd0ce065","ref":"refs/heads/latest","pushedAt":"2024-06-07T05:01:01.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"Fix error in demo of enabling sparse weight decompression feature (#2088)\n\nThe value needs to be between double quotes, otherwise it gives an error\r\nasking for the value to be a float.","shortMessageHtmlLink":"Fix error in demo of enabling sparse weight decompression feature (#2088"}},{"before":"20a5bfbfc14d094c047c26d5a6906f9629c06ce1","after":null,"ref":"refs/heads/dependabot/pip/dot-docker/tornado-6.4.1","pushedAt":"2024-06-07T05:00:17.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"}},{"before":"0647a13e5e1ddaa1dda544e6ca1622deaec7c1ea","after":"c0e2d66fd3d78124bdeaef71331ee11c7aabfd03","ref":"refs/heads/latest","pushedAt":"2024-06-07T05:00:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"eaidova","name":"Ekaterina Aidova","path":"/eaidova","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/29454499?s=80&v=4"},"commit":{"message":"Bump tornado from 6.4 to 6.4.1 in /.docker (#2089)\n\nBumps [tornado](https://github.com/tornadoweb/tornado) from 6.4 to\r\n6.4.1.\r\nSourced from tornado's\r\nchangelog.
\r\n\r\n\r\nRelease notes
\r\n.. toctree::\r\n:maxdepth: 2
\r\nreleases/v6.4.1\r\nreleases/v6.4.0\r\nreleases/v6.3.3\r\nreleases/v6.3.2\r\nreleases/v6.3.1\r\nreleases/v6.3.0\r\nreleases/v6.2.0\r\nreleases/v6.1.0\r\nreleases/v6.0.4\r\nreleases/v6.0.3\r\nreleases/v6.0.2\r\nreleases/v6.0.1\r\nreleases/v6.0.0\r\nreleases/v5.1.1\r\nreleases/v5.1.0\r\nreleases/v5.0.2\r\nreleases/v5.0.1\r\nreleases/v5.0.0\r\nreleases/v4.5.3\r\nreleases/v4.5.2\r\nreleases/v4.5.1\r\nreleases/v4.5.0\r\nreleases/v4.4.3\r\nreleases/v4.4.2\r\nreleases/v4.4.1\r\nreleases/v4.4.0\r\nreleases/v4.3.0\r\nreleases/v4.2.1\r\nreleases/v4.2.0\r\nreleases/v4.1.0\r\nreleases/v4.0.2\r\nreleases/v4.0.1\r\nreleases/v4.0.0\r\nreleases/v3.2.2\r\nreleases/v3.2.1\r\nreleases/v3.2.0\r\nreleases/v3.1.1\r\nreleases/v3.1.0\r\nreleases/v3.0.2\r\nreleases/v3.0.1\r\nreleases/v3.0.0\r\nreleases/v2.4.1\r\nreleases/v2.4.0\r\nreleases/v2.3.0
\r\n\r\n
... (truncated)
\r\n2a0e1d1
\r\nMerge pull request #3388\r\nfrom bdarnell/release-641b7af4e8
\r\nRelease notes and version bump for version 6.4.1d65f6e7
\r\nMerge pull request #3387\r\nfrom bdarnell/chunked-parsing8d721a8
\r\nhttputil: Only strip tabs and spaces from header values7786f09
\r\nMerge pull request #3386\r\nfrom bdarnell/curl-crlffb119c7
\r\nhttp1connection: Stricter handling of transfer-encodingb0ffc58
\r\ncurl_httpclient,http1connection: Prohibit CR and LF in headers0efa9a4
\r\nMerge pull request #3385\r\nfrom bdarnell/update-black2757c6e
\r\nMerge pull request #3384\r\nfrom tornadoweb/dependabot/pip/requests-2.32.2291d1b6
\r\n*: Update black