Loki: Open-source solution designed to automate the process of verifying factuality
-
Updated
May 28, 2024 - Python
Loki: Open-source solution designed to automate the process of verifying factuality
Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
WikiChat stops the hallucination of large language models by retrieving data from Wikipedia.
RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.
Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
[Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
Code and data for the paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"
Testbench for sentiment and factuality in texts.
Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
Retrieval-augmented Generation (2024 Google Project Submodules)
The implementation for EMNLP 2023 paper ”Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators“
Implementation of the paper "FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations (NAACL 2022)"
Code and data for the Dreyer et al (2023) paper on abstractiveness and factuality in abstractive summarization
API Services: Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society
Dataset: Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society
Event factuality prediction.Trigger state LSTM
Add a description, image, and links to the factuality topic page so that developers can more easily learn about it.
To associate your repository with the factuality topic, visit your repo's landing page and select "manage topics."