This repository contains algorithms developed for the paper:
Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress, Arxiv
Ameya Prabhu*, Vishaal Udandarao*, Philip Torr, Matthias Bethge+, Adel Bibi+, Samuel Albanie+
[PDF] [Slides] [Poster] [Bibtex]
We hope Sort and Search is a strong baseline and comparison for efficiently evaluating your cool large test set! To cite our work:
@article{prabhu2024lifelong,
title={Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress},
author={Prabhu, Ameya and Udandarao, Vishaal and Torr, Philip and Bethge, Matthias and Bibi, Adel and Albanie, Samuel},
journal={arXiv preprint arXiv:2402.19472},
year={2024}
}