Min-K%++: Improved Baseline for Detecting Pre-Training Data of LLMs

Overview

We propose a new Membership Inference Attack method named Min-K%++ for detecting pre-training data of LLMs, which achieves SOTA results among reference-free methods. This repo contains the lightweight implementation of our method (along with all the baselines) on the WikiMIA benchmark. For experiments on the MIMIR benchmark, please refer to our fork here.

Setup

Environment

First install torch according to your environment. Then simply install dependencies by pip install -r requirements.txt. It will install the latest transformer library from the github main branch, which is required to run Mamba models.

Our code is tested with Python 3.8, PyTorch 2.2.0, Cuda 12.1.

Data

All data splits are hosted on huggingface and will be automatically loaded when running scripts.

• The original WikiMIA is from 🤗swj0419/WikiMIA.
• The WikiMIA authors also studied a paraphrased setting, yet the paraphrased data was not released. Here we provide our version, which is paraphrased by ChatGPT with the instruction of replacing certain number of words. The data is hosted at 🤗zjysteven/WikiMIA_paraphrased_perturbed.
• In addition, to run Neighbor attack, one needs to perturb each input sentence (with masked language model) to create perturbed neighbors. We also provide the perturbed data for everyone to use at 🤗zjysteven/WikiMIA_paraphrased_perturbed.
• Lastly, we propose a new setting that simulates "detect-while-generating" by concatenating the training text with the leading non-training text. This split is hosted at 🤗zjysteven/WikiMIA_concat.

Running

There are four scripts, each of which is self-contained to best facilitate quick reproduction and extension. The meaning of the arguments of each script should be clear from their naming.

• run.py will run the Loss, Zlib, Min-K%, and Min-K%++ attack on the WikiMIA dataset (either the original or the paraphrased version) with the specified model.
• run_ref.py will run the Ref, Lowercase attack on the WikiMIA dataset (either the original or the paraphrased version) with the specified model.
• run_neighbor.py will run the Neighbor attack on the WikiMIA dataset (either the original or the paraphrased version) with the specified model.
• run_concat.py focus on the WikiMIA_concat dataset with the specified model. For this setting only the Loss, Zlib, Min-K%, and Min-K%++ are applicable.

The outputs of these scripts will be a csv file consisting of method results (AUROC and TPR@FPR=5%) stored in the results directory, with the filepath indicating the dataset and model. Sample results by running the four scripts are provided in the results directory.

Acknowledgement

This codebase is adapted from the official repo of Min-K% and WikiMIA.

Citation

If you find this work/repo/data splits useful, please consider citing our paper:

@article{zhang2024min,
  title={Min-K\%++: Improved Baseline for Detecting Pre-Training Data from Large Language Models},
  author={Zhang, Jingyang and Sun, Jingwei and Yeats, Eric and Ouyang, Yang and Kuo, Martin and Zhang, Jianyi and Yang, Hao and Li, Hai},
  journal={arXiv preprint arXiv:2404.02936},
  year={2024}
}