GPT2 finetuned with optional ways of integrating COMeT commonsense embeddings.
Training: Beaker Experiment
Generation:
python anlg/run_generation.py --model_type gpt2_for_anli_comet --model_name_or_path models/anlg/only_o1_o2/ --input-file data/anlg/dev-w-comet-preds.jsonl --task anli --output-file models/anlg/only_o1_o2/dev-w-comet-preds-generations.jsonl
Training: Beaker Experiment
Generation:
python anlg/run_generation.py --model_type gpt2_for_anli_comet --model_name_or_path models/anlg/restricted_comet_phrases_prefix/ --input-file data/anlg/dev-w-comet-preds.jsonl --task anli --output-file models/anlg/restricted_comet_phrases_prefix/dev-w-comet-preds-generations.jsonl --include_comet True --comet_as_text True --restrict_comet True
Training: Beaker Experiment
Generation:
python anlg/run_generation.py --model_type gpt2_for_anli_comet --model_name_or_path models/anlg/lm_all_comet_emb_prefix/ --input-file data/anlg/dev-w-comet-preds.jsonl --task anli --output-file models/anlg/lm_all_comet_emb_prefix/dev-w-comet-preds-generations.jsonl --include_comet True --comet_model_path comet-model/atomic_pretrained_model.th
Training: Beaker Experiment
Generation:
python anlg/run_generation.py --model_type gpt2_for_anli_comet --model_name_or_path models/anlg/lm_restricted_comet_emb_prefix/ --input-file data/anlg/dev-w-comet-preds.jsonl --task anli --output-file models/anlg/lm_restricted_comet_emb_prefix/dev-generations.jsonl --include_comet True --comet_model_path comet-model/atomic_pretrained_model.th
Training: Beaker Experiment
Generation:
python anlg/run_generation.py --model_type gpt2_for_anli_comet --model_name_or_path models/anlg/all_comet_phrases_prefix/ --input-file data/anlg/dev-w-comet-preds.jsonl --task anli --output-file models/anlg/all_comet_phrases_prefix/dev-w-comet-preds-generations.jsonl --include_cometex_m0d33r2bucxb true --comet_as_text true