Extraction and recovery of spatio-temporal structure in latent dynamics alignment with diffusion models [NeurIPS'2023 Spotlight]

Yule Wang, Zijing Wu, Chengrui Li, and Anqi Wu

Georgia Institute of Technology

Atlanta, GA, USA

Environment Setup

To install the required dependancies using conda, run:

$ conda create --name erdiff --file requirements.txt

To install the required dependancies using Python virtual environment, run:

$ python3 -m venv erdiff
$ source erdiff/bin/activate
$ python3 -m pip install --upgrade pip
$ python3 -m pip install -e .

Training & Alignment

1. Source Domain: Training

$ python3 VAE_Diffusion_CoTrain.py

2. Target Domain: Maximum Likelihood Alignment

$ python3 MLA.py

Latent Dynamics Visualization

Cited as

@article{wang2024extraction,
  title={Extraction and recovery of spatio-temporal structure in latent dynamics alignment with diffusion model},
  author={Wang, Yule and Wu, Zijing and Li, Chengrui and Wu, Anqi},
  journal={Advances in Neural Information Processing Systems},
  volume={36},
  year={2024}
}

ERDiff Poster for NeurIPS 2023