Unsupervised Attributed Multiplex Network Embedding (DMGI)

Overview

Nodes in a multiplex network are connected by multiple types of relations. However, most existing network embedding methods assume that only a single type of relation exists between nodes. Even for those that consider the multiplexity of a network, they overlook node attributes, resort to node labels for training, and fail to model the global properties of a graph. We present a simple yet effective unsupervised network embedding method for attributed multiplex network called DMGI, inspired by Deep Graph Infomax (DGI) that maximizes the mutual information between local patches of a graph, and the global representation of the entire graph. We devise a systematic way to jointly integrate the node embeddings from multiple graphs by introducing 1) the consensus regularization framework that minimizes the disagreements among the relation-type specific node embeddings, and 2) the universal discriminator that discriminates true samples regardless of the relation types. We also show that the attention mechanism infers the importance of each relation type, and thus can be useful for filtering unnecessary relation types as a preprocessing step. Extensive experiments on various downstream tasks demonstrate that DMGI outperforms the state-of-the-art methods, even though DMGI is fully unsupervised.

DMGI is introduced in the official repository of PyTorch Geometric (Link)

Paper

• Unsupervised Attributed Multiplex Network Embedding (AAAI 2020)
  • Chanyoung Park, Donghyun Kim, Jiawei Han, Hwanjo Yu

Requirements

• Python version: 3.6.8
• Pytorch version: 1.2.0
• networkx version: 2.3

How to Run

git clone https://github.com/pcy1302/DMGI.git
cd DMGI
mkdir saved_model

• Download IMDB data from here to data

python main.py --embedder DMGI --dataset imdb --metapaths MAM,MDM --isAttn

• Refer to the directory data for preprocessing for DBLP and Amazon datasets.

Data format [(ex) IMDB]

• A dictionary containing the following keys

  • train_idx: training index, val_idx: validation index, test_idx: test index, feature: feature matrix, label: labels
  • Relations: MDM, MAM

• NEW (20/10/06): You can download all the preprocessed datasets used in the paper from here

Cite (Bibtex)

• If you find DMGI useful in your research, please cite the following paper:
  • Park, Chanyoung, Donghyun Kim, Jiawei Han, and Hwanjo Yu. "Unsupervised Attributed Multiplex Network Embedding." AAAI 2020.
  • Bibtex

@article{park2019unsupervised,
  title={Unsupervised Attributed Multiplex Network Embedding},
  author={Park, Chanyoung and Kim, Donghyun and Han, Jiawei and Yu, Hwanjo},
  booktitle={AAAI},
  year={2020}
}