Skip to content

ACM Multimedia 2022 - Micro-video Tagging via Jointly Modeling Social Influence and Tag Relation

License

Notifications You must be signed in to change notification settings

SCZwangxiao/RADAR-MM2022

Repository files navigation

RADAR

Implementation of paper Micro-video Tagging via Jointly Modeling Social Influence and Tag Relation (Accepted by ACM Multimedia 2022) (paper PDF).

In this paper, we study the problem of micro-video tagging, formulated as a link prediction problem in a video-tag network to jointly model social influence and tag relation. Our RADAR model derive a better video and tag representation through Behavior Spread modeling and visual and linguistic knowledge aggregation. Extensive experiments on industrial datasets of three verticals verify the superiority of our model compared with several state-of-the-art baselines.

Framework

framework

Datasets

The dataset can be downloaded here (password: 85rv)

Prerequisites

See Installation Guide for details.

Quick Start

a. To reproduce Table 2 in paper.

bash benchmark/vanilla.sh # Vanilla
bash benchmark/mlgcn.sh # ML-GCN
bash benchmark/nextvlad.sh # NeXtVLAD
bash benchmark/cma.sh # CMA
bash benchmark/mall.sh # MALL-CNN
bash benchmark/taggnn.sh # TagGNN
bash benchmark/taghan.sh # HAN
bash benchmark/taghgt.sh # HGT
bash benchmark/simple_hgn.sh # Simple_HGN
bash benchmark/ourgnn.sh # Ours

b. To reproduce Table 3 in paper.

# 5.5.1 Ablation of different relations.
bash benchmark/ourgnn_relation_ablation.sh
# 5.5.2 Ablation of GGT.
bash benchmark/ourgnn_ggt_ablation.sh
# 5.5.3 Ablation of AAN.
bash benchmark/ourgnn_aan_ablation.sh

c. To reproduce Figure 7 in paper.

bash benchmark/ourgnn_layer_ablation.sh # (a)
python benchmark/ours_aan_sensi.py # (b)

Citation

@inproceedings{xiao2022radar,
  author       = {Xiao Wang and
                  Tian Gan and
                  Yinwei Wei and
                  Jianlong Wu and
                  Dai Meng and
                  Liqiang Nie},
  title        = {Micro-video Tagging via Jointly Modeling Social Influence and Tag
                  Relation},
  booktitle    = {{MM} '22: The 30th {ACM} International Conference on Multimedia, Lisboa,
                  Portugal, October 10 - 14, 2022},
  pages        = {4478--4486},
  publisher    = {{ACM}},
  year         = {2022},
}

About

ACM Multimedia 2022 - Micro-video Tagging via Jointly Modeling Social Influence and Tag Relation

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published