GroupMeeting

• Tasks or Methods
  • Relation Extraction
  • Semantic Role Labeling
  • Dependency Parsing
  • Math Problem Generation
  • Medical Text Processing
  • Named Entity Recognition
  • Law Judgement Prediction
  • Discourse Parsing
  • Knowledge Distilling
  • Data Augmentation
  • Transformer
  • Numerical Embedding
  • Question Answering
  • Chinese Word Segmentation
  • Machine Translation
  • Question Generation
  • Language Model
  • Abstractive Summarization
  • Sequence Labeling

Tasks or Methods

1. Relation Extraction

2020/02/23 reporter: Shuang Zeng

• paper: Fenia Christopoulou, Makoto Miwa, Sophia Ananiadou. 2019. Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphs. In EMNLP-IJCNLP 2019.
• ppt: 20200223_zs
• method: BiLSTM + Edge-oriented Graph + Iterative Inference Mechanism

2020/03/08 reporter: Yuan Zong

• paper: Daojian Zeng, Haoran Zhang, Qianying Liu. 2020. CopyMTL:Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning. In AAAI 2020.
• ppt: 20200308_zy
• method: Pointer-generator + mulit-task

2020/03/15 reporter: Runxin Xu

• paper: Zhepei Wei, Jianlin Su, Yue Wang, Yuan Tian, Yi Chang. 2019. A Novel Hierarchical Binary Tagging Framework for Joint Extraction of Entities and Relations. In arxiv preprint.
• ppt: 20200315_xrx
• method: BERT + subject tagger + relation-specific object tagger

2020/03/22 reporter: Shuang Zeng

• paper: Bowen Yu, Zhenyu Zhang, Tingwen Liu, Bin Wang, Sujian Li, Quangang Li. 2019. Beyond Word Attention: Using Segment Attention in Neural Relation Extraction. In IJCAI 2019.
• ppt: 20200322_zs
• method: Segment Attention Layer with linear-chain CRF + two regularizers

2020/04/05 reporter: Yuan Zong

• paper: Christoph Alt, Marc Hübner, Leonhard Hennig. 2019. Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction. In ACL 2019.
• ppt: 20200405_zy
• method: Pretrain_model + bag_level

2020/04/12 reporter: Shuang Zeng

• paper1: Xiaocheng Feng, Jiang Guo, Bing Qin, Ting Liu, Yongjie Liu. 2017. Effective Deep Memory Networks for Distant Supervised Relation Extraction. In IJCAI 2017.
• method: PCNN + word-level memory + sentence-level memory, bag-level multi-instance multi-label learning
• paper2: Jianhao Yan, Lin He, Ruqin Huang, Jian Li, Ying Liu. 2019. Relation Extraction with Temporal Reasoning Based on Memory Augmented Distant Supervision. In NAACL 2019.
• method: PCNN + temporal memory + iterative reasoning
• ppt: 20200412_zs

2020/04/20 reporter: Xudong Chen

• paper: Yang Li, Guodong Long, Tao Shen, Tianyi Zhou, Lina Yao, Huan Huo, Jing Jiang.2020. Self-Attention Enhanced Selective Gate with Entity-Aware Embedding for Distantly Supervised Relation Extraction. In AAAI 2020.
• ppt: 20200420_cxd
• method: Attention+Gate+Entity-Aware Embedding

2020/04/20 reporter: Runxin Xu

• paper1: Livio Baldini Soares, Nicholas FitzGerald, Jeffrey Ling, Tom Kwiatkowski.2019. Matching the Blanks: Distributional Similarity for Relation Learning. In ACL 2019.
• paper2: Weijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang, Qi Ju, Haotang Deng, Ping Wang.2020. K-BERT: Enabling Language Representation with Knowledge Graph. In AAAI 2020.
• ppt: 20200420_xrx
• method: Pre-train Model & Knowledge Graph

2020/05/03 reporter: Yuan Zong

• paper: Wenya Wang, Sinno Jialin Pan. 2020. Integrating Deep Learning with Logic Fusion for Information Extraction. In AAAI 2020.
• ppt: 20200503_zy
• method: Transformer & Logic Fusion

2020/05/17 reporter: Shuang Zeng

• paper: Kai Sun, Richong Zhang, Samuel Mensah, Yongyi Mao, Xudong Liu. 2020. Recurrent Interaction Network for Jointly Extracting Entities and Classifying Relations. In Arxiv Preprint.
• ppt: 20200517_zs
• method: Recurrent Interaction Network

2020/06/14 reporter: Shuang Zeng

• paper: Guoshun Nan, Zhijiang Guo, Ivan Sekulić, Wei Lu. 2020. Reasoning with Latent Structure Refinement for Document-Level Relation Extraction. In ACL 2020.
• ppt: 20200614_zs
• method: Node Constructor + Structure Attention based Sturcture Induction + Multi-hop Reasoning

2020/07/18 reporter: Runxin Xu

• paper: Pengcheng Yin, Graham Neubig, Wen-tau Yih, Sebastian Riedel. 2020. TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data. In ACL 2020.
• ppt: 20200718_xrx
• method: Pretraining for Table Data

2020/07/26 reporter: Xudong Chen

• paper: Pengcheng Yin, Graham Neubig, Wen-tau Yih, Sebastian Riedel. 2020. A Joint Neural Model for Information Extraction with Global Features. In ACL 2020.
• ppt: 20200726_cxd
• method: Muti-task+Global Features

2020/08/02 reporter: Shuang Zeng

• paper1: Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin, Sameer Singh. 2020. Beyond Accuracy: Behavioral Testing of NLP Models with CheckList. In ACL 2020.
• method: CheckList for generalization in NLP models
• paper2: Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, Noah A. Smith. 2020. Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks. In ACL 2020.
• method: Multi-phase Adaptive Pre-training on domains and tasks
• paper3: Yi Luan, Luheng He, Mari Ostendorf, Hannaneh Hajishirzi. 2018. Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction. In EMNLP 2018.
• method: Mutil-task setup for NER + CR + RE
• paper4: Cheng Li, Ye Tian. 2020. Downstream Model Design of Pre-trained Language Model for Relation Extraction Task. In Arxiv Preprint.
• method: Downstream design for RE using bert
• paper5: Takashi Ishida, Ikko Yamane, Tomoya Sakai, Gang Niu, Masashi Sugiyama. 2020. Do We Need Zero Training Loss After Achieving Zero Training Error?. In ICML 2020.
• method: Flooding loss for double decent on test loss
• ppt: 20200802_zs_xrx

2020/08/16 reporter: Xudong Chen

• paper: Bowen Yu, Zhenyu Zhang, Xiaobo Shu, Yubin Wang, Tingwen Liu, Bin Wang, Sujian Li. 2019. Joint Extraction of Entities and Relations Based on a Novel Decomposition Strategy.
• ppt: 20200815_cxd
• method: HBT+Decomposition Strategy

2020/08/30 reporter: Shuang Zeng

• paper: Sarthak Jain, Madeleine van Zuylen, Hannaneh Hajishirzi, Iz Beltagy. 2020. SciREX: A Challenge Dataset for Document-Level Information Extraction. In ACL 2020.
• ppt: 20200830_zs
• method: Largest Document-level Relation Extraction Dataset, which is in the domain of Science

2020/10/31 reporter: Jiaxing Lin

• paper1: Difeng Wang, Wei Hu, Ermei Cao, Weijian Sun. 2020. Global-to-Local Neural Networks for Document-Level Relation Extraction. In EMNLP 2020
• method: BERT+R-GCN for global rep, MultiHeadAttention for local rep and self-attention for topic rep
• paper2: Wenxuan Zhou, Kevin Huang, Tengyu Ma, Jing Huang. 2020. Document-Level Relation Extraction with Adaptive Thresholding and Localized Context Pooling. In ArXiv 2020
• method: BERT, localized context pooling by using the last transformer layer in BERT, adaptive thresholding and adaptive thresholding loss
• ppt: 20201031_ljx

2020/11/14 reporter: Shuang Zeng

• paper1: Hao Peng, Tianyu Gao, Xu Han, Yankai Lin, Peng Li, Zhiyuan Liu, Maosong Sun, Jie Zhou. 2020. Learning from Context or Names? An Empirical Study on Neural Relation Extraction. In EMNLP 2020.
• method: Contrastive Pre-training for RE + Random Mask Entity
• paper2: Amir DN Cohen, Shachar Rosenman, Yoav Goldberg. 2020. Relation Extraction as Two-way Span-Prediction. In ArXiv 2020.
• method: Reduce Relation Classification task to Question Answering Task with bidirectional question for each relation
• ppt: 20201114_zs

2020/12/12 reporter: Jiaxing Lin

• paper1: Jue Wang, Wei Lu. 2020. Two are Better than One: Joint Entity and Relation Extraction tiwh Table-Sequence Encoders. In EMNLP 2020
• method: Table-filling, table encoder and sequence encoder interact with each other
• paper2: Bin Ji, Jie Yu, Shasha Li, Jun Ma, Qingbo Wu, Yusong Tan, Huijun Liu. 2020. Span-based Joint Entity and Relation Extraction with Attention-based Span-specific and Contextual Semantic Representations. In COLING 2020
• method: NER: SpanSpecific representation and sentence-level contextual representation; RE: local representation and sentence-level contextual representation.
• ppt: 20201212_ljx

2020/12/26 reporter: Shuang Zeng

• paper1: Juan Li, Ruoxu Wang, Ningyu Zhang, Wen Zhang, Fan Yang, Huajun Chen. 2020. Logic-guided Semantic Representation Learning for Zero-Shot Relation Classification. In COLING 2020.
• method: Semantic Mapping in CV + Knowledge Graph Embedding + Rule-based Embedding
• paper2: Junjie Yu, Tong Zhu, Wenliang Chen, Wei Zhang, Min Zhang. 2020. Improving Relation Extraction with Relational Paraphrase Sentences. In COLING 2020.
• method: Relational Paraphrase Sentence + Multi-instance Learning
• ppt: 20201226_zs

2. Semantic Role Labeling

2020/02/23 reporter: Xudong Chen

• paper: Zuchao Li, Shexia He, Junru Zhou, Hai Zhao, Kevin Par Rui Wang. 2019. Dependency and Span, Cross-Style Semantic Role Labeling on PropBank and NomBank. In Arxiv Preprint.
• ppt: 20200223_cxd
• method: BiLSTM + Syntactic Aided + Biaffine

2020/03/22 reporter: Xudong Chen

• paper: Anwen Hu,Zhicheng Dou,Jian-Yun Nie,Ji-Rong Wen. 2019. Leveraging Multi-token Entities in Document-level Named Entity Recognition. In AAAI 2020.
• ppt: 20200322_cxd
• method: BiLSTM + Document Attention + CRF

2020/12/05 reporter: Xudong Chen

• paper: Emanuele Bastianelli, Andrea Vanzo, Oliver Lemon. 2020. Encoding Syntactic Constituency Paths for Frame-Semantic Parsing with Graph Convolutional Networks.
• ppt: 20201205_cxd
• method: GCN+Dependency parsing

3. Dependency Parsing

2020/03/15 reporter: Wei Cui

• paper: Daniel Fern´andez-Gonz´alez and Carlos G´omez-Rodr´ıguez. 2020. Discontinuous Constituent Parsing with Pointer Networks. In AAAI 2020.
• ppt: 20200315_cw
• method: Constituents as Augmented Dependencies + Pointer Network

2020/04/12 reporter: Wei Cui

• paper: Alireza Mohammadshahi and James Henderson. 2020. Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement. In Arxiv Preprint.
• ppt: 20200412_cw
• method: Graph-to-Graph Iterative Refinement

4. Math Problem Generation

2020/03/01 reporter: Tianyang Cao

• paper: Xinyu Hua and Lu Wang. 2019. Sentence-Level Content Planning and Style Specification for Neural Text Generation. In Arxiv Preprint.
• ppt: 20200301_cty
• method: context planning decoder+ style specification

2020/03/08 reporter: Songge Zhao

• paper: Cao Liu, Kang Liu .2019. Generating Questions for Knowledge Bases via Incorporating Diversified Contexts and Answer-Aware Loss. In EMNLP 2019.
• ppt: 20200308_zsg
• method: Divisified context + Transformer + Answer-aware loss

2020/03/29 repoter: Tianyang Cao

• paper: Deng Cai, Yan Wang, Wei Bi, ZhaoPeng Tu, XiaoJiang Liu, Shuming Shi. 2019. Retrieval-guided Dialogue Response Generation via a Matching-to-Generation Framework. In EMNLP 2019.
• ppt: 20200329_cty
• method: Matching score + skeleton to generation

2020/04/05 repoter: Songge Zhao

• paper: Weichao Wang , Shi Feng , Daling Wang , Yifei Zhang Answer-guided and Semantic Coherent Question Generation in Open-domain Conversation. In EMNLP 2019.
• ppt: 20200405_zsg
• method:RL + AL + CVAE genration

2020/04/26 repoter:Tianyang Cao

• paper: Yun-Zhu Song, Hong-Han Shuai, Sung-Lin Yeh, Yi-Lun Wu, Lun-Wei Ku, Wen-Chih Peng. 2020. Attractive or Faithful? Popularity-Reinforced Learning for Inspired Headline Generation. In AAAI 2020.
• ppt: 20200426_cty
• method: Article extractor with popular topic attention + popularity predictor + RL

2020/05/24 repoter: Tianyang Cao

• paper: Siqi Bao, Huang He, Fan Wang, Hua Wu and Haifeng Wang. 2020. PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable. In ACL 2020.
• ppt: 20200524_cty
• method: Discrete latent variable + context-response matching pretraining

2020/06/21 repoter: Tianyang Cao

• paper: Di Jin, Zhijing Jin, Joey Tianyi Zhou,Lisa Orii,Peter Szolovits. 2020. Hooks in the Headline: Learning to Generate Headlines with Controlled Styles. In ACL 2020.
• ppt: 20200621_cty
• method: Multitask learning and parameters sharing

2020/06/28 repoter: Songge Zhao

• paper: Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah. 2020. Language Models are Few-Shot Learners. In Arxiv Preprint.
• ppt: 20200628_zsg
• method: GPT3 pre_train LM

2020/07/12 repoter: Tianyang Cao

• paper: Zhiliang Tian, Wei Bi, Dongkyu Lee, Lanqing Xue, Yiping Song, Xiaojiang Liu, Nevin L. Zhang. 2020. Response-Anticipated Memory for On-Demand Knowledge Integration in Response Generation. In ACL 2020.
• ppt: 20200712_cty
• method: teacher-student framework + response-aware document memory construction

2020/07/26 repoter: Songge Zhao

• paper: Chao Zhao, Marilyn Walker, Snigdha Chaturvedi. 2020. Bridging the Structural Gap Between Encoding and Decoding for Data-To-Text Generation. In ACL 2020.
• ppt: 20200726_zsg
• method: GCN encoder with planning encoder on WebNLG

2020/08/02 repoter: Tianyang Cao

• paper1: Rashmi Gangadharaiah，Balakrishnan Narayanaswamy. 2020. Recursive Template-based Frame Generation for Task Oriented Dialog. In ACL 2020.
• paper2: Yanbin Zhao, Lu Chen, Zhi Chen, Ruisheng Cao, Su Zhu, Kai YuLine. 2020. Graph Enhanced AMR-to-Text Generation with Mix-Order GraphAttention Networks. In ACL 2020.
• ppt: 20200802_cty
• method: slot decoder + tree decoder, dual graph + mix order Graph Attention Network

2020/08/09 repoter: Huan Zhang

• paper: Bayu Distiawan Trisedya, Jianzhong, Qi Rui Zhang. 2020. Sentence Generation for Entity Description with Content-plan Attention. In AAAI 2020.
• ppt: 20200809_zh
• method: content plan + data-to-text

2020/08/23 repoter: Tianyang Cao

• paper: Tim Van de Cruys. 2020. Automatic Poetry Generation from Prosaic Text. In ACL 2020.
• ppt: 20200823_cty
• method: rhyme constraint + topic constraint (with nonnegative matrix factorization)

2020/09/26 repoter: Tianyang Cao

• paper: Silin Gao, Yichi Zhang1, Zhijian Ou1,Zhou Yu. 2020. Paraphrase Augmented Task-Oriented Dialog Generation In ACL 2020
• ppt: 20200926_cty
• method: paraphrase generation and two-stage decoder

2020/10/31 repoter: Xiaodan Xu

• paper: Shuang Chen, Jinpeng Wang, Xiaocheng Feng, Feng Jiang, Bing Qin, Chin-Yew Lin. 2019. Enhancing Neural Data-To-Text Generation Models with External Background Knowledge. In ACL 2019.
• ppt: 20201031_xxd
• method: entity linking + seq2seq framework

2020/10/31 repoter: Xiaodan Xu

• paper: Ratish Puduppully, Li Dong, Mirella Lapata. 2019. Data-to-text Generation with Entity Modeling In ACL 2019
• ppt: 20201031_xxd
• method: entity-special representations + hierarchical attention

2020/11/14 repoter: Tianyang Cao

• paper: Amirhossein Kazemnejad, Mohammadreza Salehi, Mahdieh Soleymani Baghshah. 2020. Paraphrase Generation by Learning How to Edit from Samples In ACL 2020.
• ppt: 20201114_cty
• method: transformer framework + edit provider + edit performer

2020/11/14 repoter: Tianyang Cao

• paper: Haozhe Ji, Pei Ke1, Shaohan Huang, Furu Wei, Xiaoyan Zhu, Minlie Huang. 2020.[Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph] In EMNLP 2020.
• ppt: 20201114_cty
• method: Multi-layer commonsense knowledge reasoning + GPT2

2020/12/12 repoter: Xiaodan Xu

• paper: Liying Cheng, Dekun Wu, Lidong Bing, Yan Zhang, Zhanming Jie, Wei Lu, Luo Si. 2020.ENT-DESC: Entity Description Generation by Exploring Knowledge Graph In EMNLP 2020.
• ppt: 20201212_xxd
• method: Multi-graph transformation + aggregation layer

2020/12/12 repoter: Xiaodan Xu

• paper: Xinyu Hua, Lu Wang. 2020.PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation In EMNLP 2020.
• ppt: 20201212_xxd
• method: Content planner based on BERT + generation framework based on BART + Iterative Refinement

2020/12/19 repoter: Tianyang Cao

• paper: Yufan Zhao, Can Xu, Wei Wu. 2020. Learning a Simple and Effective Model for Multi-turn Response Generation with Auxiliary Tasks In EMNLP 2020.
• ppt: 20201219_cty
• method: auxiliary tasks, including masked word recovery and order recovery

2020/12/19 repoter: Tianyang Cao

• paper: Zhangming Chan, Yuchi Zhang, Xiuying Chen, Shen Gao, Zhiqiang Zhang, Dongyan Zhao and Rui Yan. 2020. Selection and Generation: Learning towards Multi-Product Advertisement Post Generation In EMNLP 2020.
• ppt: 20201219_cty
• method: Selection Network + Multi-generator Network

2021/01/02 repoter: Songge Zhao

• paper: Rajat Agarwal. 2020. Acrostic Poem Generation In EMNLP 2020.
• ppt: 20210102_zsg
• method: Language model+Topic Prediction Model

2021/01/16 repoter: Xiaodan Xu

• paper: Qinzhuo Wu, Qi Zhang, Jinlan Fu, Xuanjing Huang. 2020. A Knowledge-Aware Sequence-to-Tree Network for Math Word Problem Solving In EMNLP 2020.
• ppt: 20210116_xxd
• method: entity graph + tree-structured decoder + state aggregation mechanism

2021/01/16 repoter: Xiaodan Xu

• paper: Jinghui Qin, Lihui Lin, Xiaodan Liang, Rumin Zhang, Liang Lin 2020. Semantically-Aligned Universal Tree-Structured Solver for Math Word Problems In EMNLP 2020.
• ppt: 20210116_xxd
• method: universal expression tree + tree-structured decoder

2021/01/16 repoter: Xiaodan Xu

• paper: Zhipeng Xie, Shichao Sun 2020. A Goal-Driven Tree-Structured Neural Model for Math Word Problems In IJCAI 2019.
• ppt: 20210116_xxd
• method: top-down goal decomposition + bottom-up subtree embedding

2021/03/20 reporter: Xiaodan Xu

• paper: Arkil Patel, Satwik Bhattamishra, Navin Goyal. 2020. Are NLP Models really able to Solve Simple Math Word Problems? In NAACL 2021.
• ppt: 20210320_xxd
• method: A New DataSet for Math Word Problem Solving, which reveals the deficiency of current benchmark datasets.

2021/04/24 reporter: Xiaodan Xu

• paper: Shangqing Liu, Yu Chen, Xiaofei Xie, Jingkai Siow, Yang Liu. 2021. Retrieval-Augmented Generation for Code Summarization via Hybrid GNN In ICLR 2021.
• ppt: 20210424_xxd
• method: Retrieval Augmented + Hybrid GNN with static and dynamic graph.

2021/05/15 reporter: Xiaodan Xu

• paper: Prakhar Gupta, Jeffrey P. Bigham, Yulia Tsvetkov, Amy Pavel. 2021. Controlling Dialogue Generation with Semantic Exemplars In NAACL 2021.
• ppt: 20210515_xxd
• method: Frame Extraction + Dialogue Generation Framework.

2021/05/15 reporter: Xiaodan Xu

• paper: Deng Cai, Yan Wang, Wei Bi, Zhaopeng Tu, Xiaojiang Liu, Shuming Shi. 2019. Retrieval-guided Dialogue Response Generation via a Matching-to-Generation Framework In EMNLP 2019.
• ppt: 20210515_xxd
• method: Skeleton Extraction + Pipeline Generation.

5. Medical Text Processing

2020/03/01 reporter: Huan Zhang

• paper: Bansal, T., Verga, P., Choudhary, N., & McCallum, A. 2019. Simultaneously Linking Entities and Extracting Relations from Biomedical Text Without Mention-level Supervision. In AAAI 2020.
• ppt: 20200301_zh
• method: Simultaneously link entities and extract relationships

2020/10/17 reporter: Huan Zhang

• paper: Yun He, Ziwei Zhu, Yin Zhang, Qin Chen, James Caverlee. 2020. Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition. In emnlp 2020.
• ppt: 20201017_zh
• method: disease knowledge + bert + pretrained

2020/12/05 reporter: Huan Zhang

• ppt: 20201205_zh
• paper: Alan Ramponi, Rob van der Goot, Rosario Lombardo, Barbara Plank, 2020. Biomedical Event Extraction as Sequence Labeling. In Emnlp 2020.
• method: biomedical event extraction + sequence labeling

6. Named Entity Recognition

2020/03/29 reporter: Huan Zhang

• paper: Angli Liu, Jingfei Du, Veselin Stoyanov, 2019. Knowledge-Augmented Language Model and Its Application to Unsupervised Named-Entity Recognition. In NAACL 2019.
• ppt: 20200329_zh
• method: LM + KB + unsupervised + ner(plain text)

2020/04/26 reporter: Huan Zhang

• paper: Changmeng Zheng, Yi Cai, Jingyun Xu, Ho-fung Leung and Guandong Xu, 2019. A Boundary-aware Neural Model for Nested Named Entity Recognition. In EMNLP 2019.
• ppt: 20200426_zh
• method: Boundary-aware + categorical labels prediction + nested ner

2020/05/24 reporter: Huan Zhang

• paper: Esteban Safranchik, Shiying Luo, Stephen H. Bach, 2020. Weakly Supervised Sequence Tagging from Noisy Rules. In AAAI 2020.
• ppt: 20200524_zh
• method: Weakly Supervised + Rules

2020/06/14 reporter: Xudong Chen

• paper: Xiaoya Li, Jingrong Feng, Yuxian Meng, Qinghong Han, Fei Wu and Jiwei Li, 2020. A Unified MRC Framework for Named Entity Recognition. In ACL 2020.
• ppt: 20200614_cxd
• method: Weakly Supervised + Rules

2020/06/21 reporter: Huan Zhang

• paper: Hiroki Ouchi, Jun Suzuki, Sosuke Kobayashi, Sho Yokoi, Tatsuki Kuribayashi, Ryuto Konno, Kentaro Inui, 2020. Instance-Based Learning of Span Representations:A Case Study through Named Entity Recognition. In ACL 2020.
• ppt: 20200621_zh
• method: instence-based + ner

2020/06/28 reporter: Yuan Zong

• paper: Xiang Dai, Sarvnaz Karimi, Ben Hachey, Cecile Paris1 2020. An Effective Transition-based Model for Discontinuous NER. In ACL 2020.
• ppt: 20200628_zy
• method: ner like dependency parsing

2020/07/12 reporter: Huan Zhang

• paper: Bill Yuchen Lin, Dong-Ho Lee, Ming Shen, Ryan Moreno, Xiao Huang, Prashant Shiralkar, Xiang Ren, 2020. TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognition. In ACL 2020.
• ppt: 20200712_zh
• method: entity trigger + ner -> cost-effective result

2020/09/20 reporter: Huan Zhang

• paper: Minlong Peng, Ruotian Ma, Qi Zhang, Xuanjing Huang, 2020. Simplify the Usage of Lexicon in Chinese NER. In ACL 2020.
• ppt: 20200920_zh
• method: lexicon + named entity recognition

2020/09/26 reporter: Runxin Xu

• ppt: 20200926_zh
• method: Chinese named entity recognition

2020/12/05 reporter: Huan Zhang

• ppt: 20201205_zh
• paper: Yuyang Nie, Yuanhe Tian, Xiang Wan, Yan Song, Bo Dai, 2020. Named Entity Recognition for Social Media Texts with Semantic Augmentation. In Emnlp 2020.
• method: social media texts + semantic AU + ner

2021/01/23 reporter: Yuan Zong

• paper: Qianhui Wu, Zijia Lin, Borje F. Karlsson, Jian-Guang Lou and Biqing Huang 2020. Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language. In ACL 2020.
• ppt: 20210123_zy
• method: ner + teacher-student

7. Law Judgement Prediction

2020/05/03 reporter: Xudong Chen

• paper: Nuo Xu, PinghuiWang, Long Chen, Li Pan, Xiaoyan Wang, Junzhou Zhao, 2020. Distinguish Confusing Law Articles for Legal Judgment Prediction. In ACL 2020.
• ppt: 20200503_cxd
• method: GCL + GDO

8. Discourse Parsing

2020/05/12 reporter: Wei Cui

• paper: Longyin Zhang, Yuqing Xing, Fang Kong, Peifeng Li, Guodong Zhou. 2020. A Top-Down Neural Architecture towards Text-Level Parsing of Discourse Rhetorical Structure. In ACL 2020.
• ppt: 20200512_cw
• method: GRU-CNN-GRU encoder + biaffine attention + Attention-based Encoder-Decoder on Split Point Ranking

9. Knowledge Distilling

2020/05/12 reporter: Runxin Xu

• paper: Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu. 2020. TinyBERT: Distilling BERT for Natural Language Understanding. In ICLR 2020.
• ppt: 20200512_xrx
• method: Konwledge Distilling

10. Data Augmentation

2020/05/31 reporter: Yuan Zong

• paper: Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu. 2020. MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification. In ACL 2020.
• ppt: 20200531_zy
• method: Data mixing + Semi-supervised

2020/12/19 reporter: Yuan Zong

• paper: Akari Asai and Hannaneh Hajishirzi. 2020. [Logic-Guided Data Augmentation and Regularization for Consistent Question Answering (https://www.aclweb.org/anthology/2020.acl-main.499/). In EMNLP 2020.
• ppt: 20201219_zy
• method: Data Augmentation + Regularization

11. Transformer

2020/06/07 reporter: Runxin Xu

• paper: Hao Peng, Roy Schwartz, Dianqi Li, Noah A. Smith. 2020. A Mixture of h−1 Heads is Better than h Heads. In ACL 2020.
• ppt: 20200607_xrx
• method: Consider multi-head self-attention as a mixture of experts + modify gate mechanism

2020/08/09 reporter: Runxin Xu

• paper: Weiqiu You, Simeng Sun, Mohit Iyyer. 2020. Hard-Coded Gaussian Attention for Neural Machine Translation. In ACL 2020.
• ppt: 20200809_xrx
• method: Replace learned dot-product self-attention with hard-coded gaussian attention.

12. Numerical Embedding

2020/05/17 reporter: Songge Zhao

• paper: Mor Geva, Ankit Gupta, Jonathan Berant. 2020. Injecting Numerical Reasoning Skills into Language Models. In ACL 2020.
• ppt: 20200517_zsg
• method: Specific Pre-training + fine-tuning

2020/05/31 reporter: Songge Zhao

• paper: Eric Wallace, Yizhong Wang, Sujian Li, Sameer Singh, Matt Gardner. 2019. Do NLP Models Know Numbers? Probing Numeracy in Embeddings. In EMNLP 2019.
• ppt: 20200531_zsg
• method: to be fixed

13. Question Answering

2020/07/05 reporter: Shuang Zeng

• paper1: Lin Qiu, Yunxuan Xiao, Yanru Qu, Hao Zhou, Lei Li, Weinan Zhang, Yong Yu. 2019. Dynamically Fused Graph Network for Multi-hop Reasoning. In ACL 2019.
• paper2: Nan Shao, Yiming Cui, Ting Liu, Shijin Wang, Guoping Hu. 2020. Is Graph Structure Necessary for Multi-hop Reasoning?. In Arxiv Preprint.
• ppt: 20200705_zs
• method: Paragraph Selector + Constructing Entity Graph + Encoding Query and Context + Reasoning with the Fusion Block

2020/07/05 reporter: Xudong Chen

• paper: Shaoru Guo, Ru Li, Hongye Tan, Xiaoli Li, Yong Guan,Hongyan Zhao and Yueping Zhang. 2020. A Frame-based Sentence Representation for Machine Reading Comprehension. In ACL 2020.
• ppt: 20200705_cxd
• method: Bert + Frame-based Sentence Representation

2020/09/19 reporter: Ce Zheng

• paper: Jingjing Xu, Yuechen Wang, Duyu Tang, Nan Duan, Pengcheng Yang, Qi Zeng, Ming Zhou and Xu Sun. 2019. Asking Clarification Questions in Knowledge-Based Question Answering. In EMNLP 2019.
• ppt: 20200919_zc
• method: Knowledge based data collection

2020/12/19 reporter: Yuan Zong

• paper: Xuguang Wang, Linjun Shou, Ming Gong, Nan Duan, Daxin Jiang. 2020. No Answer is Better Than Wrong Answer: A Reflection Model for Document Level Machine Reading Comprehension. In EMNLP 2020.
• ppt: 20201219_zy
• method: reflection model

2021/01/23 reporter: Yuan Zong

• paper: Yeon Seonwoo, Ji-Hoon Kim, Jung-Woo Ha, Alice Oh. 2020. Context-Aware Answer Extraction in Question Answering. In EMNLP 2020.
• ppt: 20210123_zy
• method: Block Attention

2021/04/23 reporter: Xudong Chen

• paper: M. Yasunaga, H. Ren, A. Bosselut, P. Liang, J. Leskovec. 2021. QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering. In NAACL 2021.
• ppt: 20210423_cxd
• method: GCN

14. Chinese Word Segmentation and Semi-Supervised Learning

reporter: Yuan Zong

• paper: Ning Ding, Dingkun Long, Guangwei Xu, Muhua Zhu, Pengjun Xie, Xiaobin Wang, Hai-Tao Zheng. 2020. Coupling Distant Annotation and Adversarial Training for Cross-Domain Chinese Word Segmentation. In ACL 2020.
• ppt: 20200717_zy
• method: Distant Annotation and Adversarial Training

reporter: Yuan Zong

• paper: Mingda Chen, Qingming Tang, Karen Livescu, Kevin Gimpel. 2018. Variational Sequential Labelers for Semi-Supervised Learning. In EMNLP 2018.
• ppt: 20200823_zy
• method: VAE and Semi-Supervised Learning

reporter: Yuan Zong

• paper: Jiaao Chen, Zhenghui Wang, Ran Tian, Zichao Yang, Diyi YangLocal Additivity Based Data Augmentation for Semi-supervised NER. In EMNLP 2020.
• ppt: 20201010_zy
• method: mixer and Semi-Supervised Learning

reporter: Yuan Zong

• paper: Bosheng Ding, Linlin Liu, Lidong Bing, Canasai Kruengkrai, Thien Hai Nguyen, Shafiq Joty, Luo Si, Chunyan MiaoDAGA: Data Augmentation with a Generation Approach for Low-resource Tagging Tasks. In EMNLP 2020.
• ppt: 20201107_zy
• method: Data augmentation

reporter: Yuan Zong

• paper: Dayiheng Liu, Yeyun Gong, Jie Fu, Yu Yan, Jiusheng Chen, Jiancheng Lv, Nan Duan, Ming ZhouTell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space. In EMNLP 2020.
• ppt: 20201107_zy
• method: MRC and data augmentation

15. Machine Translation

2020/08/09 reporter: Runxin Xu

• paper: Jian Yang, Shuming Ma, Dongdong Zhang, Zhoujun Li, Ming Zhou. 2020. Improving Neural Machine Translation with Soft Template Prediction. In ACL 2020.
• ppt: 20200809_xrx
• method: Soft Template in Target Side.

16. Question Generation

2020/09/06 reporter: Xudong Chen

• paper: Liangming Pan Yuxi Xie Yansong Feng Tat-Seng Chua Min-Yen Kan. 2020. Semantic Graphs for Generating Deep Questions. In ACL 2020.
• ppt: 20200906_cxd
• method: GCN.

2021/03/20 reporter: Xiaodan Xu

• paper: Xiyao Ma, Qile Zhu, Yanlin Zhou, Xiaolin Li, Dapeng Wu. 2020. Improving Question Generation with Sentence-level Semantic Matching and Answer Position Inferring In AAAI 2020.
• ppt: 20210320_xxd
• method: Seq2Seq + Sentence-level Semantic Matching + Answer Position Inferring

2021/04/24 reporter: Xiaodan Xu

• paper: Xiaojing Yu, Anxiao (Andrew) Jiang. 2021. Expanding, Retrieving and Infilling: Diversifying Cross-Domain Question Generation with Flexible Templates In EACL 2021.
• ppt: 20210424_xxd
• method: Soft Template Retrieval + Neural Generation.

17. Language Model

2020/10/10 reporter: Shuang Zeng

• paper: Ikuya Yamada, Akari Asai, Hiroyuki Shindo, Hideaki Takeda, Yuji Matsumoto. 2020. LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention. In EMNLP 2020.
• ppt: 20201010_zs
• method: Pre-training models treating entity as token, proposing entity-aware self-attention mechanism.

2021/01/05 reporter: Huan Zhang

• paper: Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu. 2019. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. In ACL 2019.
• ppt: 20210102_zh
• method: google T5 model

18. Abstractive Summarization

2020/12/05 reporter: Xudong Chen

• paper: Hanqi Jin,Tianming Wang,Xiaojun Wan. 2020. SemSUM: Semantic Dependency Guided Neural Abstractive Summarization. In AAAI 2020.
• ppt: 20201205_cxd
• method: Semantic Dependency Parsing

19. Sequence Labeling

2021/01/05 reporter: Huan Zhang

• paper: Ben Athiwaratkun, Cicero Nogueira dos Santos, Jason Krone, Bing Xiang. 2020. Augmented Natural Language for Generative Sequence Labeling. In EMNLP 2020.
• ppt: 20210102_zh
• method: Pre-training models + fine tuning + generated sequence labeling