Skip to main content

Research Repository

Advanced Search

Dual encoding for abstractive text summarization

Yao, Kaichun; Zhang, Libo; Du, Dawei; Luo, Tiejian; Tao, Lili; Wu, Yanjun

Dual encoding for abstractive text summarization Thumbnail


Authors

Kaichun Yao

Libo Zhang

Dawei Du

Tiejian Luo

Lili Tao

Yanjun Wu



Abstract

Recurrent Neural Network (RNN) based sequence-to-sequence attentional models have proven effective in abstractive text summarization. In this paper, we model abstractive text summarization using a dual encoding model. Different from the previous works only using a single encoder, the proposed method employs a dual encoder including the primary and the secondary encoders. Specifically, the primary encoder conducts coarse encoding in a regular way, while the secondary encoder models the importance of words and generates more fine encoding based on the input raw text and the previously generated output text summarization. The two level encodings are combined and fed into the decoder to generate more diverse summary that can decrease repetition phenomenon for long sequence generation. The experimental results on two challenging datasets (i.e., CNN/DailyMail and DUC 2004) demonstrate that our dual encoding model performs against existing methods.

Citation

Yao, K., Zhang, L., Du, D., Luo, T., Tao, L., & Wu, Y. (2020). Dual encoding for abstractive text summarization. IEEE Transactions on Cybernetics, 50(3), 985-996. https://doi.org/10.1109/TCYB.2018.2876317

Journal Article Type Article
Acceptance Date Sep 2, 2018
Online Publication Date Nov 2, 2018
Publication Date 2020-01
Deposit Date Oct 4, 2018
Publicly Available Date Oct 4, 2018
Journal IEEE Transactions on Cybernetics
Print ISSN 2168-2267
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Volume 50
Issue 3
Pages 985-996
DOI https://doi.org/10.1109/TCYB.2018.2876317
Public URL https://uwe-repository.worktribe.com/output/861884
Publisher URL http://dx.doi.org/10.1109/TCYB.2018.2876317
Additional Information Additional Information : (c) 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.

Files







Downloadable Citations