Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL [Paper]
Qihuang Zhong, Kunfeng Chen, Liang Ding, Juhua Liu*, Bo Du*, Dacheng Tao
Findings of Association for Computational Linguistics: EMNLP 2024. (CORE Rank A)

Revisiting Knowledge Distillation for Autoregressive Language Models [Paper]
Qihuang Zhong, Liang Ding, Li Shen, Juhua Liu*, Bo Du*, Dacheng Tao
The Annual Meeting of the Association for Computational Linguistics, 2024 (ACL 2024) (CORE Rank A*)

ROSE Doesn't Do That: Boosting the Safety of Instruction-Tuned Large Language Models with Reverse Prompt Contrastive Decoding [Paper]
Qihuang Zhong, Liang Ding, Juhua Liu*, Bo Du*, Dacheng Tao
Findings of Association for Computational Linguistics: ACL 2024. (CORE Rank A*)

Zero-shot Sharpness-Aware Quantization for Pre-trained Language Models [Paper]
Miaoxi Zhu#, Qihuang Zhong#, Li Shen, Liang Ding, Juhua Liu*, Bo Du*, Dacheng Tao
The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) (CORE Rank A)

Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks [Paper]
Haoqi Zheng#, Qihuang Zhong#, Liang Ding, Zhiliang Tian, Xin Niu, Changjian Wang, Dongsheng Li, Dacheng Tao
The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) (CORE Rank A)

Towards Making the Most of ChatGPT for Machine Translation [Paper]
Keqin Peng, Liang Ding, Qihuang Zhong, Li Shen, Xuebo Liu, Min Zhang, Yuanxin Ouyang, Dacheng Tao
Findings of Association for Computational Linguistics: EMNLP 2023. (CORE Rank A)

Revisiting Token Dropping Strategy in Efficient BERT Pretraining [Paper]
Qihuang Zhong, Liang Ding, Juhua Liu*, Xuebo Liu, Min Zhang, Bo Du*, Dacheng Tao
The Annual Meeting of the Association for Computational Linguistics, 2023 (ACL 2023) (CORE Rank A*)

Self-Evolution Learning for Discriminative Language Model Pretraining [Paper]
Qihuang Zhong#, Liang Ding#, Juhua Liu*, Bo Du*, Dacheng Tao
Findings of The Annual Meeting of the Association for Computational Linguistics, 2023 (ACL 2023) (CORE Rank A*)

Token-Level Self-Evolution Training for Sequence-to-Sequence Learning [Paper]
Keqin Peng#, Liang Ding#, Qihuang Zhong, Yuanxin Ouyang, Wenge Rong, Zhang Xiong, and Dacheng Tao.
The Annual Meeting of the Association for Computational Linguistics, 2023 (ACL 2023) (CORE Rank A*)
(Shortlisted for the best paper candidate)

Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models [Paper] [Code]
Qihuang Zhong, Liang Ding, Li Shen, Peng Mi, Juhua Liu*, Bo Du*, Dacheng Tao
Findings of Association for Computational Linguistics: EMNLP 2022. (CORE Rank A)

A Contrastive Cross-channel Data Augmentation Framework for Aspect-based Sentiment Analysis [Paper] [ArXiv] [Code]
Bing Wang, Liang Ding*, Qihuang Zhong, Ximing Li, Dacheng Tao
International Conference on Computational Linguistics (COLING 2022). (CORE Rank A)

Panda: Prompt transfer meets knowledge distillation for efficient model adaptation [Paper] [Code]
Qihuang Zhong, Liang Ding, Juhua Liu*, Bo Du*, Dacheng Tao
IEEE Transactions on Knowledge and Data Engineering, 2024. (CORE Rank A*)

E2S2: Encoding-enhanced sequence-to-sequence pretraining for language understanding and generation [Paper] [Code]
Qihuang Zhong, Liang Ding, Juhua Liu*, Bo Du*, Dacheng Tao
IEEE Transactions on Knowledge and Data Engineering, 2023. (CORE Rank A*)

AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks [Paper]
Hao Sun, Li Shen, Qihuang Zhong, Liang Ding, Shixiang Chen, Jingwei Sun, Jing Li, Guangzhong Sun, Dacheng Tao
Neural Networks, 2023. (CORE Rank A)

Unified instance and knowledge alignment pretraining for aspect-based sentiment analysis [Paper] [Code]
Juhua Liu#, Qihuang Zhong#, Liang Ding, Hua Jin, Bo Du*, Dacheng Tao
IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023.

Knowledge graph augmented network towards multiview representation learning for aspect-based sentiment analysis [Paper] [Code]
Qihuang Zhong, Liang Ding, Juhua Liu*, Bo Du*, Hua Jin, Dacheng Tao
IEEE Transactions on Knowledge and Data Engineering, 2023. (CORE Rank A*)

Joint image and feature adaptative attention-aware networks for cross-modality semantic segmentation [Paper]
Qihuang Zhong, Fanzhou Zeng, Fei Liao*, Juhua Liu*, Bo Du, Jedi S Shang
Neural Computing and Applications, 2023. (CORE Rank B)

SemiText: Scene text detection with semi-supervised learning [Paper]
Juhua Liu, Qihuang Zhong, Yuan Yuan, Hai Su, Bo Du*
Neurocomputing, 2020. (CORE Rank B)

[04/2024] Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Better Reasoners [Paper]
Qihuang Zhong#, Kang Wang#, Ziyang Xu, Juhua Liu*, Liang Ding, Bo Du*, Dacheng Tao

[02/2023] Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT [Report] [Code]
Qihuang Zhong, Liang Ding, Juhua Liu*, Bo Du*, Dacheng Tao

[02/2023] Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE [Report] [GLUE leaderboard]
Qihuang Zhong#, Liang Ding#, Keqin Peng, Juhua Liu*, Bo Du*, Li Shen, Yibing Zhan, Dacheng Tao

[12/2022] Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE [Report] [SuperGLUE leaderboard]
Qihuang Zhong#, Liang Ding#, Yibing Zhan, Yu Qiao, Yonggang Wen, Li Shen, Juhua Liu*, Baosheng Yu, Bo Du*, Yixin Chen, Xinbo Gao, Chunyan Miao, Xiaoou Tang, Dacheng Tao