MicroBERT: Distilling MoE-Based Knowledge from BERT into a Lighter Model

Dashun Zheng, Jiaxuan Li, Yunchu Yang, Yapeng Wang, Patrick Cheong Iao Pang

Faculty of Applied Sciences

Macao Polytechnic University

Research output: Contribution to journal › Article › peer-review

1 results
- Title
- Date(ascending)

Faculty of Applied Sciences Researchers Provide New Study Findings on Applied Sciences (MicroBERT: Distilling MoE-Based Knowledge from BERT into a Lighter Model)
CHEONG IAO PANG & YAPENG WANG
9/08/24
1 item of Media coverage
Press/Media