Skip to content

Conversation

jm12138
Copy link
Contributor

@jm12138 jm12138 commented May 28, 2021

PR types

  • 添加预训练模型

PR changes

  • 添加 CPM-Distill 预训练模型

Description

  • 一个通过知识蒸馏得到的小型 GPT 预训练模型
  • 源 Repo : TsinghuaAI/CPM-Distill
  • Paddle 格式的预训练模型下载 : 链接

@ZeyuChen ZeyuChen requested a review from ZHUI May 28, 2021 07:54
Copy link
Member

@ZeyuChen ZeyuChen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ZeyuChen
Copy link
Member

@ZHUI Please upload the params to BOS according to the code, then merge the code after testing.

@ZeyuChen
Copy link
Member

@jm12138 Thanks for your contribution! :)

@ZHUI
Copy link
Contributor

ZHUI commented May 28, 2021

@ZHUI Please upload the params to BOS according to the code, then merge the code after testing.

ok,get it!

Copy link
Contributor

@ZHUI ZHUI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ZHUI ZHUI merged commit 880b4e2 into PaddlePaddle:develop May 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants