Search results

Add loss subbatch for dsv3 128k training

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 11126

#11126 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Sep 29, 2025

Supports droping the masked tokens in MoE dispatching and fix some bugs

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 11114

#11114 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Sep 29, 2025

Adapt global_norm_clip for hybrid expert parallel

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 11061

#11061 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Sep 3, 2025

[Cherry-pick] Cherry-pick hybrid-expert parallel related PRs from fleety

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 11052

#11052 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Sep 3, 2025

Fix bug in subbatch and add 128k sft config

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 11032

#11032 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Aug 29, 2025

support sequence parallel in deepseek v3 model

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 11001

#11001 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Aug 28, 2025

Support sequence parallel in deepseek-v3 model

Status: Closed (abandoned).

PaddlePaddle/PaddleNLPnumber 11000

#11000 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Aug 25, 2025

[Bug Fix] Fix the compability bug of distributed strategy

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 10545

#10545 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on May 6, 2025

[Bug Fix] Fix the bug in hybrid expert parallel when moe sharding degree=1

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 10536

#10536 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on May 6, 2025

[Bug fix] Fix the bug when checking moe_sharding_degree

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 10526

#10526 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Apr 29, 2025

Adapt hybrid expert parallel

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 10501

#10501 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Apr 28, 2025

[CherryPick] add import check of local_layer

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 10038

#10038 In PaddlePaddle/PaddleNLP;

· by pkuzyc was closed on Mar 7, 2025