Search results

[LLM] revert benchmark codes

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 7871

#7871 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Jan 22, 2024

[LLM] Fix v100 csrc building

inference

stale

Status: Closed (abandoned).

PaddlePaddle/PaddleNLPnumber 7785

#7785 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Sep 9, 2025

[LLM] Support block_attention/cachekv quant for llama

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 7649

#7649 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Jan 10, 2024

support v100 csrc

stale

Status: Closed (abandoned).

PaddlePaddle/PaddleNLPnumber 7600

#7600 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Apr 8, 2025

Restruct 52 open

stale

Status: Closed (abandoned).

PaddlePaddle/PaddleNLPnumber 7596

#7596 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Jun 10, 2025

[LLM] Support ptq inference

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 7224

#7224 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Nov 13, 2023

[LLM] Reconstruct fused transformer layers

Status: Merged (completed).

PaddlePaddle/PaddleNLPnumber 7186

#7186 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Oct 12, 2023

[LLM] Dynamic cachekv int8

stale

Status: Closed (abandoned).

PaddlePaddle/PaddleNLPnumber 7126

#7126 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Dec 17, 2024

[LLM] Support ptq inference for llama

Status: Closed (abandoned).

PaddlePaddle/PaddleNLPnumber 7093

#7093 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Oct 13, 2023

[LLM] support llama ptq dygraph inference

Status: Closed (abandoned).

PaddlePaddle/PaddleNLPnumber 6877

#6877 In PaddlePaddle/PaddleNLP;

· by RichardWooSJTU was closed on Sep 20, 2023